W3C home > Mailing lists > Public > public-test-infra@w3.org > July to September 2011

Framework next steps

From: Philippe Le Hegaret <plh@w3.org>
Date: Fri, 22 Jul 2011 09:50:43 -0400
To: "Michael(tm) Smith" <mike@w3.org>, Fran├žois Daoust <fd@w3.org>
Cc: public-test-infra <public-test-infra@w3.org>
Message-ID: <1311342643.3504.203.camel@chacal>
Mike, Francois,

Some thoughts on the new framework.

now that the framework is deployed, we need to start improving and
documenting along the way as well.

Improvement:

Looking at
 http://w3c-test.org/framework/suite/nav-timing-default/

Mike has been missing some metadata. I added some on
 http://w3c-test.org/webperf/tests/
but it would be good to start documenting how we want to feed the
database.

Looking at
http://w3c-test.org/framework/test/nav-timing-default/test_document_open/

I see a number of issues:

- this is a script test and should be ran automatically by default
- link to reference page is not necessary
- number of tests reported: the test itself is problematic since it
doesn't report how many tests it contains and are failing. It contains
21 tests in fact. At the minimum, we need to tweak the test.
- we need to start documenting (in the public wiki) how to write tests
for the framework, starting with script tests and reftests.

Philippe
Received on Friday, 22 July 2011 13:50:50 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Friday, 22 July 2011 13:50:51 GMT