W3C home > Mailing lists > Public > public-css-testsuite@w3.org > September 2010

Re: Conversion of MS CSS 2.1 tests to reftests

From: Boris Zbarsky <bzbarsky@MIT.EDU>
Date: Tue, 21 Sep 2010 13:20:43 -0400
Message-ID: <4C98E96B.5000800@mit.edu>
To: Sylvain Galineau <sylvaing@microsoft.com>
CC: "public-css-testsuite@w3.org" <public-css-testsuite@w3.org>
On 9/21/10 11:21 AM, Sylvain Galineau wrote:
> Running the test suite takes about 3 days.

The HTML 4.01 version of the test suite has 7989 tests in it.  3 work 
days is 86400 seconds.  So you're saying that the test suite can be run 
at 11 seconds per test without taking any breaks, right?  Without slave 
labor?  And without making mistakes?

Or did you mean that if you task enough people with doing it you can run 
the test suite in 3 days?

Fwiw, I just tried running a few of the tests, and I think 30 seconds 
per test is a good estimate for the simple ones (that's how long they 
take me to run given the network lag, etc); the more complicated ones 
need more time than that to just read.  That gives me a lower bound of 
about 8 person-days, assuming 100% efficiency.  I'd be really surprised 
if someone can run the test suite for more than an hour or two straight 
without starting to make mistakes, though, so you either need to have 
redundancy or a lot more people doing a bit at a time...

That's just the HTML version of the test suite, note.

-Boris
Received on Tuesday, 21 September 2010 17:21:16 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Tuesday, 21 September 2010 17:21:22 GMT