- From: Boris Zbarsky <bzbarsky@MIT.EDU>
- Date: Tue, 21 Sep 2010 13:20:43 -0400
- To: Sylvain Galineau <sylvaing@microsoft.com>
- CC: "public-css-testsuite@w3.org" <public-css-testsuite@w3.org>
On 9/21/10 11:21 AM, Sylvain Galineau wrote: > Running the test suite takes about 3 days. The HTML 4.01 version of the test suite has 7989 tests in it. 3 work days is 86400 seconds. So you're saying that the test suite can be run at 11 seconds per test without taking any breaks, right? Without slave labor? And without making mistakes? Or did you mean that if you task enough people with doing it you can run the test suite in 3 days? Fwiw, I just tried running a few of the tests, and I think 30 seconds per test is a good estimate for the simple ones (that's how long they take me to run given the network lag, etc); the more complicated ones need more time than that to just read. That gives me a lower bound of about 8 person-days, assuming 100% efficiency. I'd be really surprised if someone can run the test suite for more than an hour or two straight without starting to make mistakes, though, so you either need to have redundancy or a lot more people doing a bit at a time... That's just the HTML version of the test suite, note. -Boris
Received on Tuesday, 21 September 2010 17:21:16 UTC