W3C home > Mailing lists > Public > public-web-perf@w3.org > September 2012

Tests returning an inconsistent number of results

From: James Graham <jgraham@opera.com>
Date: Thu, 13 Sep 2012 10:31:16 +0200
Message-ID: <505199D4.20506@opera.com>
To: public-web-perf@w3.org
Several test submissions here use a design where if the feature is not 
available they fail to run the rest of the testsuite (e.g. [1]). This is 
an antipattern because it makes it unnecessarily difficult to compare 
the results between builds; ideal tests should always return the same 
number of results.

Will anyone object if I patch the problematic tests and commit the fixes?

[1] 
http://w3c-test.org/webperf/tests/submission/Google/HighResolutionTime/test_cross_frame_start.html
Received on Thursday, 13 September 2012 08:31:55 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Thursday, 13 September 2012 08:31:56 GMT