W3C home > Mailing lists > Public > public-test-infra@w3.org > October to December 2011

[Bug 15062] Test results appearing in other test suites

From: <bugzilla@jessica.w3.org>
Date: Mon, 05 Dec 2011 20:10:36 +0000
To: public-test-infra@w3.org
Message-Id: <E1RXes0-0000Rt-S7@jessica.w3.org>
https://www.w3.org/Bugs/Public/show_bug.cgi?id=15062

--- Comment #4 from Peter Linss <peter.linss@hp.com> 2011-12-05 20:10:36 UTC ---
If the tests are the same but only presented in a different format, then they
should have the same name. The framework still considers them to be the same
test but does record which format the result was reported against.

The summary report will merge results from different formats, but the details
report displays the format information.

The test suites are not meant to be separated by format, but to track the
different formats within a single suite.

You can also designate which formats should be excluded for specific tests by
setting the appropriate flags for those tests (and the corresponding filter
flags in the format information). 

This is sounding like a setup issue, and possibly a different expectation of
test results. 

Instead of having different test suites, you should only have one, with the
proper test urls set per format. It looks like you also need to get Mike to set
up the proper format information.

-- 
Configure bugmail: https://www.w3.org/Bugs/Public/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.
Received on Monday, 5 December 2011 20:10:43 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Monday, 5 December 2011 20:10:44 GMT