W3C home > Mailing lists > Public > public-html-testsuite@w3.org > November 2010

Re: Test results and report table

From: Maciej Stachowiak <mjs@apple.com>
Date: Tue, 02 Nov 2010 14:45:45 +0100
Cc: Jonathan Griffin <jgriffin@mozilla.com>, Alexander Mertens <alexander.mertens@stud.fh-dortmund.de>, "miss.verstaendnis@nurfuerspam.de" <miss.verstaendnis@nurfuerspam.de>, Mikkel Toudal Kristiansen <mikkel.kristiansen@gmail.com>, Kris Krueger <krisk@microsoft.com>, Philippe Le Hegaret <plh@w3.org>, Anne van Kesteren <annevk@opera.com>, "'public-html-testsuite@w3.org'" <public-html-testsuite@w3.org>
Message-id: <E4881D79-F1CA-4F6E-A09E-3DA014B556AC@apple.com>
To: Paul Cotton <Paul.Cotton@microsoft.com>

On Nov 2, 2010, at 2:34 PM, Paul Cotton wrote:

>> It's also strange that the results include alpha/beta/preview versions of most browsers, but the stable version of Safari.
> 
> Isn't this best solved by someone from Apple providing the most recent results for whatever alpha/beta/preview version of Safari that you want represented?

It would be easy for anyone who cared to, to do so using a build from <http://nightly.webkit.org/>. 

The results for all browsers (IE included) are incomplete (afaict). I'm sure we'll all eventually have more resources run through the full test suite. But publishing the incomplete and non-comparable results as "Official" seems like a bad move in the meantime. I would suggest replacing that word with "Unofficial" and adding a disclaimer on the limitations, in addition to fixing the blatant bugs in the pass percentages.

Regards,
Maciej
Received on Tuesday, 2 November 2010 13:46:23 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Tuesday, 2 November 2010 13:46:23 GMT