W3C home > Mailing lists > Public > public-css-testsuite@w3.org > September 2010

Re: Automating testcases

From: Bjoern Hoehrmann <derhoermi@gmx.net>
Date: Sun, 05 Sep 2010 19:44:04 +0200
To: Geoffrey Sneddon <gsneddon@opera.com>
Cc: public-css-testsuite@w3.org, Arron.Eicholz@microsoft.com
Message-ID: <6pj786559972ns2tqcmdlnn8e63sjrr3si@hive.bjoern.hoehrmann.de>
* Geoffrey Sneddon wrote:
>However, the first large set of tests that it makes sense to automate 
>are tests submitted by Microsoft: there are 400–500 tests for which the 
>reference is effectively just "<p>Test passes if there is no red visible 
>on the page.</p>". This is the largest collection of tests in the 
>testsuite with a single reference.
>
>If we (i.e., the browser vendors apart from MS represented at the 
>meeting, Apple, Google, Mozilla, and Opera) wish to convert them to 
>reftests, how should we go about this?

Checking that a browser's rendering of a document contains no red is a
one-liner (IECapt | ImageMagick's identify | grep for "#FF0000 red"),
so would the task be to make sure a script can easily identify which of
the tests can be run this way and the exact pass condition (in addition
to "no red" there is also "some green", "only green" and so on)? That
should only be a matter of collecting all the prose from the tests and
then identify the right patterns.
-- 
Björn Höhrmann · mailto:bjoern@hoehrmann.de · http://bjoern.hoehrmann.de
Am Badedeich 7 · Telefon: +49(0)160/4415681 · http://www.bjoernsworld.de
25899 Dagebüll · PGP Pub. KeyID: 0xA4357E78 · http://www.websitedev.de/ 
Received on Sunday, 5 September 2010 17:44:46 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Monday, 20 September 2010 17:52:03 GMT