W3C home > Mailing lists > Public > public-css-testsuite@w3.org > April 2012

Re: Reftest review in test harness

From: Tab Atkins Jr. <jackalmage@gmail.com>
Date: Sun, 29 Apr 2012 08:46:01 -0700
Message-ID: <CAAWBYDDyhRyMEzKEUxQ=HdHmsUFONDbAVrpd+hyaomWEHjDwmw@mail.gmail.com>
To: Aryeh Gregor <ayg@aryeh.name>
Cc: CSS-testsuite <public-css-testsuite@w3.org>
On Sat, Apr 28, 2012 at 11:55 PM, Aryeh Gregor <ayg@aryeh.name> wrote:
> Currently, the test harness handles reftests by having two tabs that
> you can manually flip between, one of which contains the test file and
> one of which contains the reference file.  This is not an ideal way to
> manually review reftests.  First of all, it's slow; second of all, it
> makes it hard to spot subtle errors.  A better way to manually review
> reftests is for the images to flip back and forth automatically.  It
> fails if there's any visible flickering, and passes if there isn't.
> This way, it's possible to reliably check even multiple tests per
> second.  A crude implementation I wrote for my transforms reftests is
> here:
>
> http://hg.csswg.org/test/raw-file/77afcb7689ae/contributors/aryehgregor/incoming/viewer.html
>
> Is there any interest in updating the CSSWG test harness to have
> similar functionality?

While I don't have any real knowledge of the test harness's code, I
approve of this approach and would be willing to hack at it if Peter
is too busy.

~TJ
Received on Sunday, 29 April 2012 15:46:50 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Sunday, 29 April 2012 15:46:58 GMT