W3C home > Mailing lists > Public > public-test-infra@w3.org > July to September 2014

Mismatch between CSS and web-platform-tests semantics for reftests

From: James Graham <james@hoppipolla.co.uk>
Date: Tue, 19 Aug 2014 11:01:46 +0100
Message-ID: <53F3208A.8070800@hoppipolla.co.uk>
To: "public-test-infra@w3.org" <public-test-infra@w3.org>
CC: public-css-testsuite@w3.org
web-platform-tests has a rather simple set of semantics for reftests;
each test is identified by a single (test, ref, type) tuple. Multiple
<link> elements in the same test file result in multiple tests with
different references.

By contrast the testthewebforward documentation suggests that CSS has a
rather more complex semantic; each test is of the form (test, ref_tree),
where ref_tree is a tree of (file, type) nodes and breadth in the tree
indicates multiple options and depth in the tree indicates multiple
requirements, so the overall test passes if all the comparisons down to
some leaf node pass. In concrete terms multiple <link> elements in the
same document represent multiple options, and each reference can <link>
to further references.

Do we know how necessary the more complex setup is? In particular I
think that the main distinguishing feature is the ability to specify
multiple references of which *any* may match (since the all must match
semantic is just a way of collapsing N tests down to a single test). Is
there a list of all tests that are using this feature?
Received on Tuesday, 19 August 2014 10:02:16 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 17:34:11 UTC