Re: Fwd: status of CSS Backgrounds and Borders Module Level 3 Tests

Le 2016-12-01 10:51, Thierry MICHEL a écrit :
> Hi,
> 
> After some work done on the CSS Backgrounds and Borders Module Level 3
> CR Test Suite (thanks to David Baron and Gérard Talbot ) and after
> running the test suite against multiple browsers, the results have
> currently largely improved.
> 
> In my previous message, there was only 372 of 603 required tests
> meeting CR exit criteria.
> Today we have 479 of 604 required tests meet CR exit criteria.
> - 2 of 2 optional tests meet CR exit criteria.
> - 125 required tests are considered valid and do not meet CR exit 
> criteria.
> 
> I couldn't run these tests on Safari, as I do not have a Apple 
> computer.
> Running those on Safari (especially the one highlighted in yellow) may
> improve the results.


You also need a rather recent version of Safari; best is to use the 
latest, most recent stable version of Safari (right now: 10.0.1 on Mac 
OS X 10.12).


> The CSS Backgrounds and Borders Module Level 3 CR Test Suite Results
> are available at
> http://test.csswg.org/suites/css3-background/nightly-unstable/report/results.html
> 
> 
> Another issue is the proper coverage of this testsuite.
> 
> Some sections have a large number of tests (250), some just one or two
> tests. Somme sections have no tests.  (Attached is a file with the
> number of test per sections)
> So the question remains about the testsuite being good enough to cover
> all the functionalities of the spec.
> 
> Thierry.


If I may, I would like to add:

- many tests (possibly a majority) have not been reviewed
- a few tests need work, need adjustments, tunings, need improvements of 
various kinds, are not streamlined
- a few tests are incorrect: eg
[css-backgrounds-3] background-size-035 to reconsider, to revisit
http://lists.w3.org/Archives/Public/public-css-testsuite/2016Sep/0020.html

Gérard



> 
> -------- Message transféré --------
> From: Thierry MICHEL <tmichel@w3.org>
> Subject: status of CSS Backgrounds and Borders Module Level 3 Tests
> References: <b5f4db10-41f9-0ec1-0078-183248498a75@w3.org>
> To: w3c-css-wg@w3.org

(...)

> Edge implementation which had not been earlier tested against the
> testsuite, now allowed to have a fair number of tests to have now at
> least two passing implmentations.
> Bert also helped running these tests on Safari.

Received on Thursday, 1 December 2016 20:49:16 UTC