Re: [css-backgrounds-3] border-image-slice-007 bad linkage to its border-image-source

Le 2016-12-02 05:04, Thierry MICHEL a écrit :
> Gérard,
> 
> Thanks for your input on the corrupted files.
> 
> Isn't it odd that the following sections in the spec have no tests ?

Yes and no. Most test authors do not spend or do not want to spend over 
1 min. on choosing the precise and best link to spec. So, I assume, they 
just quickly pick a section of the spec which seems okay, reasonable to 
them. Most tests in all test suites do not target specific statements of 
the specs.

Eg you gave:
6. Border Images [NO tests]
but this section is an introduction to border-image properties and it 
shows how border-image works with 2 examples.

Many months ago, I "cleaned" one image (in Example 27 in
https://www.w3.org/TR/css3-background/#border-images
) with Gimp and intended to do more tests with it. I am attaching it to 
this email:

groovy-lime-border-image.png , 11.5 Kilo-bytes

- - - - -

Eg. If a border-image test is testing that border-image properties do 
not affect layout, then such test would have to be in "section 6. Border 
Images" because this is the section that makes such statement for the 
first time.

- - - - -

You gave
6. Border Images [NO tests]
but right now, the built test suite has 3 tests

http://test.csswg.org/suites/css-backgrounds-3_dev/nightly-unstable/html4/chapter-6.htm#s6

although we can clearly see that those 3 tests should be instead in 
other sub-sections of section 6.

- - - - -

Another example:

http://test.csswg.org/suites/css-backgrounds-3_dev/nightly-unstable/html4/border-image-11.htm

should be most likely filename-renamed and then linked to section 6.4
6.4. Edge Overhang: the ‘border-image-outset’ property
https://www.w3.org/TR/css3-background/#the-border-image-outset
and not linked to section
6.1. Image Source: the ‘border-image-source’ property
https://www.w3.org/TR/css3-background/#the-border-image-source

- - - - -

> Can we consider a proper coverage of the spec  without tests for the
> following sections?

Difficult question to answer right now. Ideally, we would have to first 
enumerate all testable statements of the spec, then list them, 
distribute them into each sections and sub-sections of the spec and then 
verify if we have at least 1 test for each testable statement by 
examining all the tests we have.

It is normal, expectable to see some sub-sections with just a few (say, 
5) tests and some other sub-sections with more (say, 25) tests or many 
more (say, 50) tests.

- - - - -

There are many other issues and problems with tests of test suites; 
coverageability is just one issue, often difficult to assess.
- Some tests are wrong, incorrect, bad; among them, some could be 
rehabilitated, some can not.
- Many tests are not streamlined, compact, minimized.
- Many tests are missing a clear description of what the tests 
themselves are trying to test, are claiming to be testing, are 
targeting, verifying exactly.
- A huge majority of tests do not reuse already created and available 
reference files: this increases test suites complexity, increase 
unneedlessly number of files and duplicates efforts, etc.
- Shepherd system, a wonderful system in my opinion, is under-used.
- Many test authors are no longer reachable via email, so they won't 
correct, improve their tests.
- Etc...

Gérard

> 
> 2.3. Animated Values   [NO tests but OK as CSS Transitions module ]
> 3. Backgrounds       [NO tests, but seems OK]
> 3.11. Backgrounds of Special Elements  [NO tests]
> 3.11.1. The Canvas Background and the Root Element [NO tests]
> 3.11.2. The Canvas Background and the HTML <body> Element[NO tests]
> 3.11.3. The ‘::first-line’ Pseudo-element‘s Background  [NO tests]
> 5.4. Color and Style Transitions     [NO tests]
> 5.5. Overlapping Curves     [NO tests]
> 6. Border Images    [NO tests]
> 6.6. Drawing the Border Image    [NO tests]
> 7.1.1. Shadow Shape, Spread, and Knockout [NO tests]
> 7.1.2. Blurring Shadow Edges   [NO tests]
> 7.1.3. Layering, Layout, and Other Details  [NO tests]
> 
> 
> Thierry
> 
> Le 01/12/2016 à 22:25, Gérard Talbot a écrit :
>> Hello,
>> 
>> [src]
>> http://test.csswg.org/source/css-backgrounds-3/border-image-slice-007.htm
>> 
>> [nightly-unstable]
>> http://test.csswg.org/suites/css-backgrounds-3_dev/nightly-unstable/html4/border-image-slice-007.htm
>> 
>> 
>> Every browser fail this test because, first of all, the linkage
>> 
>> line 14: border-image-source: 
>> url("../support/9grid40-30-20-10-lime.png");
>> 
>> is incorrect. I've run a recursive find file command ( $ find -name
>> "*grid40*" ) and that support file is nowhere in the repository.
>> 
>> I have not examined or checked the test furthermore.
>> 
>> Gérard

-- 
Test Format Guidelines
http://testthewebforward.org/docs/test-format-guidelines.html

Test Style Guidelines
http://testthewebforward.org/docs/test-style-guidelines.html

Test Templates
http://testthewebforward.org/docs/test-templates.html

CSS Naming Guidelines
http://testthewebforward.org/docs/css-naming.html

Test Review Checklist
http://testthewebforward.org/docs/review-checklist.html

CSS Metadata
http://testthewebforward.org/docs/css-metadata.html

Attachments

Received on Friday, 2 December 2016 21:00:05 UTC