[csswg-drafts] CSS tests - how to fix? (#6896)

svgeesus has just created a new issue for https://github.com/w3c/csswg-drafts:

== CSS tests - how to fix? ==
This is more of a question. The initial motivation is tests for CSS Color 4 and 5, but I guess it applies to all tests.

The [Implementation report grouped by spec section](https://test.csswg.org/harness/results/css-color-4_dev/grouped/) is very helpful, but is missing tests and test results.

If I look at [the list of test suites]() then Color 4 is listed and Color 5 is not. Also, for Color 4, the [numbering and section titles are incorrect, there are missing sections](https://test.csswg.org/harness/review/css-color-4_dev/).

![image](https://user-images.githubusercontent.com/2506926/146374703-5e3597bb-1097-4719-8d31-c90000602e2a.png)

compared to the [ED ToC](https://drafts.csswg.org/css-color-4/#toc) or the [TR Toc](https://www.w3.org/TR/css-color-4/#toc)

![image](https://user-images.githubusercontent.com/2506926/146375312-5639f47e-e606-4fae-8483-70262262dacc.png)

For example the spec has

- 9.3 Specifying Lab and LCH: the lab() and lch() functional notations [#specifying-lab-lch](https://drafts.csswg.org/css-color-4/#specifying-lab-lch)
- 9.4 Specifying OKLab and OKLCH: the oklab() and oklch() functional notations [#specifying-oklab-oklch](#https://drafts.csswg.org/css-color-4/#specifying-oklab-oklch)

tests are listed for 9.3, but none for 9.4 even though they exist.

```
$ grep -l specifying-lab-lch *.*
lab-001.html
lab-002.html
lab-003.html
lab-004.html
lab-005.html
lab-006.html
lab-007.html
lab-008.html
lch-001.html
lch-002.html
lch-003.html
lch-004.html
lch-005.html
lch-006.html
lch-007.html
lch-008.html
```

compare to

```
$ grep -l specifying-oklab-oklch *.*
oklab-001.html
oklab-002.html
oklab-003.html
oklab-004.html
oklab-005.html
oklab-006.html
oklab-007.html
oklab-008.html
oklch-001.html
oklch-002.html
oklch-003.html
oklch-004.html
oklch-005.html
oklch-006.html
oklch-007.html
oklch-008.html
```

Similar issue for [the definition of display-p3](https://drafts.csswg.org/css-color-4/#valdef-color-display-p3) [#valdef-color-display-p3](https://drafts.csswg.org/css-color-4/#valdef-color-display-p3) where there are no listed tests and yet 8 exist currently

```
$ grep -l valdef-color-display-p3 *.*
display-p3-001.html
display-p3-002.html
display-p3-003.html
display-p3-004.html
display-p3-005.html
display-p3-006.html
predefined-005.html
predefined-006.html
```

The situation for CSS Color 5 is even worse, there are tests and there is no listed testsuite at all.

```
$ grep -l css-color-5 *.*
color-contrast-001.html
color-mix-basic-001.html
color-mix-non-srgb-001.html
$ cd parsing/
$ grep -l css-color-5 *.*
color-contrast-computed.html
color-contrast-invalid.html
color-contrast-valid.html
color-mix-computed.html
color-mix-invalid.html
color-mix-valid.html
relative-color-computed.html
relative-color-invalid.html
relative-color-valid.html
```

The [documentation on the wiki](https://wiki.csswg.org/test) is out of date and mostly talks about a Mercurial repository that was last updated in 2018. The actual tests are pulled from WPT, I know. But I can't see what to edit or change to make it see the existing tests or to update the text of headings corresponding to test anchors.





Please view or discuss this issue at https://github.com/w3c/csswg-drafts/issues/6896 using your GitHub account


-- 
Sent via github-notify-ml as configured in https://github.com/w3c/github-notify-ml-config

Received on Thursday, 16 December 2021 13:12:08 UTC