Re: [infra-tests] [stability] Report duplicate tests as "excess" (#5305)

> I think adding this message to every log is too much and people will ignore
> it. Maybe something like `<span title="Excessive results are usually caused
> by duplicate test names.">PASS 20/10</span>`?

That sounds a little too unobtrusive. I don't think anyone will find it. What
do you think about using another `<details>` element, as in:

<details>
<summary>Explanation</summary>
The following table lists tests that exhibited inconsistent results after 10
iterations. The label `MISSING` indicates that the referenced test ran fewer
than 10 times. This can occur if tests are generated via logic that is
non-deterministic. The label `EXCESS` indicates that the referenced test ran
more than 10 times. This may also be due to non-determinism in test generation
logic, but it is more likely the result of duplicated test names.
</details>

View on GitHub: https://github.com/w3c/web-platform-tests/pull/5305#issuecomment-294542478

Received on Monday, 17 April 2017 17:56:11 UTC