W3C home > Mailing lists > Public > public-test-infra@w3.org > July to September 2016

Re: Data on flakiness of web platform tests

From: Philip Jägenstedt <foolip@chromium.org>
Date: Fri, 23 Sep 2016 15:08:48 +0000
Message-ID: <CAARdPYc5aCkggLAR6COXcPEnnBshFgvs4ZAzqRYV7EvTwTBfQQ@mail.gmail.com>
To: Rick Byers <rbyers@chromium.org>, Geoffrey Sneddon <g@gms-consulting.scot>
Cc: platform-predictability <platform-predictability@chromium.org>, public-test-infra@w3.org, Boaz Sender <boaz@bocoup.com>
I think that's all we have, for directories we don't import we have no clue
at all.

On Fri, Sep 23, 2016 at 5:06 PM Rick Byers <rbyers@chromium.org> wrote:

> Geoffrey was asking for data on what web-platform-tests were flaky.  I
> don't have great data from blink (since we generally don't run the ones
> that are flaky) but here is what I do have:
>
>    - All flaky blink tests on Linux
>    <https://test-results.appspot.com/dashboards/flakiness_dashboard.html#showFlaky=true&builder=chromium.webkit%3AWebKit%20Linux>
>    - search this list for imported/wpt to find just the web-platform-test ones
>
>    - List of web-platform-tests and csswg-tests that are blacklisted from
>    our import process
>    <https://cs.chromium.org/chromium/src/third_party/WebKit/LayoutTests/W3CImportExpectations?type=cs&q=file:W3CImport&sq=package:chromium&l=1>
>    - could be for multiple reasons
>       - There are also some listed here
>       <https://cs.chromium.org/chromium/src/third_party/WebKit/LayoutTests/TestExpectations> with
>       imported/wpt paths
>
> Other data?
>
> --
> You received this message because you are subscribed to the Google Groups
> "platform-predictability" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to platform-predictability+unsubscribe@chromium.org.
> To post to this group, send email to platform-predictability@chromium.org.
> To view this discussion on the web visit
> https://groups.google.com/a/chromium.org/d/msgid/platform-predictability/CAFUtAY-pd2uek_byBBgEPKjvhw8oKKf%2BSTKo3EdtHNWi1JVrmg%40mail.gmail.com
> <https://groups.google.com/a/chromium.org/d/msgid/platform-predictability/CAFUtAY-pd2uek_byBBgEPKjvhw8oKKf%2BSTKo3EdtHNWi1JVrmg%40mail.gmail.com?utm_medium=email&utm_source=footer>
> .
>
Received on Friday, 23 September 2016 15:09:30 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 17:34:12 UTC