W3C home > Mailing lists > Public > public-test-infra@w3.org > July to September 2014

Re: web-platform-tests now running in Gecko CI system

From: Masahito Kawamori <kawamori@w3.org>
Date: Tue, 9 Sep 2014 21:55:26 +0900
Message-ID: <CADyKeFwFFMOtp0VF2x-XJO6YrRpR1qV=aSz2FRHHQBfpYhZvnw@mail.gmail.com>
To: James Graham <james@hoppipolla.co.uk>
Cc: "public-test-infra@w3.org" <public-test-infra@w3.org>

Congratulations! This is a great achievement indeed.
Do you have any statistics on the results?



On Tue, Sep 9, 2014 at 12:18 AM, James Graham <james@hoppipolla.co.uk>

> As of Friday the full [1] set of web-platform-tests are now running in
> the Mozilla Continuous Integration (CI) system [2]. This means that they
> are running on every single commit to the main Gecko development tree,
> and that developers are responsible for keeping the tests from regressing.
> At present they are only enabled on Linux 64, but they will be enabled
> on other platforms once its clear that doing so isn't going to introduce
> stability problems [3]. Based on a few days worth of data, the test
> stability seems to be tolerable, but not perfect, and we have already
> had some success in fixing bugs caught by the tests.
> Obviously there is still a lot of work to be done — not least getting
> more Mozilla-authored tests submitted to web-platform-tests — but I'd
> nevertheless like to thank all the people who have helped us get this
> far through contributions to wptrunner, wptserve, the documentation at
> testthewebforward.org, and, of course, to the tests themselves. This has
> very much been a community effort, and I hope that by that as a
> community we can make a lasting positive impact on the web platform.
> [1] Excluding reftests that are simply not enabled yet, and a relatively
> short list of tests that are disabled for stability reasons; I will post
> these in a separate mail.
> [2] https://tbpl.mozilla.org/?tree=Mozilla-Inbound&jobname=web-platform-*
> [3] Linux, Windows XP, Windows 7 and Windows 8 could probably be enabled
> immediately, OSX seems to be more troublesome, and the harness currently
> doesn't support running on Android.
Received on Tuesday, 9 September 2014 12:56:01 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 17:34:11 UTC