W3C home > Mailing lists > Public > public-test-infra@w3.org > July to September 2015

RE: Web-Platform-Tests pull request

From: John Jansen <John.Jansen@microsoft.com>
Date: Tue, 18 Aug 2015 15:43:23 +0000
To: John Jansen <John.Jansen@microsoft.com>, Andreas Tolfsen <ato@mozilla.com>, "public-test-infra@w3.org" <public-test-infra@w3.org>
Message-ID: <BLUSR01MB5892CFB153A022E193B462BF1780@BLUSR01MB589.namsdf01.sdf.exchangelabs.com>
How about if we get this pull request approved and then iterate on the tests individually afterward? At least with this change they can be run in all browsers and we can start to look at interoperability of the tests we agree have value.


> > I am wondering what the status is for pull requests going in to the 
> > WPT
> repo. I have one that enables the WebDriver tests to work:
> >
> > https://github.com/w3c/web-platform-tests/pull/1890

> >
> > It's been since June, but I'm really just wondering who is on point 
> > for
> merging them in general. There are over 100 in queue currently.
> 
> With the state the specification was in when these tests were written, 
> I'm not sure it's a good idea to use them as the basis for any 
> implementation.  They made it into WPT as a clean-slate import without code review.

Yes, that is a good point. My hope is that we could get these checked in so that they can at least be run. In the current state, they cannot even be run. I have an active task on my plate to review the current coverage and make sure it still tests something in the spec, and then build out new tests for what is there. I really hope that by adding tests for each chapter, we will drive stability.
> 
> To test the fundamentals of the protocol, I feel the test harness 
> needs major work to allow the granularity needed ensure compatibility 
> with the specification.
> 
Interesting. I haven't looked into this. If you have ideas, we should spend some time discussing.

> It's also my opinion is that there are simply too many loose in the 
> specification to determine if these tests are correct.

I agree, but I do think that having tests can help clarify and drive the conversation.
Received on Tuesday, 18 August 2015 15:44:07 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 17:34:11 UTC