- From: Yosuke Funahashi <yosuke@w3.org>
- Date: Wed, 10 Feb 2016 21:10:29 +0900
- To: Paul Cotton <Paul.Cotton@microsoft.com>, Matt Wolenetz <wolenetz@google.com>
- Cc: "public-html-media@w3.org" <public-html-media@w3.org>
Hi Paul, Hi Matt, Here is a summary of the difference between WPT and Blink on MSE testing together with the comparison table [1] I posted last week. * Summary note The WPT test suite for MSE contains 174 tests through 44 test files, two js library files, and one manifest file. The Blink test suite for MSE contains 208 tests through 47 test files, two js library files, and 12 files which describe expected behaviors of some tests to help testers check if the tests are successfully completed. The Blink test suite contains 36 WPT test files with some modifications. In other words, eight test files in WPT are not yet taken into Blink. The Blink test suite contains 13 original test files, two of which are Blink specific so that wouldn't fit into WPT. If we merge these two test suites in a way which maximizes the number of tests, the resulting test suite will contain 221 tests through 55 test files, two js library files, one manifest file, and 10 'expected' files. This will bring 27% increase in the number of tests for WPT, and 7% increase in that for Blink if the Blink team uses the merged test suite as its upstream. Merging these two test suites would be not so complicated but still need some works. For example, some Blink tests don't use the W3C test harness, there are difference in coding style such as string literals, etc. Putting all these considerations together, it seems like a good idea to merge these two test suites. This is still my straw plan. I'll talk to Matt to figure out if we should merge these two suites, and, if we should, how. Regards, Yosuke [1] https://www.w3.org/2016/02/MSE-WPT-Blink-dir-comparison.pdf On 2/5/16 6:02 PM, Yosuke Funahashi wrote: > I've just created a quick comparison table for the WPT and Blink test files: > https://www.w3.org/2016/02/MSE-WPT-Blink-dir-comparison.pdf > > Yosuke > > On 2/5/16 4:51 PM, Yosuke Funahashi wrote: >> Hi Paul, Hi Matt, >> >> Here is the second revision of the test coverage report, which covers the Blink >> test scripts on MSE as well: >> https://www.w3.org/2016/02/MSE-Spec-Test-Coverage-2016-Feb.pdf >> >> You can find the details of my analysis on the WPT and Blink tests at: >> >> https://docs.google.com/spreadsheets/d/1uvIAPLfQ51OnMhxzPt3eEDy5eVyPpRHeNPnycE7kp1c/edit?usp=sharing >> >> >> >> I'm writing a summary of the difference between the WPT and Blink test scripts: >> overlaps, modifications, coding styles, etc. I will share with you the summary >> by Feb 10, which would be a sufficient start point to consider our merge >> strategy. >> >> Regards, >> Yosuke >> > -- Yosuke Funahashi Web and TV IG co-chair, Entertainment vertical champion, HTML Media Extensions WG team contact at W3C Project Associate Professor at Keio University
Received on Wednesday, 10 February 2016 12:10:40 UTC