RE: outstanding MSE test suite pull requests, creation of test results and draft Proposed Recommendation

>2 of my PRs are currently pending co-editor review. 5 pending PRs are still awaiting my full review.

We MUST get all the outstanding MSE test suite pull requests processed ASAP so that we can move on to using the resulting test suite.  We are running out of chartered time to do this work!

For the older six outstanding PRs created by Philippe or Francois we are going to consider them okay unless someone specifically pushes back before noon PDT on Wed Sep 7.  After that Philippe or Francois should feel free to merge their own PRs:
https://github.com/w3c/web-platform-tests/pulls?q=is%3Apr+is%3Aopen+label%3Amedia-source


For Matt’s new PRs the same approach applies.  Others have until noon PDT on Wed Sep 7 to review them and after that Matt should feel free to apply his own PRs.

>ACTION: plh to generate the new MSE draft PR, pointing to the testing results

Hopefully this will permit us to conclude work on the MSE test suite later on Wed and for Philippe to create new test results on Thu and to create a MSE draft Proposed Recommendation before the end of this week.

/paulc

From: Matt Wolenetz [mailto:wolenetz@google.com]
Sent: Friday, September 2, 2016 7:24 PM
To: Paul Cotton <Paul.Cotton@microsoft.com>
Cc: public-html-media@w3.org
Subject: Re: HME WG meeting minutes, Tue Aug 30

I've made some progress, not as much as I had hoped. 2 of my PRs are currently pending co-editor review. 5 pending PRs are still awaiting my full review.

Detail:
·        Prepped PR to cover 4 gaps from #823 : https://github.com/w3c/web-platform-tests/pull/3635

o   Awaiting @jdsmith3000's review to land it
o   crbug 623781<http://crbug/623781> tracks fixing the Chrome compliance issue behind at least the failure of 2 subtests (TypeError) in mediasource-addsourcebuffer.html
o   Filed crbug 643788<http://crbug/643788> to fix debug build assertion in w-p-t mediasource-removesourcebuffers.html and landed my fix for it<https://codereview.chromium.org/2305023002>
·        Reviewed and closed ancient https://github.com/w3c/web-platform-tests/pull/939

o   Found only 1 trivial test coverage gap, prepped and merged trivial PR to close that gap: https://github.com/w3c/web-platform-tests/pull/3636

·        Deferred to VNext ancient appendStream coverage test PR https://github.com/w3c/web-platform-tests/pull/954

·        Deferred to VNext more strict isTypeSupported() coverage test PR https://github.com/w3c/web-platform-tests/pull/1405


·        Commented on mechanical PR https://github.com/w3c/web-platform-tests/pull/1816 (doesn't block MSE v1 PR, it's a cross-cutting infra PR)

·        In-progress: Fixing https://github.com/w3c/web-platform-tests/pull/3082

o   Filed, and in-progress fixing (short-term Chrome MSE piece of) crbug 643846<http://crbug/643846>

·        TODO 5 more pending PRs...

On Tue, Aug 30, 2016 at 6:42 PM, Matt Wolenetz <wolenetz@google.com<mailto:wolenetz@google.com>> wrote:

On Tue, Aug 30, 2016 at 11:20 AM, Paul Cotton <Paul.Cotton@microsoft.com<mailto:Paul.Cotton@microsoft.com>> wrote:
MSE test suite results

<plh> Paul: still some outstanding pull requests

https://lists.w3.org/Archives/Public/public-html-media/2016Aug/0102.html is Matt's most recent update

<plh> Matt: going through them...

Outstanding PRs: https://github.com/w3c/web-platform-tests/pulls?q=is%3Apr+is%3Aopen+label%3Amedia-source


<plh> ... resolving the merge conflict

<plh> ... I'll send out an update later today

I've worked through about 5 of the 15 pending PRs today, and will continue tomorrow. Current status:
·
·        Merged @tidoust's https://github.com/w3c/web-platform-tests/pull/3239

·        Prepped and landed my https://github.com/w3c/web-platform-tests/pull/3612

·        Needed Chromium+W3C license stamp, so this replaces/extends @tidoust's https://github.com/w3c/web-platform-tests/pull/3264

·        Updated and landed my https://github.com/w3c/web-platform-tests/pull/3296

·        Landed @tidoust's https://github.com/w3c/web-platform-tests/pull/3233

·        Prepped PR to fix the test introduced in #3233 to comply with w3c/media-source#154: https://github.com/w3c/web-platform-tests/pull/3613

o   Awaiting @jdsmith3000's review to land it
o   crbug 639144<http://crbug/639144> tracks fixing the Chrome compliance issue behind failure of subtest 1/3 in this PR
o   crbug 373039<http://crbug/373039> is one of a group of bugs tracking fixing the Chrome compliance issue behind failure of subtest 3/3 in this PR
·        Reviewed ancient https://github.com/w3c/web-platform-tests/pull/823

o   Found 4 gaps, but otherwise closed this PR since most of the coverage it includes is already covered elsewhere in our current suite

·        In-progress: put together PR to cover 4 gaps from #823
o   crbug 623781<http://crbug/623781> tracks fixing the Chrome compliance issue behind at least the failure of 2 subtests (TypeError) in mediasource-addsourcebuffer.ht<http://mediasource-addsourcebuffer.ht>ml
o   In-progress: Investigating Chromium issue with PR I'm building to cover the 4 test gaps.
·        TODO 10 more pending PRs, followed by call to regenerate reports and lists of known user agent bugs tracking test failures.