Urgent need for EME test case review

All,

The previous pull request has become very large. I will break it up into a
sequence of smaller ones. To facilitate this, I need to merge one PR that
establishes the latest framework. The other PRs can then be reviewed in
parallel.

So, the first of this sequence is
https://github.com/w3c/web-platform-tests/pull/3355/files

I URGENTLY need review of this PR. If we are to meet our deadline of August
2, I presume we need the tests running this week and I will have limited
time to work on this tomorrow and Friday. I don't think there is much point
in attempting to meet the August 2 deadline if noone is able to review the
test PRs.

...Mark



On Mon, Jul 25, 2016 at 5:29 PM, Mark Watson <watsonm@netflix.com> wrote:

> All,
>
> Update for today: My Pull Request (
> https://github.com/w3c/web-platform-tests/pull/3324) now has updated mp4
> content and consolidated content metadata. Some re-arrangement is still
> needed to support the AV multi-key case (separate audio and video keys). I
> expect to get content tomorrow with multiple keys within one video stream.
> I'll continue to add tests tomorrow.
>
> The space of combinations of content type, key system and init data type
> is quite large and not fully covered (or all that well organized in the
> code). Some tests just need to discover a supported combination, others are
> constrained by what the DRM server supports as well as what the client
> component supports. I'll also look at how we can organize this better.
>
> As before, review of the PR is welcome!
>
> ...Mark
>
>
>
> On Mon, Jul 25, 2016 at 11:21 AM, Paul Cotton <Paul.Cotton@microsoft.com>
> wrote:
>
>> > I will be working on the other tests on and off early next week. If
>> anyone else is able to help, please coordinate with me.
>>
>>
>>
>> I am moving this discussion [1] to public-html-media@w3.org so that we
>> touch as many HME WG members as possible.
>>
>>
>>
>> Mark and others:  Please use this thread for any future updates on the
>> status of EME testing.
>>
>>
>>
>> /paulc
>>
>>
>>
>> [1]
>> https://lists.w3.org/Archives/Public/public-hme-editors/2016Jul/0056.html
>>
>>
>>
>> *From:* Mark Watson [mailto:watsonm@netflix.com]
>> *Sent:* Friday, July 22, 2016 5:25 PM
>> *To:* Paul Cotton <Paul.Cotton@microsoft.com>
>> *Cc:* Jerry Smith (WPT) <jdsmith@microsoft.com>; Greg Rutz <
>> G.Rutz@cablelabs.com>; David Dorwin <ddorwin@google.com>; Matthew
>> Wolenetz <wolenetz@google.com> (wolenetz@google.com) <wolenetz@google.com>;
>> Philippe Le Hegaret (plh@w3.org) <plh@w3.org>; Francois Daoust <fd@w3.org>;
>> public-hme-editors@w3.org; Iraj Sodagar <irajs@microsoft.com>; John
>> Simmons <johnsim@microsoft.com>; Sukhmal Kommidi <skommidi@netflix.com>
>> *Subject:* Re: DRM Today-based test case for EME
>>
>>
>>
>> All,
>>
>>
>>
>> I migrated a handful of the Google tests:
>> https://github.com/w3c/web-platform-tests/pull/3324
>>
>>
>>
>> Currently, the "drm-events" test fails because the DRM server is unaware
>> of the key id that is used (and I am unaware of the key id that it does
>> know). I'm working with Greg on this.
>>
>>
>>
>> I noticed the following whilst doing this work:
>>
>>    - We probably need to organize the content metadata (key ids, keys,
>>    MIME types etc.) into one place - presently they are scattered around in a
>>    confusing way
>>    - The idea of auto-generating the HTML stubs needs some more thought
>>    - they are presently a bit different for each test
>>    - Some of the Google tests look (to me at least) like they might be
>>    Chrome-specific. Specifically, the lifetime tests use window.internals and
>>    I am not sure if this is cross-platform. Likewise, I do not know if the
>>    garbage collection stuff is cross-platform or not.
>>    - We need some additional mp4 content files (I am in touch with Greg
>>    about this):
>>
>>
>>    - Encrypted audio
>>       - Video with multiple keys
>>
>> I will be working on the other tests on and off early next week. If
>> anyone else is able to help, please coordinate with me.
>>
>>
>>
>> Sukhmal is working on persistent-usage-record and persistent-license
>> tests, which should be ready next week.
>>
>>
>>
>> ...Mark
>>
>>
>>
>>
>>
>
>