RE: EME test suite status

> Leaving these to be migrated:

How are we going to get these remaining tests migrated?

David declined to help at last week’s WG meeting and now Jerry says MSFT does not have any resources for this work.

Is our only alternative to wait until Netflix can do ALL this work?

/paulc

From: Jerry Smith (WPT)
Sent: Thursday, September 8, 2016 2:38 PM
To: Paul Cotton <Paul.Cotton@microsoft.com>; Mark Watson <watsonm@netflix.com>
Cc: public-hme-editors@w3.org
Subject: RE: EME test suite status

I had an action to check for test help.  I’ve done that, but have been unable to find additional test developers to help with EME.  I’ve not yet had personal time to work on tests, and might yet do some.  I think we need folks familiar with the test harness to make short term progress.

As far as I know, this bug status hasn’t changed:  https://github.com/w3c/web-platform-tests/issues/3583



-        Sukhmal and Mark at Netflix have migrated these:

o   encrypted-media-check-init-data-type.html

o   encrypted-media-events.html

o   encrypted-media-generate-request-disallowed-input.html

o   encrypted-media-keystatuses.html

o   encrypted-media-not-callable-after-createsession.html

o   encrypted-media-playback-setmediakeys-after-src.html

o   encrypted-media-playback-setmediakeys-before-src.html

o   encrypted-media-playback-two-videos.html

-        Sukhmal at Netflix is working on these:
o   encrypted-media-setmediakeys-again-after-playback.html
o   encrypted-media-setmediakeys-again-after-resetting-src.html
o   encrypted-media-setmediakeys-at-same-time.html
o   encrypted-media-setmediakeys-multiple-times-with-different-mediakeys.html
o   encrypted-media-setmediakeys-multiple-times-with-the-same-mediakeys.html
o   encrypted-media-setmediakeys-to-multiple-video-elements.html
o   encrypted-media-setmediakeys.html

-        Leaving these to be migrated:
o   encrypted-media-clear-key-invalid-license.html
o   encrypted-media-clearkey-update-non-ascii-input.html
o   encrypted-media-keystatuses-multiple-sessions.html
o   encrypted-media-keystatuses-multiple-updates.html
o   encrypted-media-onencrypted.html
o   encrypted-media-playback-encrypted-and-clear-sources.html
o   encrypted-media-playback-multiple-sessions.html
o   encrypted-media-requestmediakeysystemaccess.html
o   encrypted-media-reset-src-after-setmediakeys.html
o   encrypted-media-session-closed-event.html
o   encrypted-media-syntax.html
o   encrypted-media-unique-origin.html
o   encrypted-media-update-disallowed-input.html
o   encrypted-media-waiting-for-a-key.html
Jerry

From: Paul Cotton
Sent: Thursday, September 8, 2016 11:12 AM
To: Mark Watson <watsonm@netflix.com<mailto:watsonm@netflix.com>>; Jerry Smith (WPT) <jdsmith@microsoft.com<mailto:jdsmith@microsoft.com>>
Cc: public-hme-editors@w3.org<mailto:public-hme-editors@w3.org>
Subject: RE: EME test suite status

We are making having lots of EME discussions on the HME WG email list and it would appear that we have several new EME V1Editorial issues to resolve:
https://github.com/w3c/encrypted-media/milestone/4


But I have not seen any further progress or updates on the EME test suite.

Mark and Jerry:  Can you give us an update on where this stands today?

/paulc

From: Mark Watson [mailto:watsonm@netflix.com]
Sent: Tuesday, September 6, 2016 12:56 PM
To: Paul Cotton <Paul.Cotton@microsoft.com<mailto:Paul.Cotton@microsoft.com>>
Cc: Jerry Smith (WPT) <jdsmith@microsoft.com<mailto:jdsmith@microsoft.com>>; public-hme-editors@w3.org<mailto:public-hme-editors@w3.org>
Subject: Re: EME test suite status



On Tue, Sep 6, 2016 at 9:47 AM, Paul Cotton <Paul.Cotton@microsoft.com<mailto:Paul.Cotton@microsoft.com>> wrote:
From last week’s WG meeting minutes:
http://www.w3.org/2016/08/30-html-media-minutes.html#item07



MArk will replace the key system name in the test name with either 'drm' or 'clearKey'. See https://lists.w3.org/Archives/Public/public-html-media/2016Aug/0108.html


Mark will do the above two changes, Jerry will review any PRs and then re-run the tests.

Q1: What is the status of these changes to the EME test suite?

​The above change is done, but this change<https://github.com/w3c/web-platform-tests/pull/3628> is also necessary before running the test suite again.​



outstanding PR for EME test suite: https://github.com/w3c/web-platform-tests/pulls?utf8=%E2%9C%93&q=is%3Apr%20is%3Aopen%20label%3Aencrypted-media


ISSUE https://github.com/w3c/web-platform-tests/issues/3583 outlines Google tests to be migrated. Netflix is working on some of these.

Netflix is working on the 7 tests identified in https://github.com/w3c/web-platform-tests/issues/3583#issuecomment-243203368


There are 14 others to be migrated.

David cannot do this work item this week.

Jerry will look into doing some of the remaining Google test migrations.

Q2: Have we made any progress on the above EME test suite work items on the set of 7 additional tests (Mark) and the remaining 14 tests (Jerry)?

​I'll check.
​


/paulc

Paul Cotton, Microsoft Canada
17 Eleanor Drive, Ottawa, Ontario K2E 6A3
Tel: (425) 705-9596<tel:%28425%29%20705-9596> Fax: (425) 936-7329<tel:%28425%29%20936-7329>