W3C home > Mailing lists > Public > public-html-media@w3.org > October 2016

Re: EME Test Status Update - 10-19-16

From: David Dorwin <ddorwin@google.com>
Date: Fri, 21 Oct 2016 15:37:42 -0700
Message-ID: <CAHD2rsh-NDB3Yr1FH+UA5seW71dkV9soSrGLje2uc=FBVYYyZw@mail.gmail.com>
To: Chris Pearce <cpearce@mozilla.com>
Cc: "Jerry Smith (WPT)" <jdsmith@microsoft.com>, Paul Cotton <Paul.Cotton@microsoft.com>, "public-html-media@w3.org" <public-html-media@w3.org>, Mark Watson <watsonm@netflix.com>
With https://github.com/w3c/web-platform-tests/pull/4059 and
https://github.com/w3c/web-platform-tests/pull/4060 applied locally, we
have the following results on Chrome 56 canary (plus Chrome OS for the
persistent-license tests):

/encrypted-media/drm-mp4-playback-temporary-expired.html FAIL 0/1
/encrypted-media/drm-temporary-license-type.html FAIL 0/1
/encrypted-media/idlharness.html FAIL 42/58
/encrypted-media/clearkey-mp4-requestmediakeysystemaccess.html FAIL 54/58
/encrypted-media/drm-mp4-playback-temporary-multikey-sequential.html FAIL
0/1
/encrypted-media/drm-mp4-requestmediakeysystemaccess.html FAIL 54/58
/encrypted-media/clearkey-mp4-playback-temporary-multikey-
sequential-readyState.html FAIL 0/1
/encrypted-media/drm-mp4-playback-temporary-multikey-
sequential-readyState.html FAIL 0/1
/encrypted-media/clearkey-mp4-playback-temporary-clear-encrypted.html FAIL
0/1
/encrypted-media/clearkey-mp4-playback-temporary-encrypted-clear.html FAIL
0/1
/encrypted-media/drm-mp4-playback-temporary-clear-encrypted.html FAIL 0/1
/encrypted-media/drm-mp4-playback-temporary-encrypted-clear.html FAIL 0/1
/encrypted-media/clearkey-mp4-playback-destroy-persistent-license.html FAIL
0/1
/encrypted-media/clearkey-mp4-playback-persistent-license-events.html FAIL
0/1
/encrypted-media/clearkey-mp4-playback-persistent-license.html FAIL 0/1
/encrypted-media/clearkey-mp4-playback-persistent-usage-record-events.html
FAIL 0/1
/encrypted-media/clearkey-mp4-playback-persistent-usage-record.html FAIL 0/1
/encrypted-media/clearkey-mp4-playback-retrieve-destroy-
persistent-license.html FAIL 0/1
/encrypted-media/clearkey-mp4-playback-retrieve-persistent-license.html FAIL
0/1
/encrypted-media/clearkey-mp4-playback-retrieve-persistent-usage-record.html
FAIL 0/1
/encrypted-media/drm-mp4-playback-persistent-license-events.html FAIL 0/1
/encrypted-media/drm-mp4-playback-persistent-usage-record-events.html FAIL
0/1
/encrypted-media/drm-mp4-playback-retrieve-persistent-usage-record.html FAIL
0/1
/encrypted-media/drm-mp4-playback-persistent-usage-record.html FAIL 0/1

Test bugs:
*drm-mp4-playback-temporary-expired.html* https://github.com/w3c/web-pla
tform-tests/issues/4026 (fix is in PR)
*drm-temporary-license-type.html* https://github.com/w3c/web-pla
tform-tests/issues/4027

Chrome bugs:
*idlharness.html* https://crbug.com/635688 & https://crbug.com/635694; both
are not specific to EME
*clearkey-mp4-requestmediakeysystemaccess.html* https://crbug.com/487392
(very minor issue)
*drm-mp4-requestmediakeysystemaccess.html* https://crbug.com/449690 (very
minor issue)
*drm-mp4-playback-temporary-multikey-sequential.html*
https://crbug.com/658422 (caused by non-EME-specific code)
*drm-mp4-playback-persistent-license-events.html* Under investigation
(described at the end of https://github.com/w3c/web-pla
tform-tests/issues/4011#issue-183773408).

readyState tests:
Similar to Firefox, Chrome reports HAVE_CURRENT_DATA. Chrome also has some
more general issues with readyState that are impacting our compliance.
*clearkey-mp4-playback-temporary-multikey-sequential-readyState.html*
*drm-mp4-playback-temporary-multikey-sequential-readyState.html*

Transitions to/from encrypted streams (not blocks):
Chrome does not currently support this (https://crbug.com/597443). This is
more of an implementation consistency issue than an EME issue.
Clarification of the expected behavior is tracked in VNext issue:
https://github.com/w3c/encrypted-media/issues/251.
*clearkey-mp4-playback-temporary-clear-encrypted.html*
*clearkey-mp4-playback-temporary-encrypted-clear.html *
*drm-mp4-playback-temporary-clear-encrypted.html *
*drm-mp4-playback-temporary-encrypted-clear.html*

The following do not pass because they are not implemented:
*clearkey-*persistent-license** Chrome does not plan to implement
"persistent-license" sessions for Clear Key (https://crbug.com/416194)
**-persistent-usage-record-** Chrome does not support
"persistent-usage-record" sessions.


Other than fixing the test bugs, I do not expect the results to change much.
Received on Friday, 21 October 2016 22:38:32 UTC

This archive was generated by hypermail 2.3.1 : Friday, 21 October 2016 22:38:32 UTC