Re: EME Test Status Update - 10-19-16

With https://github.com/w3c/web-platform-tests/pull/4059 and
https://github.com/w3c/web-platform-tests/pull/4060 applied locally, we
have the following results on Chrome 56 canary (plus Chrome OS for the
persistent-license tests):

/encrypted-media/drm-mp4-playback-temporary-expired.html FAIL 0/1
/encrypted-media/drm-temporary-license-type.html FAIL 0/1
/encrypted-media/idlharness.html FAIL 42/58
/encrypted-media/clearkey-mp4-requestmediakeysystemaccess.html FAIL 54/58
/encrypted-media/drm-mp4-playback-temporary-multikey-sequential.html FAIL
0/1
/encrypted-media/drm-mp4-requestmediakeysystemaccess.html FAIL 54/58
/encrypted-media/clearkey-mp4-playback-temporary-multikey-
sequential-readyState.html FAIL 0/1
/encrypted-media/drm-mp4-playback-temporary-multikey-
sequential-readyState.html FAIL 0/1
/encrypted-media/clearkey-mp4-playback-temporary-clear-encrypted.html FAIL
0/1
/encrypted-media/clearkey-mp4-playback-temporary-encrypted-clear.html FAIL
0/1
/encrypted-media/drm-mp4-playback-temporary-clear-encrypted.html FAIL 0/1
/encrypted-media/drm-mp4-playback-temporary-encrypted-clear.html FAIL 0/1
/encrypted-media/clearkey-mp4-playback-destroy-persistent-license.html FAIL
0/1
/encrypted-media/clearkey-mp4-playback-persistent-license-events.html FAIL
0/1
/encrypted-media/clearkey-mp4-playback-persistent-license.html FAIL 0/1
/encrypted-media/clearkey-mp4-playback-persistent-usage-record-events.html
FAIL 0/1
/encrypted-media/clearkey-mp4-playback-persistent-usage-record.html FAIL 0/1
/encrypted-media/clearkey-mp4-playback-retrieve-destroy-
persistent-license.html FAIL 0/1
/encrypted-media/clearkey-mp4-playback-retrieve-persistent-license.html FAIL
0/1
/encrypted-media/clearkey-mp4-playback-retrieve-persistent-usage-record.html
FAIL 0/1
/encrypted-media/drm-mp4-playback-persistent-license-events.html FAIL 0/1
/encrypted-media/drm-mp4-playback-persistent-usage-record-events.html FAIL
0/1
/encrypted-media/drm-mp4-playback-retrieve-persistent-usage-record.html FAIL
0/1
/encrypted-media/drm-mp4-playback-persistent-usage-record.html FAIL 0/1

Test bugs:
*drm-mp4-playback-temporary-expired.html* https://github.com/w3c/web-pla
tform-tests/issues/4026 (fix is in PR)
*drm-temporary-license-type.html* https://github.com/w3c/web-pla
tform-tests/issues/4027

Chrome bugs:
*idlharness.html* https://crbug.com/635688 & https://crbug.com/635694; both
are not specific to EME
*clearkey-mp4-requestmediakeysystemaccess.html* https://crbug.com/487392
(very minor issue)
*drm-mp4-requestmediakeysystemaccess.html* https://crbug.com/449690 (very
minor issue)
*drm-mp4-playback-temporary-multikey-sequential.html*
https://crbug.com/658422 (caused by non-EME-specific code)
*drm-mp4-playback-persistent-license-events.html* Under investigation
(described at the end of https://github.com/w3c/web-pla
tform-tests/issues/4011#issue-183773408).

readyState tests:
Similar to Firefox, Chrome reports HAVE_CURRENT_DATA. Chrome also has some
more general issues with readyState that are impacting our compliance.
*clearkey-mp4-playback-temporary-multikey-sequential-readyState.html*
*drm-mp4-playback-temporary-multikey-sequential-readyState.html*

Transitions to/from encrypted streams (not blocks):
Chrome does not currently support this (https://crbug.com/597443). This is
more of an implementation consistency issue than an EME issue.
Clarification of the expected behavior is tracked in VNext issue:
https://github.com/w3c/encrypted-media/issues/251.
*clearkey-mp4-playback-temporary-clear-encrypted.html*
*clearkey-mp4-playback-temporary-encrypted-clear.html *
*drm-mp4-playback-temporary-clear-encrypted.html *
*drm-mp4-playback-temporary-encrypted-clear.html*

The following do not pass because they are not implemented:
*clearkey-*persistent-license** Chrome does not plan to implement
"persistent-license" sessions for Clear Key (https://crbug.com/416194)
**-persistent-usage-record-** Chrome does not support
"persistent-usage-record" sessions.


Other than fixing the test bugs, I do not expect the results to change much.