W3C home > Mailing lists > Public > public-html-media@w3.org > September 2016

Updated EME Test Status

From: Jerry Smith (WPT) <jdsmith@microsoft.com>
Date: Thu, 15 Sep 2016 18:41:46 +0000
To: Mark Watson <watsonm@netflix.com>, David Dorwin <ddorwin@google.com>, "Paul Cotton" <Paul.Cotton@microsoft.com>, Matt Wolenetz <wolenetz@google.com>, "<public-html-media@w3.org>" <public-html-media@w3.org>
Message-ID: <SN2PR03MB047F98932C1A0961C615C65A4F00@SN2PR03MB047.namprd03.prod.outlook.com>
I’ve posted updated results for EME tests:

-            http://w3c.github.io/test-results/encrypted-media/all.html

o            Test files: 70; Total subtests: 220
-            http://w3c.github.io/test-results/encrypted-media/less-than-2.html

o            Test files without 2 passes: 34; Subtests without 2 passes: 53; Failure level: 53/220 (24.09%)
o            Previously:  Test files without 2 passes: 44; Subtests without 2 passes: 64; Failure level: 64/220 (29.09%)
-            http://w3c.github.io/test-results/encrypted-media/complete-fails.html

o            Completely failed files: 34; Completely failed subtests: 15; Failure level: 15/220 (6.82%)
o            Previously: Completely failed files: 44; Completely failed subtests: 29; Failure level: 29/220 (13.18%)

The updated results include:

-            License server restored.  This corrected failures previously seen on drm-temporary test cases.
-            Limited Chrome OS results on persistent license tests (2 passes, 3 timeouts due to server issues: https://github.com/w3c/web-platform-tests/issues/3718).
-            Latest test changes on the public test harness: http://w3c-test.org/tools/runner/index.html.


Results do NOT include polyfilled tests.

Chrome OS results are identified as CO53 in the reports.  Timeouts reflect tests not run on CO53, and generally don’t reflect a real issue.  Only these tests were run on CO53:

-            encrypted-media/drm-mp4-playback-destroy-persistent-license.html (Timeout)
-            encrypted-media/drm-mp4-playback-persistent-license-events.html (Timeout)
-            encrypted-media/drm-mp4-playback-persistent-license.html (PASS)
-            encrypted-media/drm-mp4-playback-retrieve-destroy-persistent-license.html (Timeout)
-            encrypted-media/drm-mp4-playback-retrieve-persistent-license.html (PASS)

Jerry
Received on Thursday, 15 September 2016 18:42:17 UTC

This archive was generated by hypermail 2.3.1 : Thursday, 15 September 2016 18:42:19 UTC