W3C home > Mailing lists > Public > public-webauthn@w3.org > December 2018

Re: web-platform-tests results

From: Anthony Nadalin <tonynad@microsoft.com>
Date: Thu, 6 Dec 2018 02:23:28 +0000
To: W3C Web Authn WG <public-webauthn@w3.org>, Philippe Le Hégaret <plh@w3.org>
Message-ID: <MW2PR00MB0393A8EEC2CBA59DFEF59FFDA6A90@MW2PR00MB0393.namprd00.prod.outlook.com>
Have you tried the Edge browser and Chrome ?

Get Outlook for Android<https://aka.ms/ghei36>

________________________________
From: Philippe Le Hégaret <plh@w3.org>
Sent: Thursday, December 6, 2018 7:37:36 AM
To: W3C Web Authn WG
Subject: web-platform-tests results

I managed to run the 18 tests at [1], with Chrome 73 (canary) and
Firefox 65 (nightly).

Here are the results:
  https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fw3c.github.io%2Ftest-results%2Fwebauthn%2Fall.html&amp;data=02%7C01%7Ctonynad%40microsoft.com%7Cbbeebe15d36f4f70fca008d65b026cef%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636796463307837883&amp;sdata=oi86El6746X9tMRZuAOONVgkwaj1SB6hEf5wSphBEbI%3D&amp;reserved=0
  https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fw3c.github.io%2Ftest-results%2Fwebauthn%2Fless-than-2.html&amp;data=02%7C01%7Ctonynad%40microsoft.com%7Cbbeebe15d36f4f70fca008d65b026cef%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636796463307837883&amp;sdata=28pMYeMxI9JKHghEunjLddpkRE0kuNEcbXTyY5IaauQ%3D&amp;reserved=0

I started to look at those results: we get 50 tests (out of 232) that
don't have 2 implementations passing.

For 37 of those, the 2 implementations agree, ie they both fail the test
the same way. Most of the failures are on error cases (a different
exception is returned, or no exception is thrown when one is expected).

The remaining 13, the two implementations are behaving differently.

Philippe

[1] https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fweb-platform-tests%2Fwpt%2Ftree%2Fmaster%2Fwebauthn&amp;data=02%7C01%7Ctonynad%40microsoft.com%7Cbbeebe15d36f4f70fca008d65b026cef%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636796463307837883&amp;sdata=Ru1WDmkrGJp%2Fs1wLgh%2B54eJ9oCsjO%2BTnQ4V4qylabdA%3D&amp;reserved=0
Received on Thursday, 6 December 2018 02:23:57 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 18:58:59 UTC