W3C home > Mailing lists > Public > public-test-infra@w3.org > October to December 2016

WPT: PASS despite failed assertion

From: Jack Bates <z1a8te@nottheoilrig.com>
Date: Sat, 15 Oct 2016 08:30:09 -0700
To: public-test-infra@w3.org
Message-ID: <556aa889-0ad1-9789-f1db-a148fe7a9929@nottheoilrig.com>
I noticed a couple of tests that pass even if one of their assertions fails.
To see what I mean, add an assert_true(false) to 
fetch/api/cors/cors-preflight-redirect.js, for one.
My browser logs the AssertionError, but testharness.js doesn't catch it, 
so the test passes despite the failed assertion.
Is this a known issue? Can testharness.js be improved so the failed 
assertion doesn't just vanish?
I think the issue can be addressed superficially in the tests 
themselves, but at a higher level, is there something testharness.js can 
do to avoid concealing the issue by swallowing the failed assertion?
Received on Sunday, 16 October 2016 01:59:51 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 17:34:12 UTC