W3C home > Mailing lists > Public > public-webapps-testsuite@w3.org > April 2013

RE: How to define test result in report if multiple test points designed in one test file?

From: Zhao, Tina <tina.zhao@intel.com>
Date: Sun, 7 Apr 2013 05:12:59 +0000
To: James Graham <jgraham@opera.com>, "public-webapps-testsuite@w3.org" <public-webapps-testsuite@w3.org>
Message-ID: <A68E18274FDB5F4CAA2A2A795754225F1FB644@SHSMSX101.ccr.corp.intel.com>
Ok. So unless all the check points get PASS, the test result in report should be FAIL. 

Thanks,
Tina

-----Original Message-----
From: James Graham [mailto:jgraham@opera.com] 
Sent: Thursday, April 04, 2013 5:08 PM
To: public-webapps-testsuite@w3.org
Subject: Re: How to define test result in report if multiple test points designed in one test file?

On 04/03/2013 09:17 AM, Zhao, Tina wrote:
> The draft the Opera's SSE test report is available at 
> http://www.w3.org/wiki/Webapps/Interop/ServerSentEvents
>
> I have a question about test result measurement:
>
> Take [1] test file for example. There are four check points in one 
> file, only if all of them get pass, the test result shows PASS (other 
> ways
> Fail) in report, right? However, in traditional QA way, I thought this 
> should be four test cases, 3 PASS, 1 NotRun (so I highlighted the 
> details in report).
>
> Do we have rule or guideline for this?

Each test in the file should count as one result; the grouping of multiple tests in a single file is only a convenience.
Received on Sunday, 7 April 2013 05:13:33 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 18:52:57 UTC