W3C home > Mailing lists > Public > public-wai-ert@w3.org > November 2007

Re: Example: testing multiple softwares with regard to one test case.

From: Shadi Abou-Zahra <shadi@w3.org>
Date: Tue, 06 Nov 2007 18:27:25 +0100
Message-ID: <4730A3FD.8000107@w3.org>
To: Karl Dubost <karl@w3.org>
CC: WAI ER <public-wai-ert@w3.org>

Hi Karl,

Karl Dubost wrote:
> Hi,
> 
> When we do interoperability testing, there are two ways of presenting 
> the data.
> 
> 1. list of test cases and one assertor tries all of them through one 
> software
> 2. One test case that is tried by one assertor with regards to a list of 
> implementations.
> 
> I would like to know what would be the most elegant way of doing the 
> second case.
> 
> 
> * testcase-Z  hosted at the uri http://example.org/test1
> * assertor with the name john smith and john@example.org
> * software-A - pass
> * software-B - pass
> * software-C - fail

We regard each of these as a separate test execution, and each result is 
recorded into an earl:TestResult. The relationship between the tests is 
actually part of the test case description rather than of an EARL report 
-for example, to express that "test-1", "test-2", and "test-3" are part 
of a single "interoperability test" is outside the scope of EARL.

Regards,
   Shadi


-- 
Shadi Abou-Zahra - http://www.w3.org/People/shadi/ |
   WAI International Program Office Activity Lead   |
  W3C Evaluation & Repair Tools Working Group Chair |
Received on Tuesday, 6 November 2007 17:27:41 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Tuesday, 8 January 2008 14:18:29 GMT