what to do with inferred test results?

Hi,

During today's teleconference we came across and interesting issue: how 
do we aggregate the test mode? Let take an example and say we want to 
test the color contrast of an HTML+CSS page. Two tests are executed:

Test case 1: text color contrast (automatic)
Test case 2: image color contrast (manual)

Now the result of these two tests is combined and a new result for the 
initial test requirement "sufficient color contrast" is generated. But 
what is the testing mode for this newly generated result? Options are:

Option A: the end-user combines these two results manually so the test 
mode is manual. However, this is fairly unlikely in practice.

Option B: there is a calculation, for example automatic+manual = 
semiAutomatic. But what about automatic+automatic+manual etc.?

Option C: the test mode is set to earl:inferred for such cases. The 
question is can it be inferred *and* manual, semiAutomatic and auto?

Option D: I can't think of other ways, suggestions welcome.


Regards,
   Shadi


-- 
Shadi Abou-Zahra     Web Accessibility Specialist for Europe |
Chair & Staff Contact for the Evaluation and Repair Tools WG |
World Wide Web Consortium (W3C)           http://www.w3.org/ |
Web Accessibility Initiative (WAI),   http://www.w3.org/WAI/ |
WAI-TIES Project,                http://www.w3.org/WAI/TIES/ |
Evaluation and Repair Tools WG,    http://www.w3.org/WAI/ER/ |
2004, Route des Lucioles - 06560,  Sophia-Antipolis - France |
Voice: +33(0)4 92 38 50 64          Fax: +33(0)4 92 38 78 22 |

Received on Wednesday, 18 July 2007 16:29:59 UTC