W3C home > Mailing lists > Public > public-wai-evaltf@w3.org > August 2011

some initial questions from the previous thread

From: Shadi Abou-Zahra <shadi@w3.org>
Date: Mon, 22 Aug 2011 13:34:36 +0200
Message-ID: <4E523ECC.7050104@w3.org>
To: Eval TF <public-wai-evaltf@w3.org>
Dear Eval TF,

 From the recent thread on the construction of WCAG 2.0 Techniques, here 
are some questions to think about:

* Is the "evaluation methodology" expected to be carried out by one 
person or by a group of more than one persons?

* What is the expected level of expertise (in accessibility, in web 
technologies etc) of persons carrying out an evaluation?

* Is the involvement of people with disabilities a necessary part of 
carrying out an evaluation versus an improvement of the quality?

* Are the individual test results binary (ie pass/fail) or a score 
(discrete value, ratio, etc)?

* How are these test results aggregated into an overall score (plain 
count, weighted count, heuristics, etc)?

* Is it useful to have a "confidence score" for the tests (for example 
depending on the degree of subjectivity or "difficulty")?

* Is it useful to have a "confidence score" for the aggregated result 
(depending on how the evaluation is carried out)?

Feel free to chime in if you have particular thoughts on any of these.


Shadi Abou-Zahra - http://www.w3.org/People/shadi/
Activity Lead, W3C/WAI International Program Office
Evaluation and Repair Tools Working Group (ERT WG)
Research and Development Working Group (RDWG)
Received on Monday, 22 August 2011 11:36:13 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 6 January 2015 20:40:18 UTC