W3C home > Mailing lists > Public > public-wai-evaltf@w3.org > August 2011

R: some initial questions from the previous thread

From: Roberto Scano \(IWA/HWG\) <r.scano@webprofession.com>
Date: Mon, 22 Aug 2011 14:33:26 +0200
To: "'Eval TF'" <public-wai-evaltf@w3.org>
Message-ID: <4e524c97.c7e9d80a.7b03.fffff897@mx.google.com>
Hi one question: are we thinking about a single evalutation method or
evalutation with different targets (eg: companies, public administration,
etc.)? So for be more clear we are planning to make a work for help
developers for auto-evalutate their works or we are thinking about something
that can be useful to companies / governments that need to have metrics for
evalutate web-based products?

Roberto Scano
International Webmasters Association / The HTML Writers Guild

-----Messaggio originale-----
Da: public-wai-evaltf-request@w3.org
[mailto:public-wai-evaltf-request@w3.org] Per conto di Shadi Abou-Zahra
Inviato: luned́ 22 agosto 2011 13:35
A: Eval TF
Oggetto: some initial questions from the previous thread

Dear Eval TF,

 From the recent thread on the construction of WCAG 2.0 Techniques, here 
are some questions to think about:

* Is the "evaluation methodology" expected to be carried out by one 
person or by a group of more than one persons?

* What is the expected level of expertise (in accessibility, in web 
technologies etc) of persons carrying out an evaluation?

* Is the involvement of people with disabilities a necessary part of 
carrying out an evaluation versus an improvement of the quality?

* Are the individual test results binary (ie pass/fail) or a score 
(discrete value, ratio, etc)?

* How are these test results aggregated into an overall score (plain 
count, weighted count, heuristics, etc)?

* Is it useful to have a "confidence score" for the tests (for example 
depending on the degree of subjectivity or "difficulty")?

* Is it useful to have a "confidence score" for the aggregated result 
(depending on how the evaluation is carried out)?

Feel free to chime in if you have particular thoughts on any of these.


Shadi Abou-Zahra - http://www.w3.org/People/shadi/
Activity Lead, W3C/WAI International Program Office
Evaluation and Repair Tools Working Group (ERT WG)
Research and Development Working Group (RDWG)
Received on Monday, 22 August 2011 12:33:55 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 6 January 2015 20:40:18 UTC