- From: Shadi Abou-Zahra <shadi@w3.org>
- Date: Mon, 18 Jul 2005 11:07:22 +0200
- To: giorgio@dimi.uniud.it, Nick Kew <nick@webthing.com>
- Cc: public-wai-ert@w3.org
Hi, Giorgio Brajnik wrote: > On 7/13/05, Nick Kew <nick@webthing.com> wrote: [SNIP] >>Were you on the call where we discussed this? I think we were in >>favour of allowing each tool its own choice over how to express >>confidence values. [SNIP] > In the next months if I can I will do some work on this, which of > course will be shared with this group. We have talked about providing a more open mechanism for tools to provide their own methods of expressing confidence (especially for specialized domains or tools) but we also identified a need to roll out with a "built-in" default method that is unambiguous. As a first attempt, we agreed to look into the current High/Medium/Low values and see if we can define a robust model so that different tools would generate similar results. It seems to me that working with probabilities (or numbers in general) is a practical approach from the sense of aggregations and calculation. Also Nils has been previously posting some interesting work on this to the group. However, the major draw back is that this approach ties heavily with the test definitions or needs considerable benchmarking work to deliver the base values (probabilities). One approach may be to help develop the WCAG 2.0 test suites and then use them for benchmarking purposes. Tool developers could run their tools on such test suites and identify probability values on *checkpoint* level. Of course, developers could also have their own test suites that are public or proprietary if they (and their customers) prefer. Do you think that this would eventually work? Regards, Shadi -- Shadi Abou-Zahra, Web Accessibility Specialist for Europe Chair and Team Contact for the Evaluation and Repair Tools WG World Wide Web Consortium (W3C), http://www.w3.org/ Web Accessibility Initiative (WAI), http://www.w3.org/WAI/ WAI-TIES Project, http://www.w3.org/WAI/TIES/ Evaluation and Repair Tools WG, http://www.w3.org/WAI/ER/ 2004, Route des Lucioles -- 06560, Sophia-Antipolis -- France Voice: +33(0)4 92 38 50 64 Fax: +33(0)4 92 38 78 22
Received on Monday, 18 July 2005 09:07:20 UTC