W3C home > Mailing lists > Public > public-wai-ert@w3.org > July 2005

Re: Confidences in accessibilty evaluation

From: Shadi Abou-Zahra <shadi@w3.org>
Date: Mon, 18 Jul 2005 12:42:26 +0200
Message-ID: <42DB8792.808@w3.org>
To: Nils Ulltveit-Moe <nils@u-moe.no>
Cc: public-wai-ert@w3.org

Hi Nils,

Nils Ulltveit-Moe wrote:
> However it also makes most sense to model barrier probabilities for each
> disability group, especially when it comes to aggregation.

There is a clear difference here between barrier probabilities and confidence probabilities: while the first one addresses the effect of a violation on a given user, the second one addresses the occurence of a violation in the first place (i.e. 60% that there is a violation, this violation would cause X% barrier for person A).


> Maybe it still is too early to standardise the confidence value parameter?

If you actually mean barrier probabilities then yes, it may be too early for that. But the confidence property (as introduced by previous EARL schemas) has been actually deployed quite widely, however, not interoperably. I think it is high time to standardize the different approaches implemented by different developers.


Regards,
  Shadi



> man, 18,.07.2005 kl. 11.07 +0200, skrev Shadi Abou-Zahra:
> 
>>Hi,
>>
>>Giorgio Brajnik wrote:
>>
>>>On 7/13/05, Nick Kew <nick@webthing.com> wrote:
>>
>>[SNIP]
>>
>>>>Were you on the call where we discussed this?  I think we were in 
>>>>favour of allowing each tool its own choice over how to express 
>>>>confidence values.
>>
>>[SNIP]
>>
>>>In the next months if I can I will do some work on this, which of
>>>course will be shared with this group.
>>
>>We have talked about providing a more open mechanism for tools to provide their own methods of expressing confidence (especially for specialized domains or tools) but we also identified a need to roll out with a "built-in" default method that is unambiguous. As a first attempt, we agreed to look into the current High/Medium/Low values and see if we can define a robust model so that different tools would generate similar results.
>>
>>It seems to me that working with probabilities (or numbers in general) is a practical approach from the sense of aggregations and calculation. Also Nils has been previously posting some interesting work on this to the group. However, the major draw back is that this approach ties heavily with the test definitions or needs considerable benchmarking work to deliver the base values (probabilities).
>>
>>One approach may be to help develop the WCAG 2.0 test suites and then use them for benchmarking purposes. Tool developers could run their tools on such test suites and identify probability values on *checkpoint* level. Of course, developers could also have their own test suites that are public or proprietary if they (and their customers) prefer.
>>
>>Do you think that this would eventually work?
>>
>>Regards,
>>  Shadi
>>
>>

-- 
Shadi Abou-Zahra,     Web Accessibility Specialist for Europe 
Chair and Team Contact for the Evaluation and Repair Tools WG 
World Wide Web Consortium (W3C),           http://www.w3.org/ 
Web Accessibility Initiative (WAI),    http://www.w3.org/WAI/ 
WAI-TIES Project,                 http://www.w3.org/WAI/TIES/ 
Evaluation and Repair Tools WG,     http://www.w3.org/WAI/ER/ 
2004, Route des Lucioles -- 06560, Sophia-Antipolis -- France 
Voice: +33(0)4 92 38 50 64           Fax: +33(0)4 92 38 78 22 
Received on Monday, 18 July 2005 10:42:30 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Tuesday, 8 January 2008 14:18:26 GMT