Re: Perfomance score per instance

Good points Detlev. Maybe it is best to simplify the performance score 
since it doesn't really have a scientific backing -- it is what it is, 
some very rough indicator that is useful in some contexts.

Let's discuss this at the next meeting when we re-work the section.

Best,
   Shadi


On 2.11.2013 10:14, Detlev Fischer wrote:
> Hi everyone,
>
> I guess the performance score approach is more or less a straight import from UWEM - something in which some of us may have a vested interest while others have never heard of it.
>
> In the third approach, per instance, there is no provision for the weighting or flagging of instances in relation to  their actual impact on accessibility (yes, something requiring human judgement). Without that, results can be completely misleading. I therefore suggest we drop the per instance calculation in Step 5c.
>
> Having said that, I think a more fine-grained assessment of performance is very useful - it just happens that it can neither be automated nor treated in this 'blind' per instance fashion. Examples we have discussed are images without alt text (instances range from absolutely crucial to negligible), non-semantic text headings (impact would depend on place / level of hierarchy), language of parts (critical in an online dictionary, less so for foreign terms in a longer text) etc. etc. One crucial fail will often be 'drowned' in a heap of less important passes. So in my view it is just not something the WCAG EM should advise at all.
>
> Best, Detlev
>
>
>
>
>
> Detlev Fischer
> testkreis - das Accessibility-Team von feld.wald.wiese
> c/o feld.wald.wiese
> Thedestraße 2
> 22767 Hamburg
>
> Tel   +49 (0)40 439 10 68-3
> Mobil +49 (0)1577 170 73 84
> Fax   +49 (0)40 439 10 68-5
>
> http://www.testkreis.de
> Beratung, Tests und Schulungen für barrierefreie Websites
>
>
>
>
>
>

-- 
Shadi Abou-Zahra - http://www.w3.org/People/shadi/
Activity Lead, W3C/WAI International Program Office
Evaluation and Repair Tools Working Group (ERT WG)
Research and Development Working Group (RDWG)

Received on Wednesday, 6 November 2013 12:12:02 UTC