Re: [updated] Editor Draft of WCAG-EM for publication as Working Draft

Hi Detlev,

A comment from Samuel Martin suggested that discarding "not present" 
success criteria from the count would be more precise:
  - http://www.w3.org/WAI/ER/conformance/comments-20131129#comment89

We have added a review note to this section for more feedback and 
discussion. I agree that the wording could be improved too.

Thanks,
   Shadi


On 30.1.2014 11:04, Detlev Fischer wrote:
> Hi all,
>
> I just looked at the score section in the latest WCAG EM draft
> http://www.w3.org/WAI/ER/conformance/ED-methodology-20140129#score1
>
> In the section listing steps to construct an aggregated score per website, there is the following instruction which may confuse users:
>
>     4. Mark the remaining WCAG 2.0 Success Criteria as not present in any web page or web page state in the sample selected in Step 3: Select a Representative Sample
>
> "Remaining" could mean: SC outside the defined conformance target (these have been excluded already in list point 1) or SC without matching content on the page (but I thought WCAG WG was adamant that these be treated as "pass" so they would fall under list point 3 (SC satisfied).  If the website score would excude n.a. SC, it would be skewed - given the exact same violations, score results for a site with few bells and whistles would turn out worse than for a site where more SC do apply. Actually, this may be the intended outcome, but I fond it clearer and less prone to confusion to take *ALL* SC on a given conformance level and divide by the number of fails.
>
> We might then need a remark that all SC where testers note N.A. are in fact recorded as passes for the purpose of score calculaton.
>
> Detlev
>
> --
> Detlev Fischer
> testkreis c/o feld.wald.wiese
> Thedestr. 2, 22767 Hamburg
>
> Mobil +49 (0)1577 170 73 84
> Tel +49 (0)40 439 10 68-3
> Fax +49 (0)40 439 10 68-5
>
> http://www.testkreis.de
> Beratung, Tests und Schulungen für barrierefreie Websites
>
> Shadi Abou-Zahra schrieb am 30.01.2014 09:49:
>
>> Dear Eval TF,
>>
>> The Editor Draft of 29 January 2014 of the Website Accessibility
>> Conformance Evaluation Methodology (WCAG-EM) includes all agreed changes
>> (for your reference and preview):
>>   - http://www.w3.org/WAI/ER/methodology/
>>
>> As agreed, this will now be published as an updated Working Draft.
>>
>> Best,
>>    Shadi
>>
>> --
>> Shadi Abou-Zahra - http://www.w3.org/People/shadi/
>> Activity Lead, W3C/WAI International Program Office
>> Evaluation and Repair Tools Working Group (ERT WG)
>> Research and Development Working Group (RDWG)
>>
>
>

-- 
Shadi Abou-Zahra - http://www.w3.org/People/shadi/
Activity Lead, W3C/WAI International Program Office
Evaluation and Repair Tools Working Group (ERT WG)
Research and Development Working Group (RDWG)

Received on Thursday, 30 January 2014 11:33:02 UTC