Comments on WCAG EM Working Draft 30 January 2014

Dear Eric, dear EVAL-TF,

here are a few comments on the evaluation methodology. Please excuse the 
delay. I hope the comments can still be considered for the update of the 
document.


Step 3.e:
"any web page and web page state on the website may be selected with 
similarly equivalent likelihood"

What does "similarly equivalent likelihood" mean?
Not all of the techniques described in this step will result in a 
uniform sample. The point is, that some randomness must be involved and 
that any page must have the chance to become part of the sample.
Suggestion: Simplify the sentence to "any web page and web page state on 
the website may be selected with a certain probability"
Note that "certain" does not necessarily mean "with the same probability".


Step 5.d:
The title of the second procedure "Aggregated score per web page" gives 
the impression that the calculated number is related to a single web 
page. But following the procedure will result in a single number (score) 
for the entire sample (i.e. web site). The title is misleading.

Comment on the sentence:
  "A [Draft] W3C Research Report on Web Accessibility Metrics provides 
more background for different approaches and limitations of scoring 
metrics."
The report is not only focused on limitations. Suggestion: Change 
sentence to "A [Draft] W3C Research Report on Web Accessibility Metrics 
provides more background on requirements and different approaches for 
scores and web metrics."


Step 5:
The reporting options presented in Step 5 b-e depend on the particular 
evaluation context. Not all steps are necessary in each context. It 
would be helpful if you could explain for each step in which context it 
is particularly useful. For example Step 5.d will be useful for 
large-scale evaluations.


Kind regards
Annika

-- 
Annika Nietzio
email an@ftb-volmarstein.de
web          www.ftb-net.de
phone  +49 (0) 2335 9681-29

Forschungsinstitut Technologie und Behinderung (FTB)
der Evangelischen Stiftung Volmarstein
Grundschoetteler Str. 40  D-58300 Wetter/Ruhr  Germany

Received on Monday, 17 March 2014 10:14:05 UTC