Re: Automated and manual testing process

Hi all--
This is an interesting, useful, and thought-provoking thread, but I do have a more general question:
Are we answering your question, Andrew? Is there a particular circumstance we should be addressing?
My two cents...
Mike
 

    On Monday, January 30, 2017 11:00 AM, "White, Jason J" <jjwhite@ets.org> wrote:
 

 #yiv1448771406 #yiv1448771406 -- _filtered #yiv1448771406 {panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv1448771406 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;}#yiv1448771406 #yiv1448771406 p.yiv1448771406MsoNormal, #yiv1448771406 li.yiv1448771406MsoNormal, #yiv1448771406 div.yiv1448771406MsoNormal {margin:0in;margin-bottom:.0001pt;font-size:12.0pt;}#yiv1448771406 a:link, #yiv1448771406 span.yiv1448771406MsoHyperlink {color:blue;text-decoration:underline;}#yiv1448771406 a:visited, #yiv1448771406 span.yiv1448771406MsoHyperlinkFollowed {color:purple;text-decoration:underline;}#yiv1448771406 p.yiv1448771406msonormal0, #yiv1448771406 li.yiv1448771406msonormal0, #yiv1448771406 div.yiv1448771406msonormal0 {margin-right:0in;margin-left:0in;font-size:12.0pt;}#yiv1448771406 span.yiv1448771406EmailStyle19 {color:windowtext;}#yiv1448771406 .yiv1448771406MsoChpDefault {} _filtered #yiv1448771406 {margin:1.0in 1.0in 1.0in 1.0in;}#yiv1448771406 div.yiv1448771406WordSection1 {}#yiv1448771406       From: David MacDonald [mailto:david100@sympatico.ca]

 If we can establish a metric that is reliable and that we can establish a high "inter rater reliability" among human testers who "derstand how people with different types of disabilities use the Web" then it is testable. In that case it's not "subjective" in the eyes of WCAG, and can be formulated as a testable statement. [Jason] This is a superb statement of the position that, as I recall, was developed during the evolution of WCAG 2. The challenge is to write the requirements in a way that facilitates achieving the best inter-rater reliability that we can (unfortunately without the benefit of a formal study to verify and improve it, unless someone volunteers to run such experiments).    
This e-mail and any files transmitted with it may contain privileged or confidential information. It is solely for use by the individual for whom it is intended, even if addressed incorrectly. If you received this e-mail in error, please notify the sender; do not disclose, copy, distribute, or take any action in reliance on the contents of this information; and delete it from your system. Any other use of this e-mail is prohibited.
Thank you for your compliance.