Key question on SC text and testability

Hi Andrew, Josh, and all,

A key point of contention is in the Adapting Text SC discussion is in
regard to SC text and testability.

So I have a question to the group:

Must SCs be testable on the face of the SC? In other words, from only
reading the SC text, must testability be evident to provide normative
testability? If it can't be tested true/false from the SC text, will
it or won't it meet the SC criteria requirements?

Some seem to say yes:

"you need to say by how much or it isnt testable...the criteria need
to be in the (success) criteria.    Understanding can only make it
clearer — not define it further..." - Gregg C Vanderheiden,  24 Jan
2017.
https://lists.w3.org/Archives/Public/w3c-wai-gl/2017JanMar/0420.html

"if it can't be tested true/false from the SC text, it won't meet the
SC criteria. You can flesh things out in the understanding doc, but
the SC needs to be a true/false statement" - Alastair Campbell, 10 Feb
2017
https://lists.w3.org/Archives/Public/public-low-vision-a11y-tf/2017Feb/0034.html

Some seem to say no:

"...moving the testing metrics for these SC to supporting documents,
and I support that. I believe it's in keeping with the intent, which
is that the user be able to choose their own display formatting, and
how that's tested is essentially details (assuming, as Gregg
Vanderheiden says, we have figured out how it will be tested, so we're
sure it is testable)..." - Greg Lowney, 18 April 2017
https://www.w3.org/2002/09/wbs/35422/AdaptingTextSurvey/results

The WCAG 2.1 Success Criteria Wiki page says, "Success Criteria
shall... Be testable through automated or manual processes."
https://www.w3.org/WAI/GL/wiki/WCAG_2.1_Success_Criteria
It doesn't go into specifics regarding this matter.

If we can come to consensus on this point, it may help move the
discussion forward.

Thank you.

Kindest Regards,
Laura


-- 
Laura L. Carlson

Received on Tuesday, 18 April 2017 14:12:59 UTC