Results Aggregation

Dear All,

Looking at http://wilcofiers.github.io/auto-wcag/pages/result-aggregation.html


As a strawman, I would suggest the following text as a replacement for this document:

-------------

Each test case of the Auto-WCAG group is related to a specific WCAG 2.0 sufficient technique; or failure condition, which in turn is associated to one or more Success criterion. Each test case can have one of three outcomes: Not Applicable, Pass and Fail.

The results of individual test cases are combined to determine if a sufficient technique has been successfully implemented; or a failure condition has been tripped.

You are only able to say that a Success criterion has been failed if one or more of the relevant failure conditions have been tripped.  If no relevant failure conditions have been tripped, then you can use the sufficient techniques that you have proved to be successfully implemented to evidence a WCAG 2.0 claim that a Success criterion has been met.  It is necessary to select all failure conditions which are relevant to a Success criterion; and a broad enough selection of techniques to ensure proper coverage of a Success criterion.

-------------

This allows us to:

·         Capitalise upon the mass of peer-reviewed work already in the WCAG 2.0 sufficient techniques / failure conditions (which we should be promoting).  Each of which already has a test procedure section which could be used as a starting point for a test.

·         Provide feedback about techniques / failure conditions which aren’t as testable as they might be.

·         Suggest new sufficient techniques / failure conditions if they are necessary.

·         Work within WCAG 2.0 claims guidance.

·         And most importantly – it allows us to be able to point to specific sufficient techniques or failure conditions as the way to rectify issues (which slashes reporting).

Just an idea to kick around.  Really interested to hear thoughts / comments.

All the best

Alistair

---

Alistair Garrison
Senior Accessibility Engineer
SSB Bart Group