Framework Doc - Accuracy Benchmarking

Dear All,

After reading through the Framework Document - https://w3c.github.io/wcag-act/act-framework.html#quality-updates, I would say that the Accuracy Benchmarking concept might be tricky as it is described.

The section reads – “Measuring this accuracy, not just on test data, but on pages and components that the rules would actually be applied to, is important to give users of the test results confidence in the accuracy of this data.”

The question is – how do you tell if the test is working properly in a live page, without first looking at the relevant code in the page (and assessing it – possibly manually, or with another tool)?

I would propose we concentrate on creating test suites for each of the tests – with an ever growing number of clearly specified real-world edge cases that we are informed about by the testing community.

Very best regards

Alistair

---

Alistair Garrison
Senior Accessibility Engineer
SSB Bart Group