Re: An approach suggestion - ways to test qualitative content

Hi, 

I’ve amended the document to include a subsection on “context”; and a subsection on “But, why not include adjectives or names of items as well…”

I’ll likely make amendments to the document over the coming days.

Alistair

> On 21 Oct 2021, at 10:51, Michael Cooper <cooper@w3.org> wrote:
> 
> This thread is on the public-silver-editors list, but it seems substantive, not administrative, and therefore should be moved to the public-silver list so the rest of the group can participate. Michael
> 
> On 21/10/2021 5:46 a.m., Wilco Fiers wrote:
>> Hey Alistair,
>> 
>> Thanks for putting this together. I think you and I are roughly on the same line on how such testing could work. I'd be interested to learn your thoughts on testing in context. Take your two dogs image example. "Two dogs running after a ball" may be a pretty good description for it, but "Bob and Jack playing during vacation" may very well be a good alternative too, depending on the context. How do you enable testing such things, without making the test extremely permissive?
>> 
>> I think having a big dataset to train machine learning algorithms on for testing accessibility would be a great boon to the world. I'm not sure how we'd go about developing such a thing, or if that is necessarily connected to the development of WCAG 3 itself.
>> 
>> 
>> On Wed, Oct 20, 2021 at 12:07 PM Alistair Garrison <alistair.garrison@accesseo.co.uk <mailto:alistair.garrison@accesseo.co.uk>> wrote:
>> Dear All,
>> 
>> I’d like to present the following concept paper, entitled "Measuring Alt Text Quality”.
>> 
>> https://docs.google.com/document/d/1IVCPcfyfnjm2RJRvgV5pbcQLwzxXKHw66V7R-OW3wiE/edit?usp=sharing <https://docs.google.com/document/d/1IVCPcfyfnjm2RJRvgV5pbcQLwzxXKHw66V7R-OW3wiE/edit?usp=sharing>
>> 
>> Apologies that it is in Google Docs.
>> 
>> It is, of course, rough and ready as I just wanted to get something written down to start the ball rolling.  It is not perfect (and might be subject to minor changes up until 30th Oct 2021), but it has stimulated a lot of thought in my own mind, and I hope it does in yours.  It also shows that metrics (such as SPICE), which are available in the broader AI/ML/CV research world, might prove useful when considering things we are looking to solve in the field of web accessibility. 
>> 
>> Very best regards
>> 
>> Alistair 
>> 
>> Alistair Garrison
>> CEO / Founder Accesseo Limited
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> -- 
>> Wilco Fiers
>> Axe-core & Axe-linter product owner - WCAG 3 Project Manager - Facilitator ACT Task Force
>>  
>> 

Received on Thursday, 21 October 2021 13:11:35 UTC