- From: Alistair Garrison <alistair.garrison@levelaccess.com>
- Date: Tue, 28 May 2019 15:11:15 +0000
- To: Accessibility Conformance Testing <public-wcag-act@w3.org>, Shadi Abou-Zahra <shadi@w3.org>, Wilco Fiers <wilco.fiers@deque.com>
- CC: Jonathan Avila <jon.avila@levelaccess.com>
- Message-ID: <9A0B5720-A437-47E8-A1CC-78C719B32993@ssbbartgroup.com>
Hi,
Please find below a json-based status report for Level Access’s “Access Engine” testing engine. It shows the implementation of a single test from ACT-R rules – as, really the first of many. The next status report for Access Engine I will forward to the list (likely as a url) will show many more test results – it didn’t this time as we’ve just not had the time to finalise things sufficiently (due to my travel, public holidays, etc.).
I will also caveat the status report below with the following:
1) the data in the status report is for a single rule implementation – simply to show an implementation;
2) the status report may contain errors, and is subject to rapid change - and must be considered to be use-at-your-own risk; and
3) the status report is for a not-as-yet-public release of Level Access’s free version of Access Engine, but all being well we will release this update in the near future.
I wanted to send you this report as evidence, by your implementation deadline of May 28th 2019, that Level Access are implementing at least some of the ACT-R rules in their testing engine, in the ACT Rule Format; and that we are happy to be included as an implementor in any W3C documentation. If you require anything further in the way of implementation evidence please let me know ASAP.
Wilco: Many thanks again for your help with the JSON-Earl formatting.
Very best regards
Alistair
---
Alistair Garrison
Director of Accessibility Research
Level Access
***** Status Report *****
{
"@context": {
"@vocab": "http://www.w3.org/ns/earl#",
"earl": "http://www.w3.org/ns/earl#",
"WCAG20": "http://www.w3.org/TR/WCAG20/#",
"WCAG21": "http://www.w3.org/TR/WCAG21/#",
"auto-wcag": "https://auto-wcag.github.io/auto-wcag/rules/",
"dct": "http://purl.org/dc/terms#",
"sch": "https://schema.org/",
"doap": "http://usefulinc.com/ns/doap#",
"foaf": "http://xmlns.com/foaf/spec/#",
"WebPage": "sch:WebPage",
"url": "dct:source",
"assertions": {
"@reverse": "subject"
},
"assertedBy": {
"@type": "@id"
},
"outcome": {
"@type": "@id"
},
"mode": {
"@type": "@id"
},
"pointer": {
"@type": "ptr:CSSSelectorPointer"
}
},
"@graph": [{
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/3f1791e11d02c11f950a13172fc1c03d9e84f7cf.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:passed",
"pointer": "button"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/d408cca4ab3468dde1dec3fb48e51c508cbb70d7.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:passed",
"pointer": "input"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/104a9256c8e8b0752c43ae0821daf92c18781ce8.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:passed",
"pointer": "button"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/36c92faf3ffc34dc7a5820bdefdf5d534fb60e49.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:passed",
"pointer": "span"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/064ac1119c78804ee67d6fc4001b86279675466f.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:passed",
"pointer": "summary"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/46ceea6d3ce5a938db807802a3cd8914ce154c14.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:passed",
"pointer": "button"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/cce47b593783fb76f84de37a53cd8af0f15a889f.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:passed",
"pointer": "button"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/3378832ac24e2a6460efededb922a1355a1ccfba.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:passed",
"pointer": "button"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/a6c40a95f261ac27993f8205d91f7f4540f91f23.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:failed",
"pointer": "button"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/34247af6724ee7bcdc0a71e0def98d5410e7363e.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:failed",
"pointer": "span"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/9cd3d7152dbd99cc60b83939ffb3003ab1a3d7de.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:failed",
"pointer": "button"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/8eb7978d588ab8fd27918075581699ba3ec3d57e.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:failed",
"pointer": "button"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/65cb12c42a8d46b2075f669dcabcceb0db074df8.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:inapplicable",
"pointer": "body"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/20901e2525d4f6c77476caacf41ec9d5c234a59a.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:inapplicable",
"pointer": "body"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/6cd354877d9f74fb27e250616b44abe1d70ed41e.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:inapplicable",
"pointer": "body"
}
}
]
}, {
"@type": "WebPage",
"url": "https://act-rules.github.io/testcases/97a4e1/e34c1f2a007d5711980c45f6051a3f2e52b66847.html",
"assertions": [
{
"@type": "Assertion",
"mode": "earl:automatic",
"assertedBy": {
"@id": "Level Access - Access Engine - Version 3.ACT-R",
"@type": [
"earl:Assertor",
"earl:Software",
"doap:Project"
],
"doap:name": "Access Engine",
"doap:vendor": {
"@id": "https://www.levelaccess.com/",
"@type": "foaf:Organization",
"foaf:name": "Level Access Inc."
}
},
"test": {
"@type": "TestCase",
"@id": "Test_97a4e1.js",
"title": "Test97a4e1"
},
"result": {
"@type": "TestResult",
"info": "BUTTONS HAVE AN ACCESSIBLE NAME",
"outcome": "earl:inapplicable",
"pointer": "body"
}
}
]
}]
}
Received on Tuesday, 28 May 2019 15:11:46 UTC