Responses to new comments on the ATAG2 test surveys

Hi all,

Greg, Tim, Jutta and were on the call as we went through survey 1 and part of survey 2. We will continue to work down the surveys on the next call (Monday, 4 February 2013), 

Since we'd already dealt with Greg's comments on an earlier call, all of the new comments we found were from Alex:


SURVEY 1
---

A.1.1.1 tests (https://www.w3.org/2002/09/wbs/35520/20130107/results#xq5)

COMMENT: consensus of the group Not sure what "accessible test content file" is supposed to be.
RESPONSE: The link on the survey, doesn't work properly, the explanatory text is here: http://lists.w3.org/Archives/Public/w3c-wai-au/2012OctDec/att-0056/ATAG2-10April2012PublicWD-Tests-rev20121214.html#accessible_test_content

COMMENT: I'd not sure the screen reader test should be part of the web content accessibility test procedure because bugs from screen reader will then be mistakenly attributed to the authoring tool or web content. The flip side is also true that just because screen reader present the content to users does not necessarily mean that the content meet WCAG 2.0 SCs.
RESPONSE: Agreed. The Web Content Accessibility Test Procedure (Level A, AA, AAA) only says "Such a test procedure MAY include:...Screen reader test".

A.2.1.1 tests  (https://www.w3.org/2002/09/wbs/35520/20130107/results#xq8)

COMMENT: Why does the test assume multiple editing views? I don't understand the language about "next editing view".
RESPONSE: The "loop" wording is used in case of multiple editing views. If only one is present, the "loop" only runs once.

COMMENT: Test 0002 step 2.1 has ambiguous If statement.
RESPONSE: Agreed. There is a typo: There should be a different 2.2 which should read: "Check if the authoring tool allows the content being edited to be previewed in a user agent (e.g. browser or media player) where the alternatives can be rendered. If so, go to the next editing view that renders video-only media."

COMMENT: The test should be whether authoring tool can render the alternative, not whether the authoring tool can be set to render the alternative. It is possible for the authoring tool to obtain user preference from the OS or other sources where it will automatically render alternate content.
RESPONSE: Agreed. Remove "be set to".

A.2.1.2 tests  (https://www.w3.org/2002/09/wbs/35520/20130107/results#xq9)

IMPORTANT: Just noticed that the survey incorrectly duplicates the A212 tests (as A211 tests). The real A211 tests can be found here: http://lists.w3.org/Archives/Public/w3c-wai-au/2012OctDec/att-0056/ATAG2-10April2012PublicWD-Tests-rev20121214.html

GP: Also remember to be clear that text and media alternatives do not need to be displayed if at that point in the workflow they would never exist.

COMMENT: If the tests are exactly the same, then we have duplicative SC.
RESPONSE: Commenter is correct that they are duplicated...it was a copy-paste error in the survey

A.2.2.1 tests  (https://www.w3.org/2002/09/wbs/35520/20130107/results#xq10)

COMMENT: Steps 2 indicates that the SC is not testable.
RESPONSE: Please explain a bit more?

A.2.2.2 tests  (https://www.w3.org/2002/09/wbs/35520/20130107/results#xq11)

COMMENT: All steps with "SKIP", specify where to skip to.
RESPONSE: Skip refers to a button that already exists in the W3C testing framework that causes the test to be skipped. We use it in cases where a test is not applicable.

COMMENT: Screen readers should not be use for test 0002 4.2. Appropriate accessibility checkers should be used to identify programmatic exposure.
RESPONSE: Agree...will change wording to say an API checking tool OR a screen reader

SURVEY 2
---
A.3.1.1 tests (https://www.w3.org/2002/09/wbs/35520/20130107-2/results#xq3)

COMMENT: Add this to end of step 1. "(Note: If this is due to limitations of the platform, "Partial Conformance due to Platform Limitation" is still possible.)"
RESPONSE: Please clarify. It's already part of step 1.

COMMENT: Shouldn't there be a step here for web-based content where it already passes 2.1.1 to avoid duplicative test?
RESPONSE: Agree with adding a new step: If the authoring tool is web-based and passes WCAG2.0 2.1.1 then, select PASS.

COMMENT: This SC is not about visible focus, why is 4.2 there?
RESPONSE: Because it is integral to use via keyboard for sighted users. In ATAG 2.0 there is no separate visible focus requirement.

COMMENT: Language in 4.3 can be improved. The never and ever conditions are not as clear as it can be.
RESPONSE: Agreed. New wording suggestion: Check the system for situations in which a key press has a time limit. If any key press time limit is found to be less than 20 seconds, then select FAIL.

A.3.1.1 tests (https://www.w3.org/2002/09/wbs/35520/20130107-2/results#xq4

COMMENT: Add this to end of step 1. "(Note: If this is due to limitations of the platform, "Partial Conformance due to Platform Limitation" is still possible.)"
RESPONSE: OK

COMMENT: Shouldn't there be a step here for web-based content where it already passes 2.1.2 to avoid duplicative test?
RESPONSE: OK

COMMENT: On 3.4, what if the keyboard focus cannot be returned to the first control for an unlisted reason.
RESPONSE: Seems like these two reasons are the ones that correspond to "keyboard traps"

COMMENT: The test does not involve collecting data on standard exit methods (Esc, F6, etc.) nor does it involve determining whether authors are advised of the method for moving focus away, probably via documentation.
RESPONSE: Agree - those do need to be added.

COMMENT: Lastly, the test is really about looping or linearization of focus order. The SC is about whether you can move the focus away from a given component. There is a difference.
RESPONSE: Agree - need to rewrite.

A.3.1.3 tests (https://www.w3.org/2002/09/wbs/35520/20130107-2/results#xq5

COMMENT: Add this to end of step 1. "(Note: If this is due to limitations of the platform, "Partial Conformance due to Platform Limitation" is still possible.) "
RESPONSE: OK

Received on Monday, 28 January 2013 21:23:37 UTC