(Draft) ATAG 2.0 Testing Resources

A.1.1.1 Web-Based Accessible (WCAG):

Test 0001 Assertion: The web-based portions of an authoring tool user interface meet WCAG 2.0 at AAA level. (@@Note: Only shown if the user has specified AAA as the target level) [@@JR updated]

1. If no parts of the authoring tool are web-based, then select SKIP.
2. Load the comprehensive accessible test content (Level AAA).
3. Check any web-based parts of the authoring tool with the Web Content Accessibility Test Procedure (Level AAA).
4. If WCAG 2.0 Level AAA is reached, select PASS, otherwise select FAIL.

Test 0002 Assertion: The web-based portions of an authoring tool user interface meet WCAG 2.0 at AA level. (Note: Only shown if the user has specified AA as the target level) [@@JR updated]

1. If no parts of the authoring tool are web-based, then select SKIP.
2. Load the comprehensive accessible test content (Level AA).
3. Check any web-based parts of the authoring tool with the Web Content Accessibility Test Procedure (Level AA).
4. If WCAG 2.0 Level AA is reached, select PASS, otherwise select FAIL.

Test 0003 Assertion: The web-based portions of an authoring tool user interface meet WCAG 2.0 at A level. (Note: Only shown if the user has specified A as the target level) [@@JR updated]

1. If no parts of the authoring tool are web-based, then select SKIP.
2. Load the comprehensive accessible test content (Level A).
3. Check any web-based parts of the authoring tool with the Web Content Accessibility Test Procedure (Level A).
4. If WCAG 2.0 Level A is reached, select PASS, otherwise select FAIL.

A.1.2.1 Accessibility Guidelines:

• Note: The (optional) explanation of conformance claim results should record the user interface accessibility guidelines that were followed.

Test 0001 Assertion: Any non-web-based portions of the authoring tool user interface follow the accessibility guidelines for the platform. [@@JR updated]

1. If the authoring tool is entirely web-based, then select SKIP.
2. Load the comprehensive accessible test content (any level).
3. If the accessibility guideline (for the platform) used by the developer is known, this should be used to test the accessibility of the user interface. If the user interface has followed the guidelines, then select PASS, otherwise select FAIL.
4. If the accessibility guideline (for the platform) used by the developer is not known, choose the most relevant from this list of user interface accessibility guidelines for various platforms and use it to test the accessibility of the user interface. If you find instances where the user interface has not followed the guidelines, then select FAIL, otherwise select PASS.

A.1.2.2 Platform Accessibility Services:

• Note: The (optional) explanation of conformance claim results should record the platform accessibility service(s) that were implemented.

Test 0001 Assertion: Any non-web-based components of the authoring tool user interface successfully communicate name and role with the platform accessibility services (accessibility APIs). [@@JR updated]

1. If the authoring tool is entirely web-based, then select SKIP.
2. For each user interface component in the authoring tool user interface:
   1. Check the component with the Platform Accessibility Service Test Procedure to determine if it is (a) present, (b) has an accessible name and (c) has an appropriate UI component role.
3. If (a)-(c) are all yes for all user interface components, then select PASS, otherwise select FAIL.

A.2.1.1 Text Alternatives for Rendered Non-Text Content:

If an editing-view renders non-text content, then any programmatically associated text alternatives for the non-text content can be programmatically determined. (Level A)

Test 0001 Assertion: For web-based tools, any text alternatives for programmatically associated non text content in the editing view meets WCAG 2.0 1.1.1. [@@JR updated]

1. If the authoring tool does not include editing views that render non-text content, then select SKIP.
2. If the authoring tool's editing views that render non-text content are not web-based, then select SKIP.
3. For each web-based editing view that renders non-text content:
   1. Load the comprehensive accessible test content (any level), which contains non-text content with text alternatives, in the editing view.
   2. Using the Web Content Accessibility Test Procedure, check if WCAG2 SC 1.1.1 is passed by the editing view. If not, select FAIL.
4. If all of the editing views pass, then select PASS.

Test 0002 Assertion: For non-web-based tools, any text alternatives for programmatically associated non text content in the editing view can be programmatically determined. [@@JR updated]

1. If the authoring tool does not include editing views that render non-text content, then select SKIP.
2. If the authoring tool's editing views that render non-text content are web-based, then select SKIP.
3. For each non-web-based editing view that renders non-text content:
   1. Load the comprehensive accessible test content (any level), which contains non-text content with text alternatives, in the editing view.
   2. Check with Platform Accessibility Service Test Procedure to determine if an accessible name/label is present in the accessibility API for each instance of non-test content. If not, select FAIL.
4. If all of the editing views pass, then select PASS.

A.2.1.2 Alternatives for Rendered Time-Based Media:

If an editing-view renders time-based media, then at least one of the following is true: (Level A)

• (a) Option to Render: The authoring tool provides the option to render alternatives for the time-based media; or
• (b) User Agent Option: Authors have the option to preview the time-based media in a user agent that is able to render the alternatives.

Test 0001 Assertion: Video or audio media in an editing view has an option to display captions or transcript OR an option to preview the media in user agent capable of rendering the captions or transcripts. [@@JR updated]

1. If the authoring tool does include editing views that render video or audio, then select SKIP.
2. For each editing view that renders non-text content:
   1. Load the comprehensive accessible test content (any level), which contains time-based media with alternatives (e.g. captions or transcripts), in the editing view.
   2. Check if the authoring tool allows the content being edited to be be previewed in a user agent (e.g. browser or media player) where the alternatives can be rendered OR
      if the authoring tool can be set to render the alternatives itself. If not, select FAIL.
3. If all of the editing views pass, then select PASS.

A.2.2.1 Editing-View Status Indicators:

If an editing-view adds status indicators to the content being edited, then the status messages being indicated can be programmatically determined. (Level A)

• Note: Status indicators may indicate errors (e.g., spelling errors), tracked changes, hidden elements, or other information.

Test 0001 Assertion: For web-based tools: Status information about the content (e.g. spellchecking) can be programatically determined. [@@JR updated]

1. If the editing view is non-web-based, then select SKIP.
2. Check all of the editing-views for status indicators (often used to indicate errors (e.g., spelling errors), tracked changes, hidden elements, or other information.), possibly from a product feature list or trial and error.
3. If the authoring tool does not provide status indicators in any of its editing-views, select SKIP.
4. For each type of status indicator:
   1. Open or author content that will trigger the status indicator (e.g. with spelling errors, add a hidden element, etc.), then examine the indicator with the Web Content Accessibility Test Procedure. If an indicator does not pass, then select FAIL
5. If all of the indicatrors pass, then select PASS.

Test 0002 Assertion: For non-web-based tools: Status information about the content (e.g. spellchecking) can be programatically determined. [@@JR updated]

1. If the editing view is web-based, then select SKIP.
2. Check all of the editing-views for status indicators (often used to indicate errors (e.g., spelling errors), tracked changes, hidden elements, or other information.), possibly from a product feature list or trial and error.
3. If the authoring tool does not provide status indicators in any of its editing-views, select SKIP.
4. For each type of status indicator:
   1. Open or author content that will trigger the status indicator (e.g. with spelling errors, add a hidden element, etc.), then examine the indicator with the Platform Accessibility Service Test Procedure to determine if the indicator (e.g. the validation error) has been communicated to the accessibility API. If an indicator does not pass, then select FAIL
5. If all of the indicatrors pass, then select PASS.

A.2.2.2 Access to Rendered Text Properties:

If an editing-view renders any text formatting properties that authors can also edit using the editing-view, then the properties can be programmatically determined. (Level AA)

Test 0001 Assertion:Text formatting properties can be programmatically determined.

Test 0001: Author:

Test 0001 Steps:

A.3.1.1 Keyboard Access (Minimum):

All functionality of the authoring tool is operable through a keyboard interface without requiring specific timings for individual keystrokes, except where the underlying function requires input that depends on the path of the user's movement and not just the endpoints. (Level A)

• Note 1: Keyboard interfaces are programmatic services provided by many platforms that allow operation in a device independent manner. This success criterion does not imply the presence of a hardware keyboard.
• Note 2: The path exception relates to the underlying function, not the input technique. For example, if using handwriting to enter text, the input technique (handwriting) requires path-dependent input, but the underlying function (text input) does not. The path exception encompasses other input variables that are continuously sampled from pointing devices, including pressure, speed, and angle.
• Note 3: This success criterion does not forbid and should not discourage other input methods (e.g., mouse, touch) in addition to keyboard operation.

Test 0001 Assertion:

Test 0001 Author: Tim Boland

@@

1. If the authoring tool does not support any form of keyboard interface, then select FAIL.
2. Document presence of programmatic service allowing device-independent keystroke input for platform via which functionality of authoring tool will be accessed - if no such programmatic service exists for this platform, then SC fails (or is N/A?) for that authoring tool on that platform. Go to Step 10.
3. Open authoring tool on the selected platform and document (list) all functions of authoring tool (this could be from authoring tool documentation or author experience with the tool)
4. Of these functions, document functions where path-dependent input is required (document rationale for this aspect also) and exclude those functions from the list described in Step 2, to create a modified list of functions
5. For each function in the modified list from Step 3:
6. Check that the function works correctly according to specification/expectation by just using the programmatic service described in Step 1 and nothing else
7. Check that there is no time dependency required for any keystroke input for the programmatic service used in Step 5 in order to successfully complete the function from Step 5 (that is, if a time limit is exceeded, the function does not complete correctly).
8. If checks for both Steps 5 and 6 are successful for that function, then the SC for that function (on that platform) is TRUE; otherwise the SC for that function (on that platform) is FALSE
9. If for all functions checked from Steps 4 through 7 , the SC for that function is TRUE, then the SC is passed for that authoring tool (on that platform)
10. If for at least one function checked from Steps 4 through 7, the SC for that function is FALSE, then the SC fails for that authoring tool (on that platform)
11. Close authoring tool.

A.3.1.2 No Keyboard Traps:

If keyboard focus can be moved to a component using a keyboard interface, then focus can be moved away from that component using only a keyboard interface, and, if it requires more than unmodified arrow or tab keys or other standard exit methods, authors are advised of the method for moving focus away. (Level A)

Test 0001 Assertion:

Test 0001 Author: Tim Boland

@@

1. Step 0. Document specific platform via which authoring tool will be accessed. If a keyboard interface does not exist for this platform, this SC is N/A for this authoring tool; go to Step 7. Otherwise, go to Step 1.
2. Step 1. Document if keyboard focus is supported by authoring tool as a part of the keyboard interface. If keyboard focus is not supported, this SC is N/A for this authoring tool; go to Step 7. Otherwise, go to Step 2.
3. Step 2. Document all controls for a specific function supported by authoring tool. For each of these controls, document if there are explicit instructions given to you on how to move keyboard focus to and from that control. If there are no such controls, this SC is N/A for this authoring tool; go to Step 7. Otherwise, go to Step 3.
4. Step 3. (loop) For every function control (from Step 2) in the authoring tool, test the ability to move keyboard focus (from Step 1) to this function control by using the keyboard interface from Step 0. If keyboard focus can be moved to this function control as specified in the previous sentence (by following any instructions documented in Step 2 for this control), then place the control in Group A. Otherwise place the function control in Group B. If upon exiting the loop, there are no function controls in Group A (Group A is empty), then SC is N/A for this authoring tool on this platform; go to Step 7. Otherwise go to Step 2.
5. Step 4. (loop) For every function control in Group A, attempt to move keyboard focus from this function control by only using the keyboard interface from Step 0 (and by following any instructions documented for Step 2 for this control). If for any control, focus cannot be moved away from the control in the fashion from the previous sentence (focus is trapped), then stop; SC fails for this authoring tool on this platform; go to Step 7. If the previous condition does not apply for any function control in the loop for Group A (focus is not trapped), document the specific keystrokes/exit methods required for said movement for each function control in Group A. Go to Step 5.
6. Step 5. Document a list of "standard" or "common" exit methods for this authoring tool (or authoring tools in general).
7. Step 6. (loop) For every function control in Group A, check to ensure that any exit methods documented for that function control from Step 2 are covered in the list from Step 5. For any exit methods "outside" this list, check to determine if you are notified of the exit method needed prior to attempting to move keyboard focus from that function control, and if notified exit method works in moving keyboard focus from that control. If the preceding sentences in Step 6 are all true for all function controls in Group A, then this SC passes for this authoring tool on this platform. Otherwise, this SC fails for this authoring tool on this platform. Go to Step 7.
8. Step 7. End test.

A.3.1.3 Efficient Keyboard Access:

The authoring tool user interface includes mechanisms to make keyboard access more efficient than sequential keyboard access. (Level AA)

Test 0001 Assertion:

Test 0001 Author: Tim Boland

@@

1. Step 0. Determine if the platform on which the authoring tool is running supports a keyboard interface. If it does, then proceed to Step 1. If not, then skip to Step 8.
2. Step 1. Document all mechanisms of the user interface for the authoring tool under test (from authoring tool documentation or from experience). If there are no such mechanisms, then skip to Step 8. Otherwise proceed to Step 2.
3. Step 2. Document all keyboard access capabilities (via mechanisms from Step 1) supported by the keyboard interface (from Step 0) of the authoring tool(from authoring tool documentation or from experience). If there are fewer than two keyboard access capabilities supported, or if sequential keyboard access is not included, then skip to Step 7. Otherwise proceed to Step 3.
4. Step 3. Determine/document the efficiency criteria (including rationale?) for evaluating keyboard access mechanisms that you will use for this particular authoring tool, platform, etc. Go to Step 4.
5. Step 4. Document the "before state" of the authoring tool user interface on this platform. Use a sequential keyboard access mechanism (from Steps 1 and 2) that navigates the focus one-by-one through all of the items in an ordered set (e.g., menu items, form fields) until the desired item is reached and activated. Record the "after state" of the authoring tool user interface at this point. Determine the "efficiency" of this keyboard access mechanism using your criteria from Step 3. Then go back so the "before state" of the authoring tool user interface (using any mechanism available from Step 1 to do this). Go to Step 5.
6. Step 5. From the "before state" specified earlier, use a -different from sequentlal-? keyboard access mechanism (from Step 1) (such as keyboard shortcuts and the use of bypass links) on the same objects as used in Step 4. Record the "after state" of the authoring tool user interface at this point, and verify that this "after state" is the same as the "after state" from Step 4. Determine the "efficiency" of this access using the same criteria as used in Step 4. Go to Step 6.
7. Step 6. Compare/evaluate the "efficiencies" determined from Step 4 and from Step 5. If as a result of this comparison/evaluation, Step 5 is more "efficient" than Step 4, then this authoring tool "passes" this SC on this platform. If Step 5 is more "efficient" than Step 4, or the "efficiencies" are the same for Steps 4 and 5, then this authoring tool fails this SC for this platform. Go to Step 7.
8. Step 7. If the only keyboard access method supported (from Step 2) is sequential keyboard access, then this authoring tool "fails" this SC for this platform. Go to Step 8.
9. Step 8. If the authoring tool has not been evaluated as "pass" or "fail" on this platform in previous steps up to this point, then the authoring tool is "N/A" for this SC on this platform.

A.3.1.4 Keyboard Access (Enhanced):

All functionality of the authoring tool is operable through a keyboard interface without requiring specific timings for individual keystrokes. (Level AAA)

Test 0001 Assertion:

Test 0001 Steps:

A.3.1.5 Customize Keyboard Access:

If the authoring tool includes keyboard commands, then those keyboard commands can be customized. (Level AAA)

Test 0001 Assertion:

Test 0001 Steps:

A.3.1.6 Present Keyboard Commands:

If the authoring tool includes keyboard commands,

Test 0001 Assertion:

Test 0001 Steps:

A.3.2.1 Auto-Save (Minimum):

If the authoring tool includes authoring session time limits, then the authoring tool can be set to automatically save web content edits made using the authoring tool before the session time limits are reached. (Level A)

Test 0001 Assertion:

Test 0001: Author: Tim Boland

Test 0001 Steps:

1. If the authoring tool does not have any time limits (e.g. an automatic logout), then select SKIP.
2. For each found time limit on an authoring session:
   1. check to determine if the authoring tool can be configured (or is already configured) to automatically save any edits to web content before that time limit is reached.
3. Actually perform the configuration from Step 3 if needed (or verify the configuration from Step 3 as necessary):
   1. Open an authoring session associated with the found time limit.
   2. Edit web content in that authoring session.
   3. Check to determine if all edits from Step 4b are automatically saved before that time limit is reached for that authoring session. If they are, then the result of this step is TRUE for this time limit; otherwise, the result of this step is FALSE for this time limit
4. If the result of Step 4c is TRUE for all found time limits from Step 2, then select PASS. If for any found time limit(s) from Step 2, the result of Step 4c is FALSE, then select FAIL.

A.3.2.2 Timing Adjustable:

If a time limit is set by the authoring tool, then at least one of the following is true: (Level A)

• (a) Turn Off: Authors are allowed to turn off the time limit before encountering it; or
• (b) Adjust: Authors are allowed to adjust the time limit before encountering it over a wide range that is at least ten times the length of the default setting; or
• (c) Extend: Authors are warned before time expires and given at least 20 seconds to extend the time limit with a simple action (e.g., "press the space bar"), and authors are allowed to extend the time limit at least ten times; or
• (d) Real-time Exception: The time limit is a required part of a real-time event (e.g., a collaborative authoring system), and no alternative to the time limit is possible; or
• (e) Essential Exception: The time limit is essential and extending it would invalidate the activity; or
• (f) 20 Hour Exception: The time limit is longer than 20 hours.

Test 0001 Assertion:

Test 0001: Author: Jeanne Spellman

Test 0001 Steps:

1. If the authoring tool does not have any time limits (e.g. an automatic logout), then select SKIP.
2. If the authoring tool time limit is a real-time exception, that is, the time limit is a required part of a real-time event (e.g., a collaborative authoring system), and no alternative to the time limit is possible, then select SKIP. [@@ should this be a Skip, or a Pass?@@]
3. If the time limit is essential and extending it would invalidate the activity, then select SKIP.
4. If the time limit is longer than 20 hours, then select SKIP.
5. Check whether authors are allowed to turn off each time limit before encountering it and set up the appropriate conditions to test whether it works properly. If each time limit is turned off, then select PASS.
6. If authors are warned before each time limit expires and are given at least 20 seconds to extend the time limit with a simple action (e.g., "press the space bar"), and authors are allowed to extend the time limit at least ten times, then select PASS.
7. If authors are allowed to adjust the time limit before encountering it, check the configuration parameters to insure that the time adjustment options are over a wide range that is at least ten times the length of the default setting. If this is true, select PASS.
8. If the authoring tool has time limits, and none of the above statements are true, then select FAIL.

A.3.2.3 Static Input Components:

If authoring tool user interface components that accept input can move, then authors can pause the movement. (Level A)

Test 0001 Assertion: If components of the authoring tool user interface can move, the author can pause the movement.

Test 0001 Author: Jeanne Spellman

Test 0001 Steps:

1. If no parts of the authoring tool user interface can move (animation, video or script), then select SKIP.
2. Vidually examine each part of the user interface to determine if it has motion. Don't forget to checl other modes (like an editing view).
3. If there is a way to pause or stop motion for all or each component in the user interface, , then select PASS, otherwise select FAIL.

A.3.2.4 Content Edits Saved (Extended):

The authoring tool can be set to automatically save web content edits made using the authoring tool. (Level AAA)

Test 0001 Assertion: The authoring tool automatically saves edits or has a configuration option to automatically save edits.

Test 0001 Author: Jeanne Spellman

Test 0001 Steps:

1. Check the preference settings. If there is an option to automatically save edits, activate that feature.
2. Use a sample test file to load some content into the authoring tool. Make a noticable, but minor change to the content. If there is a visible indication that the file has been automatically saved, select PASS. Otherwise, wait 5-10 minutes, close the file without manually saving the changes. Reopen the file. If the change you made is displayed correctly, select PASS. If the change was not saved, select FAIL.
3. Search the documentation for information on auto-save feature. If an auto-save feature is included in the documentation, confirm that it is working correctly using the procedure in step 2 or other procedure appropriate to the authoring tool. If you can confirm the feature is working, select PASS, otherwise select FAIL.

A.3.3.1 Static View Option:

If the authoring tool contains editing-views that render visual time-based content, then those editing-views can be paused and can be set to not play automatically. (Level A)

Test 0001 Assertion:

Test 0001: Author:

Test 0001 Steps:

1. If the authoring tool cannot be used to edit time-based content such as video, animation, animated gifs etc., then select SKIP
2. If the authoring tool does not include editing views that render visual time-based content such as video, animation, animated gifs etc., then select SKIP
3. If the renderings are non-editable, such as previews, this SC is SKIP.
4. Load sample video (audio, animation, animated gifs etc.)
5. If the authoring tool can be set to never play time-based content automatically AND once playing the content can be paused, then PASS.
6. If the editing view is web-based and the browser can be used to prevent auto-play and to pause the playing content then PASS.

A.3.4.1 Navigate By Structure:

If editing-views expose the markup elements in the web content being edited, then the markup elements (e.g., source code, content renderings) are selectable and navigation mechanisms are provided to move the selection focus between elements. (Level AA)

Test 0001 Assertion:

Test0001 Steps:

1. If the tool is designed such that markup elements are never disclosed to the author, this SC is SKIP
2. Where markup elements are disclosed to the user (e.g. document outline view, source view, etc.), if it is not possible to select a disclosed element without selecting any of the content that surrounds it, then FAIL.
3. If the only way to move selection from one disclosed element to the other is by clearing the selection and manually selecting the start and end point of the new element in the source, then FAIL.
4. Otherwise PASS.

A.3.4.2 Navigate by Programmatic Relationships:

If editing-views allow editing of programmatic relationships within web content, then mechanisms are provided that support navigation between the related content. (Level AAA)

• Note: Depending on the web content technology and the nature of the authoring tool, relationships may include, but are not limited to, element nesting, headings, labeling, programmatic definitions, and ID relationships.

Test 0001 Assertion:

Test0001 Steps:

1. If the tool is designed such that programmatic relationships (ID reference, data structure definition, function definition, etc.) are never disclosed to the author, this SC is SKIP
2. If a mechanism exists that allows the user to navigate between pieces of web content (elements, functions, etc.) where there is a programmatic relationship (ID reference, data structure definition, function definition, etc.) then PASS

A.3.5.1 Text Search:

If the authoring tool provides an editing-view of text-based content, then the editing-view enables text search, such that all of the following are true: (Level AA)

• (a) All Editable Text: Any text content that is editable by the editing-view is searchable (including alternative content); and
• (b) Match: Matching results can be made visible to authors and given focus; and
• (c) No Match: Authors are informed when no results are found; and
• (d) Two-way: The search can be made forwards or backwards.

Test 0001 Assertion:

Test 0001 Steps:

A.3.6.1 Independence of Display:

If the authoring tool includes display settings for editing-views, then the authoring tool allows authors to adjust these settings without modifying the web content being edited. (Level A)

Test 0001 Assertion:

Test Author: Tim Boland & Jan Richards

Test 0001 Steps:

1. 1. Determine (from the user interface or documentation) whether the authoring tool includes settings that affect how the content being edited is perceived by the author. If these settings exist, then document them. If not, then select SKIP.
2. 2. Create/open web content with the authoring tool.
3. 3. Determine a "method for testing how the web content will be experienced by end-users" (this may be as simple as opening the content in a user agent; or it may involve ending the authoring session).
4. 4. For each setting from Step 1, change the setting to a different value. Try to choose values that are as different as possible from the starting values, since this will make detecting differences easier. After changing each setting, save the content and then use the "method for testing how the web content will be experienced by end-users" (from Step 3). If the end user experience has changed for any of the settings, then select FAIL.
5. 5. If all settings can be changed without affecting the produced web content, then select PASS.

A.3.6.2 Save Settings:

If the authoring tool includes display and/or control settings, then these settings can be saved between authoring sessions. (Level AA)

Test 0001 Assertion:

Test 0001 Steps:

A.3.6.3 Apply Platform Settings:

The authoring tool respects changes in platform display and control settings, unless authors select more specific display and control settings using the authoring tool. (Level AA)

Test 0001 Assertion:

Test 0001 Steps:

A.3.6.4 Multiple Sets:

If the authoring tool includes display and/or control settings, then the authoring tool provides the option of saving and reloading multiple configurations of settings. (Level AAA)

Test 0001 Assertion:

Test 0001 Steps:

A.3.7.1 Preview (Minimum):

If a preview is provided, then at least one of the following is true: (Level A)

• (a) In-Market User Agent: The preview renders content using a user agent that is in-market; or
• (b) UAAG (Level A): The preview conforms to the User Agent Accessibility Guidelines 1.0 Level A [UAAG].

Test 0001 Assertion:

Test 0001 Steps:

A.3.7.2 Preview (Enhanced):

If a preview is provided, then authors can specify which user agent performs the preview. (Level AAA)

Test 0001 Assertion:

Test 0001 Steps:

A.4.1.1 Content Changes Reversible (Minimum):

All authoring actions are either reversible or the authoring tool requires author confirmation to proceed. (Level A)

Test 0001 Assertion: All authoring actions are either reversible or the authoring tool requires author confirmation to proceed.

Test 0001: Author: Tim Boland

Test 0001 Steps:

1. Open new content in the authoring tool with TEXT CONTENT or a mixture of TEXT CONTENT and NON-TEXT CONTENT WITH TEXT ALTERNATIVES, as appropriate to the authoring tool. You may also use the tool to create a sample page of content with text content or both text and non-text content.
2. Note "state" of web content within that authoring too
3. Edit that web content using that authoring tool, so that the "state" of web content after edit is different from that in step 2.
4. Attempt to "cancel" all edit(s) from step 3 by submitting request(s) to that authoring tool using appropriate mechanism provided by that authoring tool. If such mechanisms are not provided, go to step 6.
5. Immediately after step 4, check that as a result of the request(s) from step 4, the "state" of that web content is the same as the "state" of the same web content from step 2 edit(s). If this check is true, then select PASS. If this check is false, then select FAIL.
6. Check that this authoring tool provides explicit notification that no further action is possible unless permission is specifically granted by you using an appropriate mechanism provided by this authoring tool (i.e., authoring tool is "frozen" awaiting input from you). If such a notification is not provided, then select FAIL.
7. Answer "yes" to the "request to proceed" notification from step 6 , attempt to perform a subsequent action related to the authoring tool, and check that this subsequent action is successful. If this check is true, then select PASS. If this check is false, then select FAIL.

A.4.1.2 Settings Change Confirmation:

If the authoring tool provides mechanisms for changing authoring tool user interface settings, then those mechanisms can reverse the setting changes, or the authoring tool requires author confirmation to proceed. (Level A)

Test 0001 Assertion:User interface setting changes can be reversed, or require author confirmation to proceed.

Test 0001: Author: Tim Boland

Test 0001 Steps:

1. If there are NO mechanisms to change any preference settings within that authoring tool user interface, then select SKIP.
2. Open/install authoring tool. Note "values" of all preference settings within that authoring tool user interface.
3. For each mechanism to change the preference settings, use those mechanisms to change the relevant preference settings within that authoring tool user interface, so that the "value" of those preference settings is different from that from step 2.
4. Check if the authoring tool user interface provides explicit notification that no further action is possible from this authoring tool unless permission is specifically granted by you using an appropriate "vehicle" provided by this authoring tool user interface (i.e., authoring tool is "frozen" awaiting input from you). Answer "yes" to the "request to proceed" notification, then verify that the change is successful. If this check is true for all such preference setting mechanisms, then select PASS.
5. Attempt to "reverse" all changes from step 3 by using the same mechanisms as were used in step 3 to make the changes as appropriate. Check that as a result of the attempted reversals from step 3, the "value" of that associated preference setting is the same as the "value" of the same preference setting from step 2. If this check is true for all such preference setting mechanisms, then select PASS.
6. If both checks from Step 4 and Step 5 are false, then select FAIL.

A.4.1.3 Content Changes Reversible (Enhanced):

Authors can sequentially reverse a series of reversible authoring actions. (Level AAA)

• Note: It is acceptable to clear the authoring action history at the end of authoring sessions.

Test 0001 Assertion:

Test 0001 Steps:

A.4.2.1 Describe Accessibility Features:

For each authoring tool feature that is used to meet Part A of ATAG 2.0, at least one of the following is true: (Level A)

• (a) Described in the documentation: Use of the feature is explained in the authoring tool's documentation; or
• (b) Described in the interface: Use of the feature is explained in the authoring tool user interface; or
• (c) Platform service: The feature is a service provided by an underlying platform; or
• (d) Not used by authors: The feature is not used directly by authors (e.g., passing information to a platform accessibility service).

• Note: The accessibility of the documentation is covered by Guideline A.1.1 and Guideline A.1.2.

Test 0001 Assertion:

Test 0001 Steps:

1. Examine the user interface of the authoring tool, noting each user interface component that is necessary in order to meet part A of ATAG 2.0 (e.g. search functions). Note: Many of the success criteria in Part A are more qualitative and will not require particular user interface functionality (e.g. the requirement to follow WCAG 2.0). (Components are checked because they are the constituents of features)
2. For each of these user interface components:
   1. If the user interface component is part of functionality provided by the platform (e.g. the menu bar of the browser in the case of a web-based tool), then skip to the next component.
   2. If use of the user interface component is a convention of the platform (e.g. how to operate scrollbars, standard Save and Open dialog boxes), then skip to the next component.
   3. If use of the user interface component is clear from its context (e.g. a page zoom feature with percentage values in a drop-down list) , then skip to the next component.
   4. If the user interface component is documented in the interface (e.g. with text next to the item, context-sensitive help), then skip to the next component.
   5. Look up the user interface component (or its associated functionality) in the documentation. If documentation exists, then skip to the next component.
   6. If there is no way to discover how to use the user interface component besides trial-and-error then select FAIL.

A.4.2.2 Document All Features:

For each authoring tool feature, at least one of the following is true: (Level AA)

• (a) Described in the documentation: Use of the feature is explained in the authoring tool's documentation; or
• (b) Described in the interface: Use of the feature is explained in the authoring tool user interface; or
• (c) Platform service: The feature is a service provided by an underlying platform; or
• (d) Not used by authors: The feature is not used directly by authors (e.g., passing information to a platform accessibility service).

• Note: The accessibility of the documentation is covered by Guideline A.1.1 and Guideline A.1.2.

Test 0001 Assertion:

Test 0001 Steps:

1. Examine the user interface of the authoring tool, noting each user interface component that accepts input is available to the author. (Components are checked because they are the constituents of features)
2. For each of these user interface components:
   1. If the user interface component is part of functionality provided by the platform (e.g. the menu bar of the browser in the case of a web-based tool), then skip to the next component.
   2. If use of the user interface component is a convention of the platform (e.g. how to operate scrollbars, standard Save and Open dialog boxes), then skip to the next component.
   3. If use of the user interface component is clear from its context (e.g. a page zoom feature with percentage values in a drop-down list) , then skip to the next component.
   4. If the user interface component is documented in the interface (e.g. with text next to the item, context-sensitive help), then skip to the next component.
   5. Look up the user interface component (or its associated functionality) in the documentation. If documentation exists, then skip to the next component.
   6. If there is no way to discover how to use the user interface component besides trial-and-error then select FAIL. @@this would definitely benefit from a details section.

B.1.1.1 Content Auto-Generation After Authoring Sessions (WCAG):

If the authoring tool provides the functionality for automatically generating web content after the end of an authoring session, authors can specify that the content be accessible web content (WCAG). (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

• Note: This success criterion applies only to automatic processes specified by the authoring tool developer. It does not apply when author actions prevent generation of accessible web content (WCAG).

Test 0001 Assertion:

Test0001 Steps:

1. This SC only applies to authoring tools that add anything to the end-user experience beyond what the author has experienced during the authoring session. Otherwise, select SKIP
2. The SC's note also makes it clear that the SC refers to developer-provided processes, not processes created by the author or other third-parties.
3. If the auto-generation system primarily works by creating a wrapper around the author's entries, try to test the auto-generation system with as little author-entered content as possible.
4. If author input is required, ensure that only accessible content is added and that all prompts are followed correctly.
5. If the auto-generation system acts differently depending on the author's entries, try to test the auto-generation system with the "comprehensive accessible test content"
6. If additional author input is required, ensure that only accessible content is added and that all prompts are followed correctly.
7. Once the system produces output, follow the Web Content Accessibility Test Procedure to determine if it meets the WCAG 2.0 success criteria TARGET_LEVEL

B.1.1.2 Content Auto-Generation During Authoring Sessions (WCAG):

• (a) Accessible: The content is accessible web content (WCAG) without author input; or
• (b) Prompting: During the automatic generation process, authors are prompted for any required accessibility information (WCAG); or
• (c) Automatic Checking: After the automatic generation process, accessibility checking is automatically performed; or
• (d) Checking Suggested: After the automatic generation process, the authoring tool prompts authors to perform accessibility checking.

• Note 1: Automatic generation includes automatically selecting templates for authors.
• Note 2: This success criterion applies only to automatic processes specified by the authoring tool developer. It does not apply when author actions prevent generation of accessible web content (WCAG).

Test 0001 Assertion: Content generated automatically during authoring sessions.

Test 0001 Author: Jan Richards

Test 0001 Steps:

1. This SC applies only to authoring tools that automatically add content during the authoring session. Such processes can range from complex (e.g., a process that builds a whole page from just a few user entries - Note 1 applies here) to basic (e.g. adding a <strong> formatting tag when the user has selected to have text made "bold"). If the authoring tool does not automatically generate content, select SKIP.
2. Proceed by triggering as many automated authoring processes as possible. Trigger them one at a time with as little author-entered content as possible (e.g. triggering the automated processes on nearly empty pages).
3. If all of the automated authoring processes result in one of the follow outcomes then select PASS. (a) The produced content (not necessarily the document as a whole) passes the "Web Content Accessibility Test Procedure (Level AAA)"; or (b) During the automatic process, authors are prompted for any required accessibility information (WCAG) and if this is properly supplied then the produced content passes the "Web Content Accessibility Test Procedure (Level AAA)"; or (c) After the automatic generation process, accessibility checking is automatically performed (check-as-you-type systems that check for accessibility continuously will meet this); or (d) Checking Suggested: After the automatic generation process, the authoring tool prompts authors to perform accessibility checking (such prompts need not be obtrusive).
4. if any of the processes do not result in any of the outcomes in (3) then, select FAIL.

002 REPEAT WITH AA

003 REPEAT WITH A

B.1.2.1 Restructuring and Recoding Transformations (WCAG):

If the authoring tool provides restructuring transformations or re-coding transformations, and if equivalent mechanisms exist in the web content technology of the output, then at least one of the following is true: (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

• (a) Preserve: Accessibility information (WCAG) is preserved in the output; or
• (b) Warning: Authors have the default option to be warned that accessibility information (WCAG) may be lost (e.g., when saving a vector graphic into a raster image format); or
• (c) Automatic Checking: After the transformation, accessibility checking is automatically performed; or
• (d) Checking Suggested: After the transformation, the authoring tool prompts authors to perform accessibility checking.

• Note 1: For text alternatives for non-text content, see Success Criterion B.1.2.4.
• Note 2: This success criteria only applies when the output technology is "included" for conformance.

Test 0001 Assertion:

1. This SC applies only to authoring tools that perform restructuring or recoding transformations. In restructuring transformations, the content technology (e.g. HTML) stays the same, but the structural features of the technology used to markup the content are changed (e.g., linearizing tables, splitting a document into pages. In recoding transformations, the content technology used to encode the content is changed (e.g., HTML to XHTML, a word processing format to HTML). If the authoring tool does not perform such transformations, then select SKIP.
2. Examine the user interface and documentation for potential processes (e.g. under "Save As", "Export", etc.). While determining candidates: - Note that these must be automatic processes. A general find-and-replace mechanism does not qualify. - Note that the definition of content transformations excludes clipboard actions (such as copy and paste), which are treated separately. - Note that for recoding transformations, only processes resulting in technologies "included" for conformance are applicable. Saving from an "included" technology to an "unincluded" technology is not covered. - Note 1 excludes text alternatives for non-text content, an important subset of the "Listing of Accessibility Information Types". - Note that an equivalent mechanism for preserving the accessibility information must exist (in order to preserve captions, both technologies must support captions). Consult the "Listing of Accessibility Information Types" for the input and output technologies.
3. If all of the restructuring or recoding transformation processes result in one of the follow outcomes (when operating on the "Comprehensive accessible test content (Level AAA)") then select PASS. (a) The transformed content passes the "Web Content Accessibility Test Procedure (Level AAA)"; or (b) Before the transformation process proceeds, authors are warned that accessibility information may be lost; or (c) After the transformation process, accessibility checking is automatically performed (check-as-you-type systems that check for accessibility continuously will meet this); or (d) Checking Suggested: After the transformation process, the authoring tool prompts authors to perform accessibility checking (such prompts need not be obtrusive).
4. If any of the transformation processes do not result in any of the outcomes in (3) then, select FAIL.

B.1.2.2 Copy-Paste Inside Authoring Tool (WCAG):

If the authoring tool supports copy and paste of structured content, then any accessibility information (WCAG) in the copied content is preserved when the authoring tool is both the source and destination of the copy-paste. (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion:

Test 0001 Steps:

B.1.2.3 Optimizations Preserve Accessibility:

If the authoring tool provides optimizing web content transformations, then any accessibility information (WCAG) in the input is preserved in the output. (Level A).

Test 0001 Assertion:

Test 0001 Steps:

B.1.2.4 Text Alternatives for Non-Text Content are Preserved:

If the authoring tool provides web content transformations that preserve non-text content in the output, then any text alternatives for that non-text content are also preserved, if equivalent mechanisms exist in the web content technology of the output. (Level A).

• Note: This success criteria only applies when the output technology is "included" for conformance.

Test 0001 Assertion:

Test 0001 Steps:

B.2.1.1 Accessible Content Possible (WCAG):

If the authoring tool places restrictions on the web content that authors can specify, then those restrictions do not prevent WCAG 2.0 success criteria from being met. (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion:

Test 0001 Steps:

B.2.2.1 Accessible Option Prominence (WCAG):

If authors are provided with a choice of authoring actions for achieving the same authoring outcome (e.g., styling text), then options that will result in accessible web content (WCAG) are at least as prominent as options that will not. (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion:

Test 0001 Steps:

B.2.2.2 Setting Accessibility Properties (WCAG):

If the authoring tool provides mechanisms to set web content properties (e.g., attribute values), then mechanisms are also provided to set web content properties related to accessibility information (WCAG). (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

• Note: Success Criterion B.4.1.4 addresses the prominence of the mechanisms.

Test 0001 Assertion:

Test 0001 Steps:

B.2.3.1 Alternative Content is Editable (WCAG):

If the authoring tool provides functionality for adding non-text content, then authors are able to modify programmatically associated text alternatives for non-text content. (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion:

Test 0001 Steps:

B.2.3.2 Conditions on Automated Suggestions:

If the authoring tool automatically suggests text alternatives for non-text content during the authoring session, then the text alternatives may only be suggested under the following conditions: (Level A)

• (a) Author Control: Authors have the opportunity to accept, modify, or reject the suggested text alternatives prior to insertion; and
• (b) Relevant Sources: The suggested text alternatives are only derived from sources designed to fulfill the same purpose (e.g., suggesting the value of an image's "description" metadata field as a long description).

Test 0001 Assertion:

Test 0001 Steps:

B.2.3.3 Let User Agents Repair:

If the authoring tool provides automatic repair of text alternatives for non-text content after the end of an authoring session, then the authoring tool avoids using text values that would also be available to user agents. (Level A)

• Note: Examples of text values that are also available to user agents, and should be avoided, include the filename, the file format, and generic phrases (e.g. "image").

Test 0001 Assertion:

Test 0001 Steps:

B.2.3.4 Save for Reuse:

If the authoring tool provides the functionality for adding non-text content,

• (a) Save and Suggest: The text alternatives are automatically saved and suggested by the authoring tool, if the same non-text content is reused; and
• (b) Edit Option: The author has the option to edit or delete the saved text alternatives.

Test 0001 Assertion:

Test 0001 Steps:

B.2.4.1 Accessible Template Options (WCAG):

If the authoring tool provides templates, then there are accessible template (WCAG) options for a range of template uses. (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion:

Test 0001 Steps:

B.2.4.2 Identify Template Accessibility (Minimum):

If the authoring tool includes a template selection mechanism and provides any non-accessible template (WCAG) options, then the templates are provided such that the template selection mechanism can display distinctions between the accessible and non-accessible options. (Level AA)

• Note: The distinction can involve providing information for the accessible templates, the non-accessible templates or both.

Test 0001 Assertion:

Test 0001 Steps:

B.2.4.3 Author-Created Templates:

If the authoring tool includes a template selection mechanism and allows authors to create new non-accessible templates (WCAG), then authors can enable the template selection mechanism to display distinctions between accessible and non-accessible templates that they create. (Level AA)

• Note: The distinction can involve providing information for the accessible templates (WCAG), the non-accessible templates or both.

Test 0001 Assertion:

Test 0001 Steps:

B.2.4.4 Identify Template Accessibility (Enhanced):

If the authoring tool provides any non-accessible templates (WCAG) options and does not include a template selection mechanism, then the non-accessible templates include accessibility warnings within the templates. (Level AAA)

Test 0001 Assertion:

Test 0001 Steps:

B.2.5.1 Pre-Authored Content Selection Mechanism:

If authors are provided with a selection mechanism for pre-authored content other than templates (e.g., clip art gallery, widget repository, design themes), then both of the following are true: (Level AA)

• (a) Indicate: The selection mechanism indicates the accessibility status of the pre-authored content (if known); and
• (b) Prominence: Any accessible (WCAG) options are at least as prominent as other pre-authored content options.

Test 0001 Assertion:

Test 0001 Steps:

B.2.5.2 Pre-Authored Content Accessibility Status:

If the authoring tool provides a repository of pre-authored content, then each of the content objects has a recorded accessibility status. (Level AAA)

Test 0001 Assertion:

Test 0001 Steps:

B.3.1.1 Checking Assistance (WCAG):

If the authoring tool provides authors with the ability to add or modify web content in such a way that a WCAG 2.0 success criterion can be violated, then accessibility checking for that success criterion is provided (e.g., an HTML authoring tool that inserts images should check for alternative text; a video authoring tool with the ability to edit text tracks should check for captions). (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

• Note: Automated and semi-automated checking is possible (and encouraged) for many types of web content accessibility problems (WCAG). However, manual checking is the minimum requirement to meet this success criterion. In manual checking, the authoring tool provides authors with instructions for detecting problems, which authors must carry out by themselves. For more information on checking, see Implementing ATAG 2.0 - Appendix B: Levels of Checking Automation.

Test 0001 Assertion: Checking assistance (WCAG Level A) is present in less-restrictive authoring tools. [@@JR updated]

1. Check whether the authoring tool allows authors to open/paste-in pre-existing content (i.e., Comprehensive non-accessible test content (Level A)). If this is not possible, then select SKIP.
2. Search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
3. Run the checker (if the checker is manual, this will entail following ALL checking instructions). If the checker provides detail about individual errors then you can open/paste-in all of the Comprehensive non-accessible test content (Level A) at once. If the checker provides only aggregate results, open/paste-in the Comprehensive non-accessible test content (Level A) one piece at a time.
4. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

Test 0002 Assertion: Checking assistance (WCAG Level AA) is present in less-restrictive authoring tools. [@@JR updated]

1. Check whether the authoring tool allows authors to open/paste-in pre-existing content (i.e., Comprehensive non-accessible test content (Level AA)). If this is not possible, then select SKIP.
2. Search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
3. Run the checker (if the checker is manual, this will entail following ALL checking instructions). If the checker provides detail about individual errors then you can open/paste-in all of the Comprehensive non-accessible test content (Level AA) at once. If the checker provides only aggregate results, open/paste-in the Comprehensive non-accessible test content (Level AA) one piece at a time.
4. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

Test 0003 Assertion: Checking assistance (WCAG Level AA) is present in less-restrictive authoring tools. [@@JR updated]

1. Check whether the authoring tool allows authors to open/paste-in pre-existing content (i.e., Comprehensive non-accessible test content (Level AAA)). If this is not possible, then select SKIP.
2. Search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
3. Run the checker (if the checker is manual, this will entail following ALL checking instructions). If the checker provides detail about individual errors then you can open/paste-in all of the Comprehensive non-accessible test content (Level AAA) at once. If the checker provides only aggregate results, open/paste-in the Comprehensive non-accessible test content (Level AAA) one piece at a time.
4. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

Test 0004 Assertion: Checking assistance (WCAG Level A) is present in more-restrictive authoring tools. [@@JR updated]

1. If the authoring tool allows allow authors to open/paste-in pre-existing content, select SKIP.
2. Using Comprehensive non-accessible test content (Level A) as a guide, attempt to create accessibility problems using the authoring tool. If this is not possible due to authoring restrictions (such as highly limited editing scope or compulsory fields), then select SKIP.
3. If accessibility problems have been added to the content, search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
4. Run the checker (if the checker is manual, this will entail following ALL checking instructions.
5. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

Test 0005 Assertion: Checking assistance (WCAG Level AA) is present in more-restrictive authoring tools. [@@JR updated]

1. If the authoring tool allows allow authors to open/paste-in pre-existing content, select SKIP.
2. Using Comprehensive non-accessible test content (Level AA) as a guide, attempt to create accessibility problems using the authoring tool. If this is not possible due to authoring restrictions (such as highly limited editing scope or compulsory fields), then select SKIP.
3. If accessibility problems have been added to the content, search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
4. Run the checker (if the checker is manual, this will entail following ALL checking instructions.
5. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

Test 0006 Assertion: Checking assistance (WCAG Level A) is present in more-restrictive authoring tools. [@@JR updated]

1. If the authoring tool allows allow authors to open/paste-in pre-existing content, select SKIP.
2. Using Comprehensive non-accessible test content (Level AAA) as a guide, attempt to create accessibility problems using the authoring tool. If this is not possible due to authoring restrictions (such as highly limited editing scope or compulsory fields), then select SKIP.
3. If accessibility problems have been added to the content, search the user interface (and documentation) for accessibility checking functionality (which can be automated, semi-automated, manual instructions or a combination). If checking functionality is not present, then select FAIL.
4. Run the checker (if the checker is manual, this will entail following ALL checking instructions.
5. If the checker is able to cause all of the accessibility problems to be detected (automatically, semi-automatically, manually or a combination), then select PASS. Otherwise, select FAIL.

B.3.1.2 Help Authors Decide:

If the authoring tool provides checks that require authors to decide whether a potential web content accessibility problem (WCAG) is correctly identified (i.e., manual checking and semi-automated checking), then instructions are provided from the check that describe how to decide. (Level A)

Test 0001 Assertion: Checking assistance (WCAG Level A) includes help to decide whether potential issues are actual issues, if user judgement is required. [@@JR updated]

1. Examine the checking functionality identified in the WCAG Level A-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
2. If the checker automatically identifies all of the issues, the select SKIP.
3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether support of some kind (e.g. instructions) is provided in each case to help the user make the required decision. If such support is always provided, then select PASS, otherwise select FAIL.

Test 0002 Assertion: Checking assistance (WCAG Level AA) includes help to decide whether potential issues are actual issues, if user judgement is required. (Note: Only shown if the user has specified AA or AAA as the target level) [@@JR updated]

1. Examine the checking functionality identified in the WCAG Level AA-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
2. If the checker automatically identifies all of the issues, the select SKIP.
3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether support of some kind (e.g. instructions) is provided in each case to help the user make the required decision. If such support is always provided, then select PASS, otherwise select FAIL.

Test 0003 Assertion: Checking assistance (WCAG Level AAA) includes help to decide whether potential issues are actual issues, if user judgement is required. (Note: Only shown if the user has specified AAA as the target level) [@@JR updated]

1. Examine the checking functionality identified in the WCAG Level AAA-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
2. If the checker automatically identifies all of the issues, the select SKIP.
3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether support of some kind (e.g. instructions) is provided in each case to help the user make the required decision. If such support is always provided, then select PASS, otherwise select FAIL.

B.3.1.3 Help Authors Locate:

If the authoring tool provides checks that require authors to decide whether a potential web content accessibility problem (WCAG) is correctly identified (i.e., manual checking and semi-automated checking), then the relevant content is identified to the authors. (Level A)

• Note: Depending on the nature of the editing-view and the scope of the potential web content accessibility problem (WCAG), identification might involve highlighting elements or renderings of elements, displaying line numbers, or providing instructions.

Test 0001 Assertion: Checking assistance (WCAG Level A) includes help to locate potential issues if user judgement is required. [@@JR updated]

1. Examine the checking functionality identified in the WCAG Level A-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
2. If the checker automatically identifies all of the issues, then select SKIP.
3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether a mechanism of some kind (e.g. hyperlink to the location, identification by line number, instructions on how to locate, etc.) is provided in each case to help the user determine where the potential issue is located within the content. If such a mechanism is always provided, then select PASS, otherwise select FAIL.

Test 0002 Assertion: Checking assistance (WCAG Level AA) includes help to locate potential issues if user judgement is required. (Note: Only shown if the user has specified AA or AAA as the target level) [@@JR updated]

1. Examine the checking functionality identified in the WCAG Level AA-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
2. If the checker automatically identifies all of the issues, then select SKIP.
3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether a mechanism of some kind (e.g. hyperlink to the location, identification by line number, instructions on how to locate, etc.) is provided in each case to help the user determine where the potential issue is located within the content. If such a mechanism is always provided, then select PASS, otherwise select FAIL.

Test 0003 Assertion: Checking assistance (WCAG Level AAA) includes help to locate potential issues if user judgement is required. (Note: Only shown if the user has specified AAA as the target level) [@@JR updated]

1. Examine the checking functionality identified in the WCAG Level AAA-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
2. If the checker automatically identifies all of the issues, then select SKIP.
3. If the checker relies on the author to verify any found issues (as semi-automatic checks do) or find issues (as manual instructions do), then check whether a mechanism of some kind (e.g. hyperlink to the location, identification by line number, instructions on how to locate, etc.) is provided in each case to help the user determine where the potential issue is located within the content. If such a mechanism is always provided, then select PASS, otherwise select FAIL.

B.3.1.4 Status Report:

If the authoring tool provides checks, then authors can receive an accessibility status report based on the results of the accessibility checks. (Level AA)

• Note: The format of the accessibility status report is not specified and they might include a listing of problems detected or a WCAG 2.0 conformance level, etc..

Test 0001 Assertion: Accessibility status reporting is present. [@@JR updated]

1. Examine the checking functionality identified for B.3.1.1. If no checking functionality exists, then select SKIP.
2. If the checking functionality does not result in any information being returned to the author about accessibility issues, then select FAIL.
3. If the information returned is gathered together in some way (a conformance statement, a list of accessibility problems, etc.), then select PASS.

B.3.1.5 Programmatic Association of Results:

If the authoring tool provides checks, then the authoring tool can programmatically associate accessibility checking results with the web content that was checked. (Level AA)

Test 0001 Assertion: Checking results can be programmatic associated to the content. [@@JR updated]

1. Examine the checking functionality identified for B.3.1.1. If no checking functionality exists, then select SKIP.
2. Examine the checking functionality (including settings and documentation) to see if it includes any functionality that allows the results of the checking to be programmatically associated with the content (e.g. a file containing the checking results that includes a hyperlink back to the checked content).
3. If the checking results can be programmatically associated with the content, then select PASS. Otherwise, select FAIL.

B.3.2.1 Repair Assistance (WCAG):

If checking (see Success Criterion B.3.1.1) can detect that a WCAG 2.0 success criterion is not met, then repair suggestion(s) are provided: (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

• Note: Automated and semi-automated repair is possible (and encouraged) for many types of web content accessibility problems (WCAG). However, manual repair is the minimum requirement to meet this success criterion. In manual repair, the authoring tool provides authors with instructions for repairing problems, which authors must carry out by themselves. For more information on repair, see Implementing ATAG 2.0 - Appendix C: Levels of Repair Automation.

Test 0001 Assertion: Checking assistance (WCAG Level A) includes help to repair all detected issues. [@@JR updated]

1. Examine the checking functionality identified in the WCAG Level A-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
2. If the authoring tool automatically repairs all identified issues, then select SKIP.
3. For each identified issue, that is not automatically fixed:
   1. Check whether support of some kind (e.g. dialog with repair options, instructions on how to repair, etc.) is provided. If it is, go on to the next issue.
   2. If no support is provided, then select FAIL.
4. If support is provided for every identified issue, then select PASS.

Test 0002 Assertion: Checking assistance (WCAG Level AA) includes help to repair all detected issues. (Note: Only shown if the user has specified AA or AAA as the target level) [@@JR updated]

1. Examine the checking functionality identified in the WCAG Level A-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
2. If the authoring tool automatically repairs all identified issues, then select SKIP.
3. For each identified issue, that is not automatically fixed:
   1. Check whether support of some kind (e.g. dialog with repair options, instructions on how to repair, etc.) is provided. If it is, go on to the next issue.
   2. If no support is provided, then select FAIL.
4. If support is provided for every identified issue, then select PASS.

Test 0003 Assertion: Checking assistance (WCAG Level AAA) includes help to repair all detected issues. (Note: Only shown if the user has specified AAA as the target level) [@@JR updated]

1. Examine the checking functionality identified in the WCAG Level A-related tests for B.3.1.1. If no checking functionality exists, then select SKIP.
2. If the authoring tool automatically repairs all identified issues, then select SKIP.
3. For each identified issue, that is not automatically fixed:
   1. Check whether support of some kind (e.g. dialog with repair options, instructions on how to repair, etc.) is provided. If it is, go on to the next issue.
   2. If no support is provided, then select FAIL.
4. If support is provided for every identified issue, then select PASS.

B.4.1.1 Features Active by Default:

All accessible content support features are turned on by default. (Level A)

Test 0001 Assertion: All accessible content support features are turned on by default. [@@JR updated]

1. Create or retrieve the List of Accessible Content Support Features (the "List')
2. For each feature on the "List":
   1. If the feature is "always on", go on to the next feature.
   2. If the feature can be turned off, check whether it is on by default. If it is, go on to the next feature.
   3. If the future is off by default, then then select FAIL.
3. If all of the features are either "always on" or on by default, then select PASS.

B.4.1.2 Option to Reactivate Features:

If authors can turn off an accessible content support feature, then they can turn the feature back on. (Level A)

Test 0001 Assertion: All accessible content support features that can be turned off, can be turned back on. [@@JR updated]

1. Retrieve or create the List of Accessible Content Support Features (the "List").
2. For each feature on the "List":
   1. Determine whether the feature can be turned off. If not, go on to the next feature.
   2. If it can be turned off, turn it off and then check whether it can be turned back on. If it can be turned back on, go on to the next feature.
   3. If it cannot be turned back on, then select FAIL.
3. If all of the features that can be turned off can be turned back on, then select PASS.

B.4.1.3 Feature Deactivation Warning:

If authors turn off an accessible content support feature, then the authoring tool informs them that this may increase the risk of content accessibility problems (WCAG). (Level AA)

Test 0001 Assertion: All accessible content support features that can be turned off include a warning of the potential consequences. [@@JR updated]

1. Retrieve or create the List of Accessible Content Support Features (the "List").
2. For each feature on the "List":
   1. Determine whether the feature can be turned off. If not, go on to the next feature.
   2. If it can be turned off, turn it off and check for any type of warning (text, icon, pop-up, etc.), before and/or after the feature is turned off, explaining that turning off the feature may increase the risk of accessibility problems being introduced. If a warning is present, go on to the next feature.
   3. If no warning is presented, then select FAIL.
3. If all of the features that can be turned off include warnings, then select PASS.

B.4.1.4 Feature Prominence:

All accessible content support features are at least as prominent as features related to either invalid markup, syntax errors, spelling errors or grammar errors. (Level AA)

Test 0001 Assertion: Content support features are as prominent as features related to either invalid markup, syntax errors, spelling errors or grammar errors. [@@JR updated]

1. Retrieve or create the List of Accessible Content Support Features (the "List").
2. For each feature on the List:
   1. Identify whether the feature is comparable to another feature of the authoring tool related to either invalid markup, syntax errors, spelling errors, or grammar errors (e.g., an accessibility checker is comparable with a spell checker). If there is no comparable feature, go on to the next feature.
   2. If there is a comprable feature, for both the accessible feature and its comparator-feature, determine how many "opening actions" are required to access each. "Opening actions" are actions made by authors on components within the user interface that result in new components becoming displayed or enabled. (e.g., keyboard shortcut to a top-level menu item to display a sub-menu, keyboard selection on a button to display a dialog box, mouse click on a checkbox to enable previously disabled sub-items, etc. Actions that do not cause new components to become actionable (e.g., moving focus, scrolling a list), are not counted as "opening actions".)
   3. If the accessible content support feature requires the same or less "opening actions", go on to the next feature.
   4. If the comparator feature requires less "opening actions", then select FAIL.
3. If all of the accessible content support features required the same or less "opening actions". select PASS.

B.4.2.1 Model Practice (WCAG):

A range of examples in the documentation (e.g., markup, screen shots of WYSIWYG editing-views) demonstrate accessible authoring practices (WCAG). (Level A to meet WCAG 2.0 Level A success criteria; Level AA to meet WCAG 2.0 Level A and AA success criteria; Level AAA to meet all WCAG 2.0 success criteria)

Test 0001 Assertion: At least two example of Level A accessible authoring practices appear in the documentation. (Note: Only shown if the user has specified A as the target level) [@@JR updated]

1. Locate the authoring tool's documentation.
2. Locate examples of authoring practice being used in the documentation (e.g. examples of markup, screenshots, etc.).
3. Referring to the Web Content Accessibility Test Procedure, determine whether the demonstrated authoring practice would meet WCAG 2.0 Level A (e.g. if an image insertion dialog box is shown with an inappropriately empty alt field).
4. If two practices can be found that would meet WCAG 2.0 Level A, select PASS. Otherwise, select FAIL.

Test 0002 Assertion: At least two example of Level AA accessible authoring practices appear in the documentation. (Note: Only shown if the user has specified AA as the target level) [@@JR updated]

1. Locate the authoring tool's documentation.
2. Locate examples of authoring practice being used in the documentation (e.g. examples of markup, screenshots, etc.).
3. Referring to the Web Content Accessibility Test Procedure, determine whether the demonstrated authoring practice would meet WCAG 2.0 Level AA (e.g. if an image insertion dialog box is shown with an inappropriately empty alt field).
4. If two practices can be found that would meet WCAG 2.0 Level AA, select PASS. Otherwise, select FAIL.

Test 0003 Assertion: At least two example of Level AAA accessible authoring practices appear in the documentation. (Note: Only shown if the user has specified AAA as the target level) [@@JR updated]

1. Locate the authoring tool's documentation.
2. Locate examples of authoring practice being used in the documentation (e.g. examples of markup, screenshots, etc.).
3. Referring to the Web Content Accessibility Test Procedure, determine whether the demonstrated authoring practice would meet WCAG 2.0 Level AAA (e.g. if an image insertion dialog box is shown with an inappropriately empty alt field).
4. If two practices can be found that would meet WCAG 2.0 Level AAA, select PASS. Otherwise, select FAIL.

B.4.2.2 Feature Instructions:

Instructions for using any accessible content support features appear in the documentation. (Level A)

Test 0001 Assertion: Instructions for using any accessible content support features appear in the documentation. [@@JR updated]

1. Search the authoring tool user interface (and linked support material) for documentation (e.g. a help system)
2. If no documentation can be found, then select FAIL.
3. Retrieve or create the List of Accessible Content Support Features (the "List").
4. For each feature on the "List":
   1. If the feature does have instructions in the documentation, go on to the next feature.
   2. If the feature does have instructions in the documentation, then select FAIL.
5. If all of the features have instructions that appear in the documentation, then select PASS.

B.4.2.3 Tutorial:

The authoring tool provides a tutorial for an accessible authoring process that is specific to that authoring tool. (Level AAA)

Test 0001 Assertion: The authoring tool provides a tutorial for an accessible authoring process that is specific to that authoring tool. [@@JR updated]

1. Search the authoring tool user interface (and linked support material) for a step-by-step tutorial explaining how to use the tool to produce accessible web content.
2. If no accessibility-related tutorials can be found, then select FAIL.
3. If one or more accessibility-related tutorials are found, review the tutorials checking whether any of the tutorials are specific to the authoring tool or whether they only treat the subject generally (such that the tutorials could equally serve as a tutorial for a different authoring tool).
4. If any of the tutorials is specific to the authoring tool , then select PASS. Otherwise, select FAIL.

B.4.2.4 Instruction Index:

The authoring tool documentation contains an index to the instructions for using any accessible content support features. (Level AAA)

Test 0001 Assertion: The authoring tool documentation contains an index to the instructions for using any accessible content support features. [@@JR updated]

1. Search the authoring tool user interface (and linked support material) for an instruction index (e.g. "Search Help", list of help topics, etc.).
2. If no index can be found, then select FAIL.
3. Retrieve or create the List of Accessible Content Support Features (the "List").
4. For each feature on the "List":
   1. If the feature does not have instructions in the documentation, go on to the next feature.
   2. If the feature does have instructions in the documentation, and is reachable from the index, go on to the next feature.
   3. If the feature does have instructions in the documentation, but is not reachable from the index, then select FAIL.
5. If all of the features are reachable from the index, then select PASS.