- From: Seth Thompson <seth@bocoup.com>
- Date: Mon, 25 Jul 2022 06:57:00 -0400
- To: public-aria-at@w3.org
- Cc: Matthew King <mck@fb.com>, James Scholes <james@pac.bz>, Isaac Durazo <isaac@bocoup.com>
- Message-ID: <CAKrs2vR6mSC54kTASsmpNkG4MrYXO+idvC3HH3tn1D+u4VMBmg@mail.gmail.com>
Hi all,
Since we didn’t have an ARIA-AT Community Group meeting last week, I wanted
to provide an asynchronous update for those who are following the design of
the new Candidate Test Plan page where vendors will be able to review test
plans for their AT.
The following update can also be found as a comment on the GitHub thread
<https://github.com/w3c/aria-at-app/issues/437#issuecomment-1193834553>
containing the original mockups. Feel free to provide feedback or continue
the conversation on the thread. The original mockups will be updated to
reflect these changes soon.
- New top-level hierarchy of test plans
- The top-level view of Candidate test plans has been updated to
organize plans by AT, so that vendors can easily identify the plans that
they are responsible for reviewing.
- Each AT is given a separate heading and a separate table of test
plans. For now these tables have two columns: Test Plan Name
(which is also
a link) and Review Status
- Pending an ongoing discussion, this table could also include
another column with a summary of results
- New view for reviewing tests and test content
- The new view for reviewing test and test content resembles the Test
Run view, rather than the reports page.
- There is a left-hand navigation section with an ordered list of all
tests and an icon to indicate progress.
- The right-hand pane contains the full test material: instructions,
test page link, commands, and assertions
- The output and assertion results are visible as read-only form
elements. This design choice allows us to maintain consistency with the
Test Run view and convey that the results are included for
context, but not
part of the actual content being reviewed.
- The action buttons would be updated to reflect the capabilities of
the vendor reviewers
- New format for test content and results
- The new format of the test content is identical to the initial form
that testers see when filling in results. This will allow reviewers to
easily understand the test instructions, success criteria, and test page,
in context.
- The candidate results (output and assertions results) will be
visible as readonly form inputs or text within a disclosure widget. This
allows the results to be seen, but foregrounds the test content itself
(instructions, commands, and assertions) as the object of review.
- This change replaces the tabular summary view of results which is
visible on the reports page and as a confirmation screen after submitting
results as a tester.
Looking forward to discussing these changes in more detail at the upcoming
meeting. We're happy to provide additional context and considerations for
these choices or to consider other options for any design challenges.
Best,
Seth & Isaac
Received on Monday, 25 July 2022 10:59:05 UTC