Re: Retesting radio buttons/VO bot

My opinion is that bot results should be run first and included before a tester starts. That way, all they have to do is verify/correct them versus having to retype everything, which takes those of us who suck at typing a really long time.

From: Mike Pennisi <mike@bocoup.com>
Date: Wednesday, February 5, 2025 at 5:46 PM
To: Dean Hamack <dean@bushidodesigns.net>, "public-aria-at@w3.org" <public-aria-at@w3.org>
Subject: Re: Retesting radio buttons/VO bot


Ah, I see! In that case, the behavior you've reported is expected.

This sounds like an opportunity for a good design discussion around a new feature, though. Perhaps we want the system to store bot-collected AT responses independently from any particular Test Plan Run (and to draw from that whenever creating new Test Plan Runs). Or maybe we just want to give Testers the ability to request work from the bot. Or maybe something else...
On 2/5/25 20:39, Dean Hamack wrote:
Thanks Mike. I actually assigned myself to the new test, so that’s not the issue.

From: Mike Pennisi <mike@bocoup.com><mailto:mike@bocoup.com>
Date: Wednesday, February 5, 2025 at 5:38 PM
To: <public-aria-at@w3.org><mailto:public-aria-at@w3.org>
Subject: Re: Retesting radio buttons/VO bot
Resent-From: <public-aria-at@w3.org><mailto:public-aria-at@w3.org>
Resent-Date: Thu, 6 Feb 2025 01:37:46 +0000


Hi Dean! Sorry for the delay. While we shouldn't rule out a bug in the application, there's a chance that this might have simply been an administrative oversight.

Here's how this works from a Test Admin's perspective. First, a new Test Plan Run is created and assigned to a bot. The bot immediately starts doing its job collecting AT responses. Once the bot is done, the Test Admin re-assigns the Test Plan Run to a human Tester.

One possible explanation for your issue is that a new Test Plan Run was created and assigned to you directly. Matt or Isa might be able to weigh in here on the list, but it's probably just as likely that we discuss it during tomorrow's CG meeting.
On 1/31/25 23:58, Dean Hamack wrote:
Hi folks,

Went in to look at the new radio button tests. The bot ran the tests for VO, but unlike in the past, it didn’t export the output into the user tests.

Allow me to explain: before when we would run the bot and you would sign up to do a test, all of the tests were prepopulated with the bot results, which were usually correct. Now when I go there, I would have to copy the output from the bot tests and paste it into mine, which massively increases the time.

Is there a way to have the bot results populated into the test users’ accounts?

Dean Hamack, CPWA
AXXS
Phone: (206) 226-0719
Email: dean@axxs.io<mailto:dean@axxs.io>

Received on Thursday, 6 February 2025 01:57:01 UTC