RE: Focus and Combobox Interaction with Mobile VoiceOver

Hi Taliesin,

 

Did you figure out what you would like to do with this?

 

If a screen reader is not running, can users interact with the slider when the listbox is expanded? If so, I assume interacting with the slider would collapse the listbox? The same type of interaction should be OK for screen reader users.

 

That said, as a VoiceOver user, I find those types of interactions more tedious on web than in native mobile. In native mobile, pop-up menus and lists are often modal and that can simplify the interaction … except when it is buggy and you can’t get out of the modal ☹. Attempting to replicate that for mobile web is an interesting idea, but it would be a significant change to the patterns and could be pretty tricky. It could have some undesirable side effects for desktop users.

 

BTW, coming changes to the combobox role in ARIA 1.2 will make this kind of widget simpler and more flexible. We may be rewriting that collapsible listbox pattern using combobox later this year.

 

Matt King

 

From: Taliesin Smith <talilief@gmail.com> 
Sent: Sunday, January 19, 2020 8:07 PM
To: w3c-wai-ig@w3.org
Cc: Jesse Greenberg <jesse.greenberg@colorado.edu>
Subject: Focus and Combobox Interaction with Mobile VoiceOver

 

Hi Folks,

I have a question about how strict focus should be kept on a list of options in a combobox interaction. 

 

The PhET Sim Molarity is implemented with interactive description that can be accessed with four screen reader/browser combinations: NVDA & Firefox, JAWS & Chrome, VoiceOver & Safari, and Mobile VO & Safari on iOS. My question is specifically about Mobile Voice on iOS.

 

Link to Molarity: https://phet-dev.colorado.edu/html/molarity/1.6.0-dev.1/phet/molarity_en_phet.html?a11y

 

The combobox interaction for choosing a new solute is based on the the accessible design pattern used here:

https://www.w3.org/TR/wai-aria-practices/examples/listbox/listbox-collapsible.html

 

The issue that we have found is that when using Mobile VoiceOve it is possible for the list of options to stay open and still move focus over to a slider and interact with the slider.

 

My question is, would it be better to treat the popped-up list of solutes like a dialog and prevent access to the rest of the sim while the list of options is open?

 

Currently, we are using focus, so when the list loses focus it closes, but this doesn’t seem to work with Mobile VoiceOver.

 

Any thoughts?

 

Taliesin Smith

 

~.~.~

Also available off list at:

Taliesin.Smith@colorado.edu <mailto:Taliesin.Smith@colorado.edu> 
Inclusive Design Researcher
PhET Interactive Simulations
https://phet.colorado.edu/en/accessibility
Physics Department
University of Colorado, Boulder