RE: Testing captcha

To Janina

In Window's 10 I've tried using Narrator (Windows 10 October 2018 update version) in both Edge and Internet Explorer to see if my results were similar to yours. Here's how it went: 

Edge with Narrator: Tickbox for 'I am not a robot' worked every time 
IE with Narrator: always failed the reCAPTCHA tickbox. Audio CAPTCHA came up. Sometimes it would work fine, but my attempts with misspellings or leaving our words didn't work. For example, on one occasion I had two words read out, one of which I couldn't hear well so just entered the first word but it didn't work and took me back to the tickbox. 

Anecdotally it suggests that the experience between users, screen readers and web browsers is totally different which bears out the conversation we had about reCAPTCHA broadly in our last call.  

I'm still overseas and using a computer with liited AT options so appreciate my tests are very limited, but if you'd like me to do more comprehensive test let me know and I'll see if I can get a few more things installed. 

Scott. 

Dr Scott Hollier 
Digital Access Specialist 
Mobile: +61 (0)430 351 909
Web: www.hollier.info
 
Technology for everyone
 
Looking to upskill your staff with digital access training? Fill the room for one flat fee. 
 
Keep up with digital access news by following @scotthollier on Twitter and subscribing to Scott's newsletter. 

-----Original Message-----
From: Janina Sajka <janina@rednote.net> 
Sent: Friday, 28 December 2018 7:04 AM
To: public-rqtf@w3.org
Subject: Testing reCAPTCHA

Colleagues:

As I work to finalize our note draft, I have learned Google provides a test site for demonstrating the "so-called no CAPTCHA reCAPTCHA. I thought I would share some of my results using different browsers on different OS. Should anyone wish to do some testing, I would be interested in your results by reply to this email.

The site is at:

http://www.google.com/recaptcha/api2/demo

Here's what I tried with this site:

1.)	On Apple Macintosh, V. 10.14 Mojave:

	Chrome just works by checking the "I am not a robot" box."

		Safara fails the checkbox and brings up a CAPTCHA. I
		take the audio challenge and am asked to type the words
		I hear. I purposefully mispell two of three words I hear
		and pass the challenge.

2.)	On a 64-bit Linux machine running on the 4.19.12 Arch kernel build with
GTK3 3.24, Firefox 64, and a recent development build of Orca:

	Checking the checkbox passes.

3.)	On Windows 10 with NVDA:

	Firefox 63.0.3 passes the checkbox text.

		Google Chrome passes the checkbox test

			Microsoft Edge fails the checkbox, and seems
			unable to bring up the Audio CAPTCHA option at
			all.

4.)	Chrome Canary on Android 8 passes the checkbox.

Google's source for these examples is hosted on github:

https://github.com/google/recaptcha

NOTE: The above results are, frankly, puzzling because they do not comport with the widely reported failure of the checkbox for users of screen readers in recent months. I'm still struggling to explain that disparity.

Also, we should probably note that the checkbox actually isn't a checkbox in classic HTML meaning of that term. Here's a CUNY article about what it is under the hood:

http://qnimate.com/how-does-googles-no-captcha-recaptcha-work/

Best,

Janina



-- 

Janina Sajka

Linux Foundation Fellow
Executive Chair, Accessibility Workgroup:	http://a11y.org

The World Wide Web Consortium (W3C), Web Accessibility Initiative (WAI)
Chair, Accessible Platform Architectures	http://www.w3.org/wai/apa

Received on Friday, 28 December 2018 08:29:31 UTC