W3C home > Mailing lists > Public > public-wai-evaltf@w3.org > April 2012

AW: Using AT for evaluation

From: Kerstin Probiesch <k.probiesch@googlemail.com>
Date: Mon, 2 Apr 2012 16:51:25 +0200
To: "'Denis Boudreau'" <dboudreau@accessibiliteweb.com>, "'RichardWarren'" <richard.warren@userite.com>
Cc: "'Eval TF'" <public-wai-evaltf@w3.org>
Message-ID: <4f79bcc4.2266b40a.4c57.ffffef47@mx.google.com>
Hi Richard, Denis, all,

I also think that test with "real" (at least screen reader) users are
important and that we should strongly recommend it but leave it optional. As
I remember the discussion on our last telco there are two aspects:

- testing with AT and
- accessibility supported

I think we have an intersection but also other aspects like: are
technologies like PDF and Flash accessibility supported? Depending upon the
answer it will have probably different consequences for our methodology.
Also different use cases like internet and intranet (especially when it
comes to scripting for JAWS or other screen readers in closed environments)
might have an impact. I'm thinking about if we could find for the tests of
intranets something better than just "optional" without reducing the
audience of our methodology in whole.



Von: Denis Boudreau [mailto:dboudreau@accessibiliteweb.com] 
Gesendet: Montag, 2. April 2012 15:40
An: RichardWarren
Cc: Eval TF
Betreff: Re: Using AT for evaluation

Hi Richard,

I would also like to weigh in with Richard here. All too often, screen
reader testing is considered a luxury that can be done without. I am one of
those who think that an evaluation cannot be considered complete unless some
screen reader testing has been conducted - and ideally, not only by a
developer, but really by a "real" end user with a visual impairment, using
the assistive technology regularly. The same could be said of other end user
using other tools for other disabilities or limitations, but at the very
least, screen readers.

There are always things that are brought up with AT testing that cannot be
flagged using only a checklist. Some of the things that come to mind are
links used for buttons that really should be coded as <button>, an
overwhelming number of heading elements in a page (big menus and fat footers
anyone?) or quite obviously, any script that opens up or reveals content in
a page. I recently had big surprises simply with phone number formats and
how screen readers read them. That was another real eye opener (no pun

This is why I tend to follow this pattern personally:

* testing the web page with a screen reader
* using an automatic checker for basic problems
* running manual testing to complete the audit

And whenever I am being offered the budget to do so, calling in a visually
impaired friend or two who can push those tests much further that my sighted
self can push them.


On 2012-03-29, at 6:48 PM, RichardWarren wrote:

First – sorry I missed the last half of the teleconference – system crash.
I wish to add to the discussion on using AT in evaluation. I believe it is
important to use a screen reader at the very least before completing an
evaluation. We do the normal stuff first (it is not fair to ask a blind user
to struggle if we already know that the site is impossible for them). But as
soon as we are happy that a site is reasonably good we always ask someone to
check with their screen reader. Most times their comments re-inforce what we
have found (often with better phrasing <G>). But just occasionally they find
something that our other systems do not pick up. For example the word
“accesskeys” sound completely Russian unless it is written “access keys”, or
I strongly believe that the audio output needs to be checked properly. If
you look at our outline procedure sent to this list on 26 Feb you will see
that we find someone who is new to the site to use a screen reader. This
approach gives us a high level of confidence in our final evaluation.
Technical Manager
Website Auditing Limited
Received on Monday, 2 April 2012 14:51:21 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 6 January 2015 20:40:20 UTC