RE: An Evaluation Question for all you experts

Hi again Shadi

I just finished going through your response links. I am of the opinion that we need something more for evaluators, but perhaps our document will help with that.

The quick reference is useful, but can be cumbersome.  For instance, if you want to check such an issue, you go first to the How to Meet : http://www.w3.org/WAI/WCAG20/quickref/Overview.php and have to go through the points until you find one that you think most closely describes your issue, then you have to look at the Sufficient Techniques, Advisory Techniques and Failures.  Sometimes, even then, an evaluator can be unsure whether such an item would pass as it is not always described exactly there.  This present issue on keyboard traps is such a point.

I put an item on the WCAG working group mailing list asking if a search feature was being contemplated.  The answer was, not at this time.  It would be great to be able to type in something in a search feature e.g. 'keyboard trap' and all of the guidelines, sufficient techniques etc. were to be listed.  Wouldn't it make the documents much easier to use?  The easier they are to use, the more people will use them - IMHO:)

Also, regarding one of your other comments.  I really think that new evaluators need to be told that a particular piece of code can violate a number of guidelines, just as a piece of code can cause numerous html validation errors.  While it makes a score look rather scary, it can often be fixed quite quickly when that one error has had a cascading error effect.

I think a "How to evaluate to WCAG 2.0"  - perhaps including my ideal search feature described above, would be really useful and would go well with our evaluation methodology and may also cover some of the points Detlev made earlier regarding whether we looked at how to evaluate individual criteria in our methodology.


Regards

Vivienne L. Conway, B.IT(Hons)
PhD Candidate & Sessional Lecturer, Edith Cowan University, Perth, W.A.
Director, Web Key IT Pty Ltd.
v.conway@ecu.edu.au
v.conway@webkeyit.com
Mob: 0415 383 673

This email is confidential and intended only for the use of the individual or entity named above. If you are not the intended recipient, you are notified that any dissemination, distribution or copying of this email is strictly prohibited. If you have received this email in error, please notify me immediately by return email or telephone and destroy the original message.
________________________________________
From: Shadi Abou-Zahra [shadi@w3.org]
Sent: Tuesday, 8 November 2011 6:00 PM
To: Vivienne CONWAY
Cc: Eval TF
Subject: Re: An Evaluation Question for all you experts

Hi Vivienne,

I have not actually looked at the website but from your description it
sounds to me that other Success Criteria than SC 2.1.2 may be relevant:
  - SC 1.1.1 for the text alternatives on the buttons
  - SC 2.4.4 and SC 2.4.9 for the link text (purpose)
  - SC 3.2.2 for changing the context without warning

A discussion of this is probably better on the WAI Interest Group (IG)
mailing list, which I hope everyone in this list is tracking too:
  - <http://www.w3.org/WAI/IG/>

Having said that, I guess some key take aways for this group include:
  - evaluators need better guidance on the Techniques level
  - one issue often maps to more than one Success Criterion

We need to be aware of that, in particular the second point which will
impact how we aggregate issues and score the websites. Is it a bigger
issue because it maps to more than one criterion and thus probably
impacts more people, or is that an artifact of how WCAG is structured?

Some of this may be partially answered through the RDWG Symposium:
  - <http://www.w3.org/WAI/RD/2011/metrics/>

The first point may indicate that a "How to Evaluate WCAG 2.0" rather
than "How to Meet WCAG 2.0" quick reference guide is needed:
  - <http://www.w3.org/WAI/WCAG20/quickref/>

We will need a lot more discussion about how this guide is to look like
but it is one of the planned activities:
  - <http://www.w3.org/WAI/ER/2011/eval/#supporting>

Are there other particular issues that you wanted to raise?

Sidenote: this seems related to a previous thread from Detlev Fischer:
  - <http://lists.w3.org/Archives/Public/public-wai-evaltf/2011Sep/0101>

Best,
   Shadi


On 8.11.2011 03:54, Vivienne CONWAY wrote:
> Hi all
>
> I have been having an interesting discussion with a fellow evaluator on what consitutes a failure of 2.1.2. (Keyboard Trap). http://www.w3.org/TR/UNDERSTANDING-WCAG20/keyboard-operation-trapping.html#keybrd-interfacedef
>
> If you have time, please have a look at the following website:
> http://jobsearch.gov.au/default.aspx
>
> If you navigate via the keyboard to the large box on the right hand side with the eight numbers (which have such lovely link names as 1-link, 2-link), you will see that you can click on the box and it takes you - with no warning, - to a new window.  The person using a screen reader would not know they have entered a new window unless they hear and notice the new URL, but that's not what I'm wondering about.  The only way I can see to get out is to exit the window via the Alt-F, exit option to close the window, at which time you go back to the starting point.  My question is, does this constitute a keyboard trap?  For example, the user doesn't know they are in a new window, so would not know to exit in the above way.
>
> This is a typical question someone evaluating a website would come across, so I thought you might find it useful to discuss it and give me your learned opinions.
>
> Happy analyzing
>
> Vivienne
>
>
>
>
> Regards
>
> Vivienne L. Conway, B.IT(Hons)
> PhD Candidate&  Sessional Lecturer, Edith Cowan University, Perth, W.A.
> Director, Web Key IT Pty Ltd.
> v.conway@ecu.edu.au
> v.conway@webkeyit.com
> Mob: 0415 383 673
>
> This email is confidential and intended only for the use of the individual or entity named above. If you are not the intended recipient, you are notified that any dissemination, distribution or copying of this email is strictly prohibited. If you have received this email in error, please notify me immediately by return email or telephone and destroy the original message.
> ________________________________________
> From: Shadi Abou-Zahra [shadi@w3.org]
> Sent: Friday, 4 November 2011 4:27 AM
> To: Eval TF
> Subject: Minutes for Teleconference on 3 November 2011
>
> Eval TF,
>
> Please find the minutes for the teleconference on 3 November 2011:
>    -<http://www.w3.org/2011/11/03-eval-minutes.html>
>
> Next meeting: Thursday 10 November 2011
>
>
> Regards,
>     Shadi
>
> --
> Shadi Abou-Zahra - http://www.w3.org/People/shadi/
> Activity Lead, W3C/WAI International Program Office
> Evaluation and Repair Tools Working Group (ERT WG)
> Research and Development Working Group (RDWG)
>
> This e-mail is confidential. If you are not the intended recipient you must not disclose or use the information contained within. If you have received it in error please return it to the sender via reply e-mail and delete any record of it from your system. The information contained within is not the opinion of Edith Cowan University in general and the University accepts no liability for the accuracy of the information provided.
>
> CRICOS IPC 00279B
>

--
Shadi Abou-Zahra - http://www.w3.org/People/shadi/
Activity Lead, W3C/WAI International Program Office
Evaluation and Repair Tools Working Group (ERT WG)
Research and Development Working Group (RDWG)

This e-mail is confidential. If you are not the intended recipient you must not disclose or use the information contained within. If you have received it in error please return it to the sender via reply e-mail and delete any record of it from your system. The information contained within is not the opinion of Edith Cowan University in general and the University accepts no liability for the accuracy of the information provided.

CRICOS IPC 00279B

Received on Wednesday, 9 November 2011 03:57:16 UTC