Re: Categorization of media a11y requirements

Hi, Frank and Silvia:

I actually suggest that you *not* call it TTXT because, ironically, TTXT is already in use as the name of another timed-text format:  http://gpac.sourceforge.net/doc_ttxt.php#ttxt .  Maybe call it TRACKDETAIL?

Geoff/NCAM



On 11/4/10 5:19 PM, "Silvia Pfeiffer" <silviapfeiffer1@gmail.com> wrote:

Maybe this classification is more useful in the Checklist [1] than the
one we have there currently for "types of technologies affected"?

I would, however, suggest calling the Text track format details TTEXT
and not TRACK, since track is now the keyword for the markup in HTML5.

[1] http://www.w3.org/WAI/PF/HTML/wiki/Media_Accessibility_Checklist

Cheers,
Silvia.


On Fri, Nov 5, 2010 at 3:55 AM, Frank Olivier
<Frank.Olivier@microsoft.com> wrote:
>
> Re http://www.w3.org/2010/11/04-html-wg-minutes.html
>
> Members of HTML WG and media a11y reviewed the http://www.w3.org/WAI/PF/HTML/wiki/Media_Accessibility_Requirements requirements
>
> We sorted the requirements into the following categories:
> *       UX: User agent user experience requirement
> *       SPECNEW: New requirements for the HTML5 specification
> *       SPECCED: Already in the HTML5 specification
> *       TRACK: Text track format detail - something that should be specced in the track format, not the HTML spec
> *       NO: Not an issue we will address in the W3C
>
>
> Of the 119 requirements in the document:
> SPECNEW 11 items (9% of total)
> SPECCED 21 (18%)
> TRACK           24 (20%)
> NO              4 (3%)
> UX              73 (61%)
>
> Detailed list:
> NO: (DV-9) Allow the author to use a codec which is optimized for voice only, rather than requiring the same codec as the original soundtrack.Does not seem like a UA issue:
> NO: (KA-3) The author would be able to choose any/all of the controls, skin them and position them. Needs discussion' kill
> NO: (KA-5) The scripted and native controls must go through the same platform-level accessibility framework (where it exists), so that a user presented with the scripted version is not shut out from some expected behavior.
> NO: (PP-1) This necessitates a clear and unambiguous declared format, so that existing authoring tools can be configured to export finished files in the required format.
> SPECCED, UX: (CA-2) Support the synchronisation of multitrack audio either within the same file or from separate files - preferably both.
> SPECCED: (API-1) The existence of alternative-content tracks for a media resource must be exposed to the user agent.
> SPECCED: (API-2) Since authors will need access to the alternative content tracks, the structure needs to be exposed to authors as well, which requires a dynamic interface.
> SPECCED: (API-3) Accessibility APIs need to gain access to alternative content tracks no matter whether those content tracks come from within a resource or are combined through markup on the page.
> SPECCED: (CA-1) Support clear audio as a separate, alternative audio track from other audio-based alternative media resources.
> SPECCED: (CC-22) Support captions that are provided inside media resources as tracks, or in external files.
> SPECCED: (CC-26) Support multiple tracks of foreign-language subtitles in different languages.
> SPECCED: (CC-27) Support live-captioning functionality. Addressed via API
> SPECCED: (CN-4) Support third-party provided structural navigation markup.
> SPECCED: (CNS-4) Producers and authors may optionally provide additional access options to identified structures, such as direct access to any node in a table of contents. [May be done with cue range]
> SPECCED: (DAC-4) Synchronized alternatives for time-based media (e.g., captions, descriptions, sign language) can be rendered at the same time as their associated audio tracks and visual tracks (UAAG 2.0 3.1.3).
> SPECCED: (DV-3) Support multiple description tracks (e.g., discrete tracks containing different levels of detail).
> SPECCED: (DV-4) Support recordings of real human speech as a track of the media resource, or as an external file.
> SPECCED: (KA-3) All functionality available to native controls must also be available to scripted controls.
> SPECCED: (PP-1) Support existing production practice for alternative content resources, in particular allow for the association of separate alternative content resources to media resources. Browsers cannot support all forms of time-stamp formats out there, just as they cannot support all forms of image formats (etc.).
> SPECCED: (PP-4) Typically, alternative content resources are created by different entities to the ones that create the media content. They may even be in different countries and not be allowed to re-publish the other one's content. It is important to be able to host these resources separately, associate them together through the Web page author, and eventually play them back synchronously to the user.
> SPECCED: (SL-4) Support multiple sign-language tracks in several sign languages.
> SPECCED: (T-1) Support the provisioning of a full text transcript for the media asset in a separate but linked resource. where the linkage is programmatically accessible to AT.
> SPECNEW, SPECCED: (SL-1) Support sign-language video either as a track as part of a media resource or as an external file.
> SPECNEW, SPECCED: (SL-2) Support the synchronized playback of the sign-language video with the media resource.
> SPECNEW, TRACK: (CC-5) Support positioning in all parts of the screen - either inside the media viewport but also possibly in a determined space next to the media viewport. This is particularly important when multiple captions are on screen at the same time and relate to different speakers, or when in-picture text is avoided.
> SPECNEW, TRACK: (CN-1) Provide a means to structure media resources so that users can navigate them by semantic content structure.
> SPECNEW, UX: (CC-25) Support edited and verbatim captions, if available.
> SPECNEW, UX: (DV-8) Allow the author to provide fade and pan controls to be accurately synchronized with the original soundtrack.
> SPECNEW: (CN-3) Support both global navigation by the larger structural elements of a media work, and also the most localized atomic structures of that work, even though authors may not have marked-up all levels of navigational granularity.
> SPECNEW: (CN-6) Support direct access to any structural element, possibly through URIs. [Media fragment-like issue]
> SPECNEW: (CNS-1) All identified structures, including ancillary content as defined in "Content Navigation" above, must be accessible with the use of "next" and "previous," as refined by the granularity control. [May be handled with cue ranges]
> SPECNEW: (DAC-2) The user has a global option to specify which types of alternative content by default and, in cases where the alternative content has different dimensions than the original content, how the layout/reflow of the document should be handled. (UAAG 2.0 3.1.2). [Probably minimal spec text required: Media queries would work nicely here; also UX issue (user sets media query to match)]
> SPECNEW: (DAC-5) Non-synchronized alternatives (e.g., short text alternatives, long descriptions) can be rendered as replacements for the original rendered content (UAAG 2.0 3.1.3).
> TRACK, UX: (CC-16) Use conventions that include inserting left-to-right and right-to-left segments within a vertical run (e.g. Tate-chu-yoko in Japanese), when rendered as text in a top-to-bottom oriented language.
> TRACK, UX: (CC-19) Present the full range of typographical glyphs, layout and punctuation marks normally associated with the natural language's print-writing system.
> TRACK, UX: (CC-21) Permit the distinction between different speakers.
> TRACK, UX: (ECC-2) Support hyperlinks and other activation mechanisms for supplementary data for (sections of) caption text.
> TRACK, UX: (ECC-3) Support text cues that may be longer than the time available until the next text cue and thus provide overlapping text cues.
> TRACK, UX: (ECC-4) It needs to be possible to define timed text cues that are allowed to overlap with each other in time and be present on screen at the same time
> TRACK: (CC-10) Render a background in a range of colors, supporting a full range of opacities.
> TRACK: (CC-11) Render text in a range of colors.
> TRACK: (CC-14) Allow the use of mixed display styles-- e.g., mixing paint-on captions with pop-on captions-- within a single caption cue or in the caption stream as a whole.
> TRACK: (CC-17.1) Represent content of different natural languages. In some cases the inclusion of a few foreign words form part of the original soundtrack, and thus need to be in the same caption resource.
> TRACK: (CC-18) Represent content of at least those specific natural languages that may be represented with [Unicode 3.2], including common typographical conventions of that language (e.g., through the use of furigana and other forms of ruby text).
> TRACK: (CC-2) Allow the author to specify erasures, i.e., times when no text is displayed on the screen (no text cues are active).
> TRACK: (CC-20) Permit in-line mark-up for foreign words or phrases.
> TRACK: (CC-3) Allow the author to assign timestamps so that one caption/subtitle follows another, with no perceivable gap in between.
> TRACK: (CC-4) Be available in a text encoding.
> TRACK: (CC-8) Allow the author to specify line breaks.
> TRACK: (CC-9) Permit a range of font faces and sizes.
> TRACK: (CN-2) The navigation track should provide for hierarchical structures with titles for the sections.
> TRACK: (DV-14) Support metadata, such as copyright information, usage rights, language, etc.
> TRACK: (ECC-1) Support metadata markup for (sections of) timed text cues.
> TRACK: (PP-2) Support the association of authoring and rights metadata with alternative content resources, including copyright and usage information. [Move to ATAG?]
> TRACK: (PP-3) Support the simple replacement of alternative content resources even after publishing.
> UX, SPECCED: (MD-5) If the user can modify the state or value of a piece of content through the user interface (e.g., by checking a box or editing a text area), the same degree of write access is available programmatically (UAAG 2.0 2.1.5).
> UX: (CA-3) Support separate volume control of the different audio tracks.
> UX: (CC-1) Render text in a time-synchronized manner, using the media resource as the timebase master.
> UX: (CC-12) Enable rendering of text with a thicker outline or a drop shadow to allow for better contrast with the background.
> UX: (CC-13) Where a background is used, it is preferable to keep the caption background visible even in times where no text is displayed, such that it minimises distraction. However, where captions are infrequent the background should be allowed to disappear to enable the user to see as much of the underlying video as possible.
> UX: (CC-15) Support positioning such that the lowest line of captions appears at least 1/12 of the total screen height above the bottom of the screen, when rendered as text in a right-to-left or left-to-right language
> UX: (CC-17.2) Also allow for separate caption files for different languages and on-the-fly switching between them. This is also a requirement for subtitles.
> UX: (CC-23) Ascertain that captions are displayed in sync with the media resource.
> UX: (CC-24) Support user activation/deactivation of caption tracks.
> UX: (CC-6) Support the display of multiple regions of text simultaneously.
> UX: (CC-7) Display multiple rows of text when rendered as text in a right-to-left or left-to-right language.
> UX: (CN-10) Support that in bilingual texts both the original and translated texts can appear on screen, with both the original and translated text highlighted, line by line, in sync with the audio narration.
> UX: (CN-5) Keep all content representations in sync, so that moving to any particular structural element in media content also moves to the corresponding point in all provided alternate media representations (captions, described video, transcripts, etc) associated with that work.
> UX: (CN-7) Support pausing primary content traversal to provide access to such ancillary content in line.
> UX: (CN-8) Support skipping of ancillary content in order to not interrupt content flow.
> UX: (CN-9) Support access to each ancillary content item, including with "next" and "previous" controls, apart from accessing the primary content of the title.
> UX: (CNS-2) Users must be able to discover, skip, play-in-line, or directly access ancillary content structures.
> UX: (CNS-3) Users need to be able to access the granularity control using any input mode, e.g. keyboard, speech, pointer, etc.
> UX: (DAC-1) The user has the ability to have indicators rendered along with rendered elements that have alternative content (e.g., visual icons rendered in proximity of content which has short text alternatives, long descriptions, or captions). In cases where the alternative content has different dimensions than the original content, the user has the option to specify how the layout/reflow of the document should be handled. (UAAG 2.0 3.1.1).
> UX: (DAC-3) The user can browse the alternatives and switch between them.
> UX: (DAC-6) Provide the user with the global option to configure a cascade of types of alternatives to render by default, in case a preferred alternative content type is unavailable.
> UX: (DAC-7) During time-based media playback, the user can determine which tracks are available and select or deselect tracks. These selections may override global default settings for captions, descriptions, etc. (UAAG 2.0 4.9.8)
> UX: (DAC-8) Provide the user with the option to load time-based media content such that the first frame is displayed (if video), but the content is not played until explicit user request.
> UX: (DV-1) Provide an indication that descriptions are available, and are active/non-active.
> UX: (DV-10) Allow the user to select from among different languages of descriptions, if available, even if they are different from the language of the main soundtrack.
> UX: (DV-11) Support the simultaneous playback of both the described and non-described audio tracks so that one may be directed at separate outputs (e.g., a speaker and headphones).
> UX: (DV-12) Provide a means to prevent descriptions from carrying over from one program or channel when the user switches to a different program or channel.
> UX: (DV-13) Allow the user to relocate the description track within the audio field, with the user setting overriding the author setting. The setting should be re-adjustable as the media plays.
> UX: (DV-2) Render descriptions in a time-synchronized manner, using the media resource as the timebase master.
> UX: (DV-6) Allow the user to independently adjust the volumes of the audio description and original soundtracks, with the user's settings overriding the author's.
> UX: (DV-7) Permit smooth changes in volume rather than stepped changes. The degree and speed of volume change should be under provider control.
> UX: (ECC-5) Allow users to define the reading speed and thus define how long each text cue requires, and whether media playback needs to pause sometimes to let them catch up on their reading.
> UX: (EVD-1) Support detailed user control as specified in (TVD-4) for extended video descriptions.
> UX: (EVD-2) Support automatically pausing the video and main audio tracks in order to play a lengthy description.
> UX: (EVD-3) Support resuming playback of video and main audio tracks when the description is finished.
> UX: (KA-1) Support operation of all functionality via the keyboard on systems where a keyboard is (or can be) present (Needs better text), and where a unique focus object is employed. This does not forbid and should not discourage providing mouse input or other input methods in addition to keyboard operation. (UAAG 2.0 4.1.1)
> UX: (KA-2) Support a rich set of native controls for media operation, including but not limited to play, pause, stop, jump to beginning, jump to end, scale player size
> UX: (KA-4) It must always be possible to enable native controls regardless of the author preference to guarantee that such functionality is available
> UX: (MD-2) Ensure accessibility of all user-interface components including the user interface, rendered content, and alternative content; make available the name, role, state, value, and description via a platform-accessibility architecture. (UAAG 2.0 2.1.2)
> UX: (MD-3) If a feature is not supported by the accessibility architecture(s), provide an equivalent feature that does support the accessibility architecture(s). Document the equivalent feature in the conformance claim. (UAAG 2.0 2.1.3)
> UX: (MD-4) If the user agent implements one or more DOMs, they must be made programmatically available to assistive technologies. (UAAG 2.0 2.1.4) This assumes the video element will write to the DOM.
> UX: (MD-6) If any of the following properties are supported by the accessibility-platform architecture, make the properties available to the accessibility-platform architecture
> UX: (MD-7) Ensure that programmatic exchanges between APIs proceed at a rate such that users do not perceive a delay. (UAAG 2.0 2.1.7).
> UX: (SL-3) Support the display of sign-language video either as picture-in-picture or alpha-blended overlay, as parallel video, or as the main video with the original video as picture-in-picture or alpha-blended overlay.
> UX: (SL-5) Support the interactive activation/deactivation of a sign-language track by the user.
> UX: (T-2) Support the provisioning of both scrolling and static display of a full text transcript with the media resource, e.g. in a area next to the video or underneath the video, which is also AT accessible.
> UX: (TSM-1) The user can adjust the playback rate of the time-based media tracks to between 50% and 250% of real time.
> UX: (TSM-2) Speech whose playback rate has been adjusted by the user maintains pitch in order to limit degradation of the speech quality.
> UX: (TSM-3) All provided alternative media tracks remain synchronized across this required range of playback rates.
> UX: (TSM-4) The user agent provides a function that resets the playback rate to normal (100%).
> UX: (TSM-5) The user can stop, pause, and resume rendered audio and animation content (including video and animated images) that last three or more seconds at their default playback rate.
> UX: (TVD-1) Support presentation of text video descriptions through a screen reader or braille device, with playback speed control and voice control and synchronisation points with the video.
> UX: (TVD-2) TVDs need to be provided in a format that contains the following information: (A) start time, text per description cue (the duration is determined dynamically, though an end time could provide a cut point)
> UX: (TVD-3) Where possible, provide a text or separate audio track privately to those that need it in a mixed-viewing situation, e.g., through headphones.
> UX: (TVD-4) Where possible, provide options for authors and users to deal with the overflow case: continue reading, stop reading, and pause the video. (One solution from a user's point of view may be to pause the video and finish reading the TVD, for example.) User preference should override authored option.
> UX: (TVD-5) Support the control over speech-synthesis playback speed, volume and voice, and provide synchronisation points with the video.
> UX: (VP-1) It must be possible to deal with three different cases for the relation between the viewport size, the position of media and of alternative content:
> UX: (VP-2) The user can change the following characteristics of visually rendered text content, overriding those specified by the author or user-agent defaults
> UX: (VP-3) Provide the user with the ability to adjust the size of the time-based media up to the full height or width of the containing viewport, with the ability to preserve aspect ratio and to adjust the size of the playback viewport to avoid cropping, within the scaling limitations imposed by the media itself.
> UX: (VP-4) Provide the user with the ability to control the contrast and brightness of the content within the playback viewport.
> UX: (VP-5) Captions and subtitles traditionally occupy the lower third of the video, where also controls are also usually rendered.
> UX: [In that this is a user agent issue] (MD-1) Support a platform-accessibility architecture relevant to the operating environment. (UAAG 2.0 2.1.1)
> UX: (CA-4) Support pre-emphasis filters, pitch-shifting, and other audio-processing algorithms.
> UX: (DV-5) Allow the author to independently adjust the volumes of the audio description and original soundtracks. [Actually a requirement on the media format]
>
>
>
>