RE: text track associations

If markup for linked audio can't have its captions associated in markup as simply as linking the audio, then the solution is IMO broken and unacceptable. There really aren't many scenarios for linked audio where authors don't need to be able to say, 'these captions go with that audio'. If this isn't built in, it's basically not going to get done; and I think we should actually abandon the idea of linking media resources in markup and have the author do it all in script.

-----Original Message-----
From: Silvia Pfeiffer [mailto:silviapfeiffer1@gmail.com] 
Sent: 09 April 2011 11:22
To: Sean Hayes
Cc: David Singer; Mark Watson; Eric Carlson; Ian Hickson; public-html-a11y@w3.org
Subject: Re: text track associations

On Sat, Apr 9, 2011 at 5:01 AM, Sean Hayes <Sean.Hayes@microsoft.com> wrote:
> Yes they will share a timeline once they are glued together, that's only one of the issues here. They will also need to share a display space. I want to see how this example would be marked up using the 'controller' model. Do I put the director captions inside the <audio> that is the director commentary? If so, how do they show up in the other video space. If not, what information does the UA use to associate the second caption track with the remote audio element?
>
> For example:
> <video id=vid mediagroup=set src=mainvideo.vid >
>    <track kind=captions id=main>
> </video>
>
> <audio mediagroup=set src=director.aud >
>    <track kind=captions id=director>
> </audio>
>
> how do captions.director end up getting displayed in video.vid?
>

As it stands right now, in this example, the captions in the audio
track are not displayed, so have to be mapped onto the screen through
the JavaScript API. So, you can create a display area that matches
where you want to place them and you can make it replace the main
captions. This is acceptable for complex situation, IMHO.

However, we have a similar issue with captions for audio description
tracks, which should probably be more commonly displayed as an
alternative or addition to the normal captions. I'd probably encourage
the Web author to add that in another track with the full transcript
of both the captions and audio descriptions as you did in the example
below:



> Alternately if I do:
> <video id=vid mediagroup=set src=mainvideo.vid >
>    <track kind=captions id=main>
>    <track kind=captions id=director>
> </video>
>
> <audio mediagroup=set src=director.aud >
> </audio>
>
> Then how do I prevent the director captions being offered as an option for the ordinary video until the second audio is selected?

In the case of the director's track, I'd probably prefer the above
markup. For audio descriptions probably this one and then it's fine
when both the captions and audio descriptions are displayed because
they would occupy different times anyway.


Cheers,
Silvia.

Received on Saturday, 9 April 2011 14:41:59 UTC