RE: text track associations

Yes they will share a timeline once they are glued together, that's only one of the issues here. They will also need to share a display space. I want to see how this example would be marked up using the 'controller' model. Do I put the director captions inside the <audio> that is the director commentary? If so, how do they show up in the other video space. If not, what information does the UA use to associate the second caption track with the remote audio element?

For example:
<video id=vid mediagroup=set src=mainvideo.vid >
    <track kind=captions id=main>
</video>

<audio mediagroup=set src=director.aud >
    <track kind=captions id=director>
</audio>

how do captions.director end up getting displayed in video.vid? 

Alternately if I do:
<video id=vid mediagroup=set src=mainvideo.vid >
    <track kind=captions id=main>
    <track kind=captions id=director>
</video>

<audio mediagroup=set src=director.aud >
</audio>

Then how do I prevent the director captions being offered as an option for the ordinary video until the second audio is selected?

-----Original Message-----
From: David Singer [mailto:singer@apple.com] 
Sent: 08 April 2011 19:06
To: Sean Hayes
Cc: Silvia Pfeiffer; Mark Watson; Eric Carlson; Ian Hickson; public-html-a11y@w3.org
Subject: Re: text track associations


On Apr 8, 2011, at 2:16 , Sean Hayes wrote:

> In a multitrack API, since caption tracks are essentially the audio for Deaf and HoH use, we will need some way for these to follow the selected audio asset.
> 
> If I have a presentation, with the option of switching to different a different audio resource (e.g director commentary which is longer, starts before and ends after the main movie). The captions for it need to be timed to the commentary audio, and so if it's in a markup element, live in that element. If the user has captions turned on and wants the commentary audio, then the captions for the commentary soundtrack will need to replace the captions for the original audio track, and render into the rectangle allotted for the main video.
> 
> I'm not seeing how I would create this. 


I think that the optional additions and alternatives that are logically part of one resource need to share a timeline.  We mustn't forget we're in a web environment where we can use web markup to offer choices to the user.  It's common and expected that there is a 'top-level choice' -- do you want
a) the plain movie
b) the movie with director's commentary in parallel and inserted (longer)
c) the movie with audio description of video (longer, includes places where the video is paused to give time for the description)
...

I think we'll go crazy if the time-map of the optional/alternative parts is not common with the base resource.

David Singer
Multimedia and Software Standards, Apple Inc.

Received on Friday, 8 April 2011 19:01:34 UTC