[media-source] Support timed text in MSE (#358)

nigelmegitt has just created a new issue for https://github.com/w3c/media-source:

== Support timed text in MSE ==
As discussed at TPAC 2024-09-26 (please add minutes link when minutes have been prepared), add text track support to MSE.

Main use case is to simplify player code by allowing the same buffer pipeline management to be used for text tracks as for audio and video.

Suggestion to allow page code to pull the text content _out_ of the buffer prior to presentation, so that different formats can be handled.

From the discussion there were multiple other concerns related to this, that would need to be addressed by specification changes, including:
* Handling in-band subtitles and captions
* Understanding/expressing the active time interval for a non-wrapped plain text cue sample, e.g. plain text VTT. May need an explicit data structure or other API when pushing those samples into the MSE buffer
* Defining the model for handling changes in available text tracks, e.g. when ads are inserted, that have differing numbers of text tracks from the main programme
* Defining the player behaviour if the text track buffer runs out of content, but the audio and video buggers are adequately populated

Please view or discuss this issue at https://github.com/w3c/media-source/issues/358 using your GitHub account


-- 
Sent via github-notify-ml as configured in https://github.com/w3c/github-notify-ml-config

Received on Friday, 27 September 2024 00:27:32 UTC