Re: [media-and-entertainment] Frame accurate seeking of HTML5 MediaElement

One detail for such a document (I'm not volunteering to write) is video frame reordering. Widely deployed video codecs such as AVC reorder and often offset the presentation time of pictures relative to their order and timing in the compressed bitstream. For instance, frames 1, 2, 3, 4 in the compressed stream might be displayed in order e.g. 2, 1, 4, 3 and presentation time can be delayed several frames. Frame rate changes are not unusual in adaptively streamed video. Operations such as seeking, editing, and splicing of the compressed stream, e.g. in an MSE buffer, do not happen at the presentation times often assumed. Audio, TTML, HTML, events, etc. must take presentation reordering and delay into account for frame accurate synchronization at some "composition point" in the media pipeline. 

-- 
GitHub Notification of comment by KilroyHughes
Please view or discuss this issue at https://github.com/w3c/media-and-entertainment/issues/4#issuecomment-406536137 using your GitHub account

Received on Friday, 20 July 2018 08:58:58 UTC