Re: [media-and-entertainment] Media Containers API (#108)

Some brief thoughts on work since WebCodecs:
- We've had several partners express interest in containers, both for demuxing or muxing. They are often able to make mp4box.js work (or less frequently jswebm), but sometimes need a WASM ffmpeg for more format support. Linking them to the incomplete PR we have for that is often helpful: https://github.com/w3c/webcodecs/pull/549
- Mostly everyone we've encountered just needs basic muxing, demuxing with track selection and seeking. Though some would benefit if stuff like exif metadata could be surfaced.
- Those that do end up using mp4box.js, have made mistakes around extra data handling for aac, h264, h265 and how codec strings are specified within the container.
- I wrote a brief explainer on how we might leverage MediaRecorder at least for muxing, but it didn't get any traction (either internally or from other UAs): https://github.com/dalecurtis/mediarecorder-muxer/blob/main/explainer.md
- Similarly there may be some limited API we can conceive around using MediaSource for demuxing. MSE demuxers are less capable than what something like ffmpeg can do though, so this may not be better than mp4box.js

-- 
GitHub Notification of comment by dalecurtis
Please view or discuss this issue at https://github.com/w3c/media-and-entertainment/issues/108#issuecomment-2091148772 using your GitHub account


-- 
Sent via github-notify-ml as configured in https://github.com/w3c/github-notify-ml-config

Received on Thursday, 2 May 2024 17:41:14 UTC