Re: [webrtc-encoded-transform] Expose RTCEncoded*Frame interfaces in Worklets (#226)

If we want to do decoding in real-time threads, in the `AudioWorkletGlobalScope`, here are some rough steps:

- Adding a way to get the encoded audio packet from a `RTCEncodedAudioFrame`, without allocations, and in a real-time-safe manner
- Adding a sync decoding interface to Web Codecs, that doesn't use js objects (just buffer in, buffer out, no allocs, etc.), so it's real-time safe
- Exposing this to the `AudioWorkletGlobalScope`
- Adding some tranfering capabilities to Web Codec objects so that one could set-up a decoder outside the real-time thread, and send it over

-- 
GitHub Notification of comment by padenot
Please view or discuss this issue at https://github.com/w3c/webrtc-encoded-transform/issues/226#issuecomment-2090521024 using your GitHub account


-- 
Sent via github-notify-ml as configured in https://github.com/w3c/github-notify-ml-config

Received on Thursday, 2 May 2024 13:36:12 UTC