RE: CfC: Should WebCodecs be exposed in Window environments?

I support exposing VideoEncoder, AudioEncoder, VideoDecoder, and AudioDecoder in Window contexts at this time.

There is an issue with finding the holy grail use-case which needs WebCodecs to be exposed to Window, but WebCodecs is unlikely to be used in isolation. It will be used with other APIs like WebUSB, Web Audio, and other APIs that are not exposed to Workers. For worker implementation, the code becomes a tad more complicated. This may hurt the adoption of WebCodecs.
The average latency and time to first frame are longer for Workers compared to Windows. In our PoC, involving WebCodecs on various Intel platforms, we gathered a few data points with respect to the window vs worker debate. While it may take me some time to make the data publicly available (without NDA), long story short, exposing to window was better for performance in most parameters.

-Riju (on behalf of Intel)

Received on Wednesday, 30 June 2021 17:38:23 UTC