W3C home > Mailing lists > Public > public-webrtc-logs@w3.org > October 2022

[mediacapture-transform] Applicability of VideoTrackGenerator? (#86)

From: Bernard Aboba via GitHub <sysbot+gh@w3.org>
Date: Tue, 04 Oct 2022 01:28:08 +0000
To: public-webrtc-logs@w3.org
Message-ID: <issues.opened-1395543019-1664846886-sysbot+gh@w3.org>
aboba has just created a new issue for https://github.com/w3c/mediacapture-transform:

== Applicability of VideoTrackGenerator? ==
`VideoTrackGenerator` (the successor to MSTG) converts a stream of `VideoFrame`s to a `MediaStreamTrack`. 

`VideoFrame`s may have been "transformed" by a process that generates jitter. For example, they may have been processed by a Machine Learning algorithm that takes a varying amount of time, or they may have been produced by a decoder that received encoded chunks over a network with varying delays. 

Currently, the specification does not talk about what an application can expect of `VideoTrackGenerator` in terms of playout delay and smoothness.  Does `VideoTrackGenerator` assume that there is a jitter buffer upstream that generates `VideoFrames` with constant delays? Or does `VideoTrackGenerator` adjust the playout delay in response to the jitter it experiences in the `VideoFrames` it receives? 

Please view or discuss this issue at https://github.com/w3c/mediacapture-transform/issues/86 using your GitHub account

Sent via github-notify-ml as configured in https://github.com/w3c/github-notify-ml-config
Received on Tuesday, 4 October 2022 01:28:10 UTC

This archive was generated by hypermail 2.4.0 : Saturday, 6 May 2023 21:19:59 UTC