Re: [mediacapture-screen-share] Exposing mouse events from captured surfaces (#259)

Looking quickly at the proposal, there might be some potential sync issues between video frames and the mouse events.
Hopefully, this should not be a very big issue. Was it discussed though?

An alternative is to attach the mouse information as metadata to VideoFrames directly.
It would be exposed to JS either via [VideoFrameCallbackMetadata](https://wicg.github.io/video-rvfc/#dictdef-videoframecallbackmetadata) or via [VideoFrameMetadata](https://www.w3.org/TR/webcodecs/#dictdef-videoframemetadata).

Has this option been investigated?

-- 
GitHub Notification of comment by youennf
Please view or discuss this issue at https://github.com/w3c/mediacapture-screen-share/issues/259#issuecomment-1545809315 using your GitHub account


-- 
Sent via github-notify-ml as configured in https://github.com/w3c/github-notify-ml-config

Received on Friday, 12 May 2023 14:09:19 UTC