Re: [mediacapture-screen-share-extensions] Auto-pause for Captured Surface Switching (2nd edition) (#15)

> Wouldn't it be convenient for users to see a preview of what they have picked to answer the "are you sure?" question in an informed manner?

The idea is that you'd get all tracks, video and audio, auto-paused, and then selectively unpause just the track used for the preview.
(See my previous comment for what benefits this approach yields.)

> Exposing an API to allow CaptureController to mute all tracks it is related to is orthogonal to the discussion we have on the API design.

Sorry, that's not my proposal. I am not (currently) proposing a knob that the app can manipulate. Rather, I am saying:
- We can have an unlimited number of events associated with source-changes; that's not the crux of the issue.
- At least one of those events should be associated with auto-pause.
- The MVP is to have an event on `CaptureController` be auto-pausing, and the rest to be informative-only.

> This pattern is being used by real web sites using data channel and WebCodecs for video conferencing.

Could you name a few such sites? I'd love to get their feedback.

> Since we want to encourage processing in workers, it is important to have API working nicely there too.

Definitely. But future use-cases can be addressed by future extensions, while existing use-cases require more immediate solutions.

> Event ordering is deterministic, 2 can never happen before 1.
> The question about clones event order is interesting, I'll file an issue to see what we should do.

Note that I did NOT place `x2` before `x1`. Rather, I placed `x2` before `y1`.
Or are you sure that the ordering between `x2` and `y1` (two different tracks) is deterministic **even if one is in a worker**? (Maybe it is...? I am looking forward to learn from you here.)

> Within sourcechange callback, the surface type exposed via track.getSettings() would be the old surface type. This is a potential footgun for web apps.

Yes. Good point.
Maybe it's a `"sourcechangestarted"` event?

-- 
GitHub Notification of comment by eladalon1983
Please view or discuss this issue at https://github.com/w3c/mediacapture-screen-share-extensions/issues/15#issuecomment-2465096647 using your GitHub account


-- 
Sent via github-notify-ml as configured in https://github.com/w3c/github-notify-ml-config

Received on Friday, 8 November 2024 15:52:30 UTC