Re: [mediacapture-screen-share] Allow screen-captured applications to self-declare a capture handle (#159)

To summarize some use cases and benefits:

### 1. Analytics
Capturing applications can gather statistics over what applications its users tend to capture. This can be used to improve service for the users by introducing collaborations. One such collaboration - enabled by this very feature - is described immediately below.

### 2. Cross-Tab Communication
The capturing application can more easily¹ know what it is capturing (assuming opt-in from the captured app). It can use this to establish (out-of-band) communication with the captured tab and send it messages through a shared back-end. For example, a VC application could detect that it's capturing a collaborating productivity suite, e.g. an app for displaying presentations. The captured presentations-app could declare its session ID as part of the capture handle. The capturing app, upon specific user interaction², could then send messages to a shared back-end, informing the captured application when the user wishes to flip to the previous/next slide, enter/exit presentation mode, etc. Contrast this with the otherwise awkward flow of forcing the user to switch to the presentation tab whenever they want to change slides.
(@jan-ivar, @aboba, wdyt?)

### 3. Conditional Tab-Focus Change
This relates to a different proposal I'll be making shortly. I will edit this comment to link to that use-case shortly.


---
1. "More easily" - This is not new, because magic-pixels, etc., already allow an application to signal its identity to a collaborating capturer. However, this proposal would make this more ergonomic.
2. The VC app, upon detecting which collaborating app it is capturing, can expose specific, relevant user controls. For example, if a video-streaming service is captured, expose buttons for previous/next video; if a productivity app is captured, next/previous slide/page/etc.

-- 
GitHub Notification of comment by eladalon1983
Please view or discuss this issue at https://github.com/w3c/mediacapture-screen-share/issues/159#issuecomment-818041490 using your GitHub account


-- 
Sent via github-notify-ml as configured in https://github.com/w3c/github-notify-ml-config

Received on Monday, 12 April 2021 18:41:18 UTC