Re: [mediacapture-screen-share] Identification of Captured Application By Capturer (#166)

> Use cases
> 1. Establishing Cross-Tab Communication
> ... display controls for the user that will allow the user to flip through slides on the captured ... slides deck

> 3. Conditional Tab-Focus Change
> ... a capturing application [decides] whether ... to hand off tab-focus to the captured application, depending ...

These two sound like the actual use case is:

  1. Remote-control a locally captured presentation webpage in a meeting

I think it's important to look at the original use case, to not bake in assumptions or implementation decisions already taken.

With that in hand, I'd take a step back and ask whether *getDisplayMedia* or  *getViewportMedia*  is the right tool.

Attempting to build this new integrated experience over *getDisplayMedia* seems:
 1. Unsafe: capture resumes past navigation, an oversharing surprise (because we're capturing the tab container)
 2. Unexpected: action-at-a-distance magic _("what have I given permission to? I thought this was a read-only feature?")_
 3. Inconsistent: Works one way for some tabs and another for others.
 4. Poor user experience: Users may not choose the right tab.
 5. Limited: any further integration with the target hits a wall _(how do I make it bigger/smaller? interact with elements?)_
 5. Stagnant: apps settling in a house of straw, not bricks. HTML capture remains as dangerous as ever

Of course, integrating this with *getViewportMedia* is not without challenges either, but seems more future proof (none of the above problems). Challenges that remain would be:
 - Could tabs be signaled to start capture in the background?
 - How'd users choose what to present? In-content pickers? If so, how could we open it up beyond ACME-only choices?
 - Do we need to programmatically move between tabs? Is that a good idea?

I think there's a lot to be worked out here to be able to support this use case. I think we should do that before we attempt to standardize pieces of the puzzle.

-- 
GitHub Notification of comment by jan-ivar
Please view or discuss this issue at https://github.com/w3c/mediacapture-screen-share/issues/166#issuecomment-820723266 using your GitHub account


-- 
Sent via github-notify-ml as configured in https://github.com/w3c/github-notify-ml-config

Received on Thursday, 15 April 2021 20:52:54 UTC