Re: [mst-content-hint] Differentiate between speech for human and machine consumption (#39)

Differentiating between speech for human and machine consumption could be considered moot if we still cannot capture speech output from `window.speechSynthesis.speak()`. 

Consider an individual with speech impairment that uses Onboard http://manpages.ubuntu.com/manpages/bionic/man1/onboard.1.html to write and execute `speak()`, currently there is no specified way to capture that speech output.

https://stackoverflow.com/questions/45003548/how-to-capture-generated-audio-from-window-speechsynthesis-speak-call#comment82141734_45003549

> Hi @guest271314, isn't this recording the user's mic - and not the actual synthesized speech? Is that what you intended? – Ronen Rabinovici Dec 1 '17 at 11:26

https://stackoverflow.com/questions/45003548/how-to-capture-generated-audio-from-window-speechsynthesis-speak-call#comment90686857_45003549
> @guest271314, I used the code at plnkr.co/edit/PmpCSJ9GtVCXDhnOqn3D?p=preview but it still recorded from my microphone. – Jeff Baker Aug 15 '18 at 22:54

https://stackoverflow.com/questions/45003548/how-to-capture-generated-audio-from-window-speechsynthesis-speak-call#comment96709886_45003549
> This doesn't record speaker output. I tried capturing tab audio using chrome extension but still failed. It seems speechSynthesis is not using HTMLmediaElement for audio hence we shall not be able to capture at tab/browser level. The audiooutput mentioned above returns "default " for both mic and speaker since there is no way to set "kind" field while setting constraints in getUsermedia, it always captures "mic". Let me know in case more details required. – Gaurav Srivastava Mar 4 '19 at 1:13 

Support SpeechSynthesis *to* a MediaStreamTrack #69  https://github.com/WICG/speech-api/issues/69

Extending Media Capture and Streams with MediaStreamTrack kind TTS #654 
 https://github.com/w3c/mediacapture-main/issues/654

Support capturing audio output from sound card https://github.com/w3c/mediacapture-main/issues/629

Will continue to request  this feature, though for reasons beyond this users' control: fraudulent rationale and actions of WICG/W3C, as evidenced by the prima facie absurdity and hypocrisy (after following their suggestions and instructions for joining the organizations) of the 1,000 year ban imposed as a reprisal by the organization from contributing to projects under the umbrella of that organization for not fitting into some predefined neat box
![Screenshot_2020-04-15_14-26-11](https://user-images.githubusercontent.com/4174848/79349133-6dbf6a00-7f25-11ea-9774-2717a763d284.png)

Perhaps your advocacy for TTS/SST technologies being implemented via `MediaStreamTrack` can help nudge that gap in coverage along to specification and impementation. 

-- 
GitHub Notification of comment by guest271314
Please view or discuss this issue at https://github.com/w3c/mst-content-hint/issues/39#issuecomment-614078369 using your GitHub account

Received on Wednesday, 15 April 2020 14:37:05 UTC