W3C home > Mailing lists > Public > public-webrtc@w3.org > September 2018

WebRTC and Real-time Translation

From: Adam Sobieski <adamsobieski@hotmail.com>
Date: Fri, 21 Sep 2018 12:59:04 +0000
To: "public-webrtc@w3.org" <public-webrtc@w3.org>
Message-ID: <CY4PR0101MB3095A38735A4CD74A53101BDC5120@CY4PR0101MB3095.prod.exchangelabs.com>
Greetings. I opened an issue on WebRTC and Real-time Translation at the GitHub repository for WebRTC version next use cases (https://github.com/w3c/webrtc-nv-use-cases/issues/2).


Real-time translation is both an interesting and important use case for a next version of WebRTC.

Speech Recognition, Translation and Speech Synthesis

Approaches to real-time speech-to-speech machine translation include those which interconnect speech recognition, translation and speech synthesis components and services. In that regard, we can consider client-side, on-prem, server-side, third-party and cloud-based components and services. In that regard, we can also consider both free and priced components and services.

We can envision post-text speech technology and machine translation components and services. Speech recognition need not output to text; we can consider speech-to-SSML. Machine translation need not input from nor output to text; we can consider SSML-to-SSML machine translation. Components and services may provide various options with respect to their input and output data formats.

Connecting Components and Services by Constructing Graphs

We can consider APIs which facilitate the construction of graphs which represent the flow of data between components and services. As these graphs are constructed, users could be apprised of relevant notifications, requests for permissions and options for payments. As these constructed graphs are activated, a number of protocols could be utilized to interconnect the components and services which, together, provide users with real-time translation..


WebRTC Translator Demo<https://www.youtube.com/watch?v=Tv8ilBOKS2o>
Real Time Translation in WebRTC<https://www.youtube.com/watch?v=EPBWR_GNY9U>

Best regards,
Adam Sobieski
Received on Friday, 21 September 2018 13:00:01 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 19:18:44 UTC