Re: [EXTERNAL] Natural language interfaces and conversational agents

John Paton wrote on 04/03/2021 09:22:
>
> HCO – Hearing Carry Over
>
> For someone who can hear well enough but is speech impaired.
>
> The user types text but receives spoken audio.
>
> VCO – Voice Carry Over
>
> For someone who can’t hear well enough to follow a conversation but 
> prefers speaking to typing.
>
> User speaks but receives replies in text.
>
> Captioned Telephony
>
> Multimodal communication where the user receives a live captions of 
> the speech. Technical issues mean mistakes in the captions are common 
> and there is always a lag.
>
> User speaks but receives both speech and text in return.
>
This is excellent John, thank you!

Josh


> For symmetry I can imagine a captioned telephony where the user types 
> but receives speech and text in return. I haven’t seen it in the wild.
>
> If a system only supported text -> text OR voice -> voice then HCO and 
> VCO would need the user to switch but I’m not aware of a use case 
> where the user preferences would change part the way through a call.
>
> In a human-machine interaction though if a user preferred to use their 
> voice but the speech recognition didn’t understand them they may 
> switch to text for that part or the rest of the call. They may also 
> want the ability to edit (in text) the phrase that the computer 
> understood from their speech. So there are use cases for multimodal 
> input too.
>


-- 
Emerging Web Technology Specialist/Accessibility (WAI/W3C)