Multimodality, Grammars and Event Models

Voice Browser Working Group, Greetings.  I wanted to also broach multimodal input and grammars.  Some other ideas for extending SRGS include specifying JavaScript events and DOM elements in grammars, as a hypothesis towards the multimodal examples indicated in Section 4 of the HTML Speech Incubator Group Final Report (
 That is, something like:
<item event="html5:click" target="...#element" before="0.5s" after="0.5s" /> or <event type="html5:click" target="...#element" before="0.5s" after="0.5s" /> Where a JavaScript event type can be specified for any element or for a particular element, and where a time interval can also be specified.  Other approaches include that SpeechRecognitionEvent can return interim results ("hypothesis" events), which could be used for multimodal interactions.   Kind regards, Adam Sobieski


Received on Friday, 20 April 2012 14:13:24 UTC