W3C home > Mailing lists > Public > public-xg-htmlspeech@w3.org > October 2011

Re: Reminder: send questions

From: Patrick Ehlen <pehlen@attinteractive.com>
Date: Tue, 4 Oct 2011 17:14:42 -0700
To: "Young, Milan" <Milan.Young@nuance.com>, Michael Johnston <johnston@research.att.com>, Dan Burnett <dburnett@voxeo.com>
CC: "public-xg-htmlspeech@w3.org" <public-xg-htmlspeech@w3.org>
Message-ID: <CAB0EF82.A4B9%pehlen@attinteractive.com>
But I think Michael is referring to using INFO for data that may change
within a session and be different on each request. For example, user
gestures that accompanied the audio, or contextual information like the
names of entities displayed in the GUI that might ASR might use to weight
them differently. 

These kinds of things are request-related, not session-related, and we need
a method to transmit them, if not using INFO.


On 10/4/11 5:02 PM, "Young, Milan" <Milan.Young@nuance.com> wrote:

> I've been thinking of these INFO messages as being session-level
> parameters.  Both models would result in immediate communication with
> the speech service which seems to be what you are after.  I prefer the
> parameter model for the following reasons:
> 
>   * Session parameters could also be used to apply persistent parameters
> (i.e. those that should be implicitly part of every request).  For
> example a default speech timeout or user-id.  It's true that you could
> accomplish the same with INFO messages, but calling them session
> parameters seems conceptually cleaner.
> 
>   * Session parameters are gettable.  This allows blocking communication
> with the remote service when required.  Otherwise you need to do a dance
> where you release control and then wait for some event.
> 
>   * Session parameters are useful for modeling configurable values that
> are better associated with the session rather than requests.  For
> example audio codecs, service versions, protocol versions, etc.
> 
> 
> Thanks
> 
> 
> -----Original Message-----
> From: public-xg-htmlspeech-request@w3.org
> [mailto:public-xg-htmlspeech-request@w3.org] On Behalf Of JOHNSTON,
> MICHAEL J (MICHAEL J)
> Sent: Tuesday, October 04, 2011 1:07 PM
> To: Dan Burnett
> Cc: public-xg-htmlspeech@w3.org
> Subject: Re: Reminder: send questions
> 
> Here is one I sent earlier:
> 
> One thing I see missing from the API draft is support for the INFO
> messages for sending metadata to the recognizer during recognition.
> 
> In the html+speech protocol we have a generic capability to send
> metadata to the recognizer, the
> relevant reco-method is INFO (see below).   These messages can be sent
> during the transmission of
> audio.  This covers multimodal use cases where there may be metadata
> (e.g. GUI actions, button clicks etc) that take place while the user is
> speaking, which are relevant for processing the user's audio.
> 
> To support this at the API level we need some kind of method on
> SpeechInputRequest that will cause the INFO message to be sent over the
> protocol.
> 
> e.g.
> 
> interface SpeechInputRequest {
> 
> .....
> 
> void
> s<file:///Users/johnstonmjr/NOTES/2011/sep%202011/speechwepapi.html#dfn-
> setsensitivity>endinfo(in DOMstring
> i<file:///Users/johnstonmjr/NOTES/2011/sep%202011/speechwepapi.html#dfn-
> sensitivity>nfo);
> 
> .....
> 
> 
> Michael
> 
> 
> 
> 
> 
> reco-method  = "LISTEN"             ; Transitions Idle -> Listening
>              | "START-INPUT-TIMERS" ; Starts the timer for the various
> input timeout conditions
>              | "STOP"               ; Transitions Listening -> Idle
>              | "DEFINE-GRAMMAR"     ; Pre-loads & compiles a grammar,
> assigns a temporary URI for reference in other methods
>              | "CLEAR-GRAMMARS"     ; Unloads all grammars, whether
> active or inactive
>              | "INTERPRET"          ; Interprets input text as though it
> was spoken
>              | "INFO"               ; Sends metadata to the recognizer
> 
> INFO
> 
> In multimodal applications, some recognizers will benefit from
> additional context. Clients can use the INFO request to send this
> context. The Content-Type header should specify the type of data, and
> the data itself is contained in the message body.
> 
> 
> 
> On Oct 4, 2011, at 3:03 PM, Dan Burnett wrote:
> 
> Group,
> 
> Please remember to send any questions you have about how the protocol
> relates to the Web API in advance of our call this week so Robert can be
> ready to address them.
> 
> The most recent version of the protocol on the mailing list is here [1].
> 
> -- dan
> 
> [1]
> http://lists.w3.org/Archives/Public/public-xg-htmlspeech/2011Sep/0012.ht
> ml
> 
> 
> 
> 
> 
Received on Wednesday, 5 October 2011 00:15:19 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Wednesday, 5 October 2011 00:15:19 GMT