RE: MediaRecorder and using Streams

Regarding what is written on the blog under MIME type:

"One of the issues with the current API discussed on public-media-capture was that of blob mime types.[3] Each blob should have a mime type, but it's not entirely clear what type it should be. The mime type of the final encoding result makes only sense for the entire data set, not for individual chunks of data."

Isn't the point of returning time-sliced BLOB's for the speech recognition use case that the BLOB's be self-contained and have a MIME type associated with them?  For instance, assume that an implementation is returning a time-slice of encoded audio data every 500 ms.  If we also assume that the 500 ms chunk is being sent to a server somewhere for what is hopefully real-time processing, wouldn't the server have to know the MIME type for each BLOB it receives?  The text above seems to indicate that the server would have to wait for the "final encoding result", which would imply to me that RT speech recognition using the MediaRecorder is out if we have this interpretation.  And I don't see how Stream API helps in this regards.

My interpretation could be totally incorrect of course - wouldn't be the first time.

-Giri

From: Jim Barnett [mailto:Jim.Barnett@genesyslab.com]
Sent: Monday, September 09, 2013 3:18 PM
To: Rachel Blum; Robert O'Callahan
Cc: public-media-capture@w3.org
Subject: RE: MediaRecorder and using Streams

We can certainly look at this once the Streams API stabilizes.    The plan is for MediaRecorder to lag behind Media Capture (a.k.a. getUserMedia).  We're in a hurry to get gUM out, but there's not so much of a rush for MediaRecorder.


-          Jim

From: groby@google.com<mailto:groby@google.com> [mailto:groby@google.com] On Behalf Of Rachel Blum
Sent: Monday, September 09, 2013 6:05 PM
To: Robert O'Callahan
Cc: Jim Barnett; public-media-capture@w3.org<mailto:public-media-capture@w3.org>
Subject: Re: MediaRecorder and using Streams

Just to keep the list informed: Greg and I have summarized the pros/cons we can see around MediaRecorder using a Streams API. (attached)

Agreeing with Robert though that we shouldn't block MediaRecorder on Streams stabilizing - but it seems an idea worth exploring.

 - rachel

On Thu, Aug 1, 2013 at 2:57 PM, Robert O'Callahan <robert@ocallahan.org<mailto:robert@ocallahan.org>> wrote:
I think the basic idea makes sense but we can do it in addition to the Blob-only API, once the Streams situation has stabilized. I don't want to block MediaRecorder's streaming functionality on that.

Rob
--
Jtehsauts  tshaei dS,o n" Wohfy  Mdaon  yhoaus  eanuttehrotraiitny  eovni le atrhtohu gthot sf oirng iyvoeu rs ihnesa.r"t sS?o  Whhei csha iids  teoa stiheer :p atroa lsyazye,d  'mYaonu,r  "sGients  uapr,e  tfaokreg iyvoeunr, 'm aotr  atnod  sgaoy ,h o'mGee.t"  uTph eann dt hwea lmka'n?  gBoutt  uIp  waanndt  wyeonut  thoo mken.o w

Received on Monday, 9 September 2013 22:29:56 UTC