Core Use Cases - v1.0: Class 4. Interactive Audio Functionality

I found the following proposal of Chris very interesting:

> Note: This functionality may require either defining new media type(s), or perhaps a change to the <audio> element semantics.  In interactive audio, a sound is not the same as a single playable media file; typically a sound (or 'cue') is some kind of bag of pointers to multiple playable audio files, plus some selection logic and/or parameter mapping logic.

I will try to illustrate this idea for people not familiar with IA.

For example, in Safari and Opera (Firefox soon) , one can put space-structured graphics in an img element:
<img src="car.svg" alt="a car" />
and this is conform to the semantic of the img w3c spec

Will be nice to be able to put time-structured audio (cue if using iXMF vocabulary) in the audio element:
<audio src="beach_music.ixmf" alt="music at the beach"/>

with a beach_music  file  like this one:

<cue id="beach_music" loopCount="-1">
   <chunk pick="exclusiveRandom"> 
       <sound src="/loop_1-1.wav" pickPriority="2"/> 
       <sound src="/loop_1-2.wav" pickPriority="2"/> 
       <sound src="/loop_1-3.wav" pickPriority="1"/> 
   </chunk> 
   <chunk pick="exclusiveRandom"> 
       <sound src="/loop_2-1.wav" pickPriority="2"/> 
       <sound src="/loop_2-2.wav" pickPriority="2"/> 
       <sound src="/loop_2-3.wav" pickPriority="1"/> 
   </chunk>
<panControl>

    <animate id="slide" attribute="pan" begin="beach_music.start"    from="-100" to="100"/>

</panControl>
</cue>


jacques lemordant
http://wam.inrialpes.fr

Received on Wednesday, 30 June 2010 10:08:02 UTC