- From: Chris Grigg <chris@chrisgrigg.org>
- Date: Wed, 30 Jun 2010 13:43:17 -0700
- To: public-xg-audio@w3.org
Thanks very much for amplifying, Jacques. This is an interesting mapping of common IA practices to HTML/XML expression. Maybe we should think some more about using the id attribute as a way to connect abstract sounds to other HTML elements (or to styles?). The only thing I would add is that iXMF is only one of many, many interactive audio systems that have been designed & used over the years, most of which include the concept that a sound is more than just a single playable media file. I should probably clarify (because I'm involved in the iXMF project and also on the IASIG Steering Committee) that I didn't mean iXMF specifically when I suggested new media type(s) for this -- IMHO we should be open to all possible solutions, and are probably not yet at a stage to pick (nor invent) anything particular. It's worth noting that in Jacques' examples this is all being done declaratively, requiring no JS coding per se. It's the kind of thing that a sound designer who isn't a programmer could do, or that a simple tool for sound designers could emit. For folks not so familiar with interactive audio -- the value for the "pick" attribute that Jacques calls "exclusiveRandom" is one of the most basic selection logic operations in interactive audio; it's probably the key technique for reducing repetition fatigue. It becomes even more powerful if we add something like an "omitMostRecent" attribute, for example omitMostRecent="1" would ensure that for a given sound, the exact same file is never played twice in a row. -- Chris G. On 2010Jun 29, at 6:00 a, jacques lemordant wrote: > I found the following proposal of Chris very interesting: > >> Note: This functionality may require either defining new media type(s), or perhaps a change to the <audio> element semantics. In interactive audio, a sound is not the same as a single playable media file; typically a sound (or 'cue') is some kind of bag of pointers to multiple playable audio files, plus some selection logic and/or parameter mapping logic. > > I will try to illustrate this idea for people not familiar with IA. > > For example, in Safari and Opera (Firefox soon) , one can put space-structured graphics in an img element: > <img src="car.svg" alt="a car" /> > and this is conform to the semantic of the img w3c spec > > Will be nice to be able to put time-structured audio (cue if using iXMF vocabulary) in the audio element: > <audio src="beach_music.ixmf" alt="music at the beach"/> > > with a beach_music file like this one: > > <cue id="beach_music" loopCount="-1"> > <chunk pick="exclusiveRandom"> > <sound src="/loop_1-1.wav" pickPriority="2"/> > <sound src="/loop_1-2.wav" pickPriority="2"/> > <sound src="/loop_1-3.wav" pickPriority="1"/> > </chunk> > <chunk pick="exclusiveRandom"> > <sound src="/loop_2-1.wav" pickPriority="2"/> > <sound src="/loop_2-2.wav" pickPriority="2"/> > <sound src="/loop_2-3.wav" pickPriority="1"/> > </chunk> > <panControl> > > <animate id="slide" attribute="pan" begin="beach_music.start" from="-100" to="100"/> > > </panControl> > </cue> > > > jacques lemordant > http://wam.inrialpes.fr >
Received on Wednesday, 30 June 2010 20:43:49 UTC