- From: Robert O'Callahan <robert@ocallahan.org>
- Date: Thu, 6 Oct 2011 10:00:50 +1300
- To: Chris Wilson <cwilso@google.com>
- Cc: Olli@pettay.fi, public-webevents@w3.org
Received on Wednesday, 5 October 2011 21:01:20 UTC
My goal is to turn MediaStreams into a generic framework for real-time signal processing. http://hg.mozilla.org/users/rocallahan_mozilla.com/specs/raw-file/tip/StreamProcessing/StreamProcessing.html We could add a MIDI track type and add MIDI capture to navigator.getUserMedia. You'd also be able to load MIDI data using an HTML media element. Then you could write a MIDI synthesizer in JS, running in a Worker, taking raw MIDI data as input and generating output audio samples. Because MediaStreams maintain synchronization, you'd have that; for example if you had a MIDI track and a video track synchronized, they'd stay synchronized after sound synthesis. And you'd be able to mix MIDI output with other audio effects. Rob -- "If we claim to be without sin, we deceive ourselves and the truth is not in us. If we confess our sins, he is faithful and just and will forgive us our sins and purify us from all unrighteousness. If we claim we have not sinned, we make him out to be a liar and his word is not in us." [1 John 1:8-10]
Received on Wednesday, 5 October 2011 21:01:20 UTC