Re: Rationalizing new/start/end/mute/unmute/enabled/disabled

On Mon, Apr 8, 2013 at 9:47 PM, Stefan Håkansson LK <
stefan.lk.hakansson@ericsson.com> wrote:

> 2. We should define how a saved stream (and perhaps other media files) can
> be converted to a MediaStream. Using the media element is one option, but
> would not meet the requirement of allowing the user to fool the application
> - something we have discussed we should support.
>

Fooling the application is only relevant for streams generated by
getUserMedia. If an application wants to stream its own saved resource as a
MediaStream, we don't need to let the user interfere with that.

A question on video_element.captureStreamUntilEnded(): does it capture only
> what is rendered, or also tracks that are not played?
>

All tracks that we can decode. So e.g. if you play a resource with a video
track in an <audio> element and capture that to a MediaStream, the
MediaStream contains the video track.

And for the case of multiple audio tracks: those are mixed by the media
> element when played.
>
Will those individual tracks be present in the captured MediaStream, or
> will there be just one audio track (representing the mixed audio)?
>

We don't currently support decoding more than one audio track, but when we
do I think we should represent those as separate tracks in the MediaStream.
The enabled state of those tracks will need to follow the track selections
of the media element --- we haven't thought about how to do that yet.

How well have you specified it, is there text available that could be used?
>

There was some text in the MediaStream Processing draft. It's not very good
though.

In principle I agree, being able to switch source of a MediaStream(Track)
> would be a natural to have (and needed for certain legacy interop cases).
>

We may not need to "switch the source of a MediaStreamTrack". There are a
few ways to expose API to effective switch audio sources. One approach
would be to create a MediaStreamTrack from the output of a Web Audio
AudioNode. Then Web Audio can be used to switch from one audio source to
another. Web Audio already specs this:
https://dvcs.w3.org/hg/audio/raw-file/tip/webaudio/specification.html#MediaStreamAudioDestinationNodealthough
no-one's implemented it yet AFAIK. It would be easy for us to
implement.

(Here you could also have a MediaStream with two video tracks sent to the
> other end, and switch at the target. Maybe not the most natural way, but
> doable.)
>

Trying do all these effects at the target sounds clumsy, fragile and
constraining.

Rob
-- 
q“qIqfq qyqoquq qlqoqvqeq qtqhqoqsqeq qwqhqoq qlqoqvqeq qyqoquq,q qwqhqaqtq
qcqrqeqdqiqtq qiqsq qtqhqaqtq qtqoq qyqoquq?q qEqvqeqnq qsqiqnqnqeqrqsq
qlqoqvqeq qtqhqoqsqeq qwqhqoq qlqoqvqeq qtqhqeqmq.q qAqnqdq qiqfq qyqoquq
qdqoq qgqoqoqdq qtqoq qtqhqoqsqeq qwqhqoq qaqrqeq qgqoqoqdq qtqoq qyqoquq,q
qwqhqaqtq qcqrqeqdqiqtq qiqsq qtqhqaqtq qtqoq qyqoquq?q qEqvqeqnq
qsqiqnqnqeqrqsq qdqoq qtqhqaqtq.q"