Re: active speaker information in mixed streams

Hey Tim, Peter,

Sync isn't really the issue here. It's mostly about the fact that the
mixer is not a WebRTC entity. This means that it most likely doesn't
even know what SCTP is, it doesn't necessarily have access to
signalling and above all, the mix is likely to also contain audio from
non-webrtc endpoints. Using DataChannels in such situations would
likely turn out to be quite convoluted.

Emil

On Tue, Jan 28, 2014 at 9:39 PM, tim panton <thp@westhawk.co.uk> wrote:
>
> On 28 Jan 2014, at 13:28, Emil Ivov <emcho@jitsi.org> wrote:
>
>> Hey all,
>>
>> One requirement that we often bump against is the possibility to
>> extract active speaker information from an incoming *mixed* audio
>> stream. Acquiring the CSRC list from RTP would be a good solution to
>> this. Audio levels as per RFC6465 would be even better.
>>
>> Are these something that could be foreseeable for 1.0 ?
>>
>
> Would it be possible to extract the relevant audio levels with the WebAudioApi and
> then send the data points over the DataChannel. I realise the sync won't be exact,
> but might it do the trick ?
>
>> Emil
>>
>> --
>> https://jitsi.org
>>
>



-- 
Emil Ivov, Ph.D.                       67000 Strasbourg,
Project Lead                           France
Jitsi
emcho@jitsi.org                        PHONE: +33.1.77.62.43.30
https://jitsi.org                       FAX:   +33.1.77.62.47.31

Received on Tuesday, 28 January 2014 22:31:19 UTC