RE: active speaker information in mixed streams

Emil said: 

+1. While polling is obviously much better than nothing at all, having a change event would be quite convenient.

With regard to energy levels, there are two main use cases:

1.  acting on changes of the current speaker (e.g. in order to upscale their corresponding video and thumbnail everyone else)
2.  showing energy levels for all participants

[BA] I believe that the polling proposal could address need #2 by delivering a list of CSRCs as well as an (averaged) level, but I'm not sure about #1. 

#1 is about timely dominant speaker identification, presumably without false speaker switches. 

To do this well, you may need to do more than firing an event based on changes in a ranked list of speakers based on averaged levels; better approaches tend to actually process the audio. 

For example, see http://webee.technion.ac.il/Sites/People/IsraelCohen/Publications/CSL_2012_Volfin.pdf 

Received on Wednesday, 29 January 2014 14:15:11 UTC