Re: Legislative Recordings and 3D Video

E-Governance Community Group,

Open Government Community Group,


An example scenario of photography and videography from 3D video data is that of a press conference.  Processing the 3D data from sensor arrays, cameras can be placed arbitrarily in the spaces of conference venues to show journalists as they ask questions and cameras can be placed on vectors between press conference hosts and journalists so that, while answering journalists’ questions, press conference hosts can look simultaneously at journalists and cameras.  The example highlights some of the new ways that photographers and videographers can position, calibrate and maneuver virtual cameras in 3D recordings.




Multidisciplinary research topics include automatic and computer-assisted generation and analysis of multimedia and of cinematography.  Topics include the cinematography of entire events, summarizations of events and clips, for example clips utilized in presentations and in other materials such as digital books and textbooks.  Topics pertinent to both generating and analyzing such multimedia, and topically the cinematography in such multimedia, include support for multimedia documents, multiple or tandem devices, mixed and multiple camera angle tracks, stereoscopic multiview coding, multiview coding and free viewpoint video scenarios.





3D video viewing scenarios include uses of 3D televisions and 3D display devices as well as combinations of other display devices with sensors and mobile computers.  Some mobile computing human-computer interface topics include, with regard to multiple camera angle video, multitouch ergonomics for moving between multiple cameras, including while viewing fullscreen video, in a manner intuitive to spatial navigation and to the positions of the multiple cameras and camera angles.  Users could additionally gesture to view 3D models of multiple cameras and camera angles and then navigate by means of selecting cameras.




Computer vision and visual-inertial odometry topics are also pertinent to the ergonomics of viewing 3D content, graphics and video, on mobile devices.  Algorithms can utilize data from multiple cameras on the fronts and backs of devices, head-tracking, accelerometers, compasses and gyroscopes to provide users with the ergonomics to move mobile computers, e.g. tablets, through space, and their heads relative to them, for enhanced viewing experiences with 3D content, graphics and video.




Technologies, both in use and emerging, can transform the recording, storage and viewing of legislative events and records, meetings, press conferences, presentations and infographics.










Kind regards,




Adam Sobieski








Bares, William H., Joël P. Grégoire, and James C. Lester. "Realtime constraint-based cinematography for complex interactive 3D worlds." In AAAI/IAAI, pp. 1101-1106. 1998.




Bares, William H., Somying Thainimit, Scott McDermott, and C. Boudreaux. "A model for constraint-based camera planning." In Smart Graphics. Papers from the 2000 AAAI Spring Symposium, pp. 84-91. 2000.




Bruls, W. H. A., Chris Varekamp, Rene Klein Gunnewiek, Bart Barenbrug, and Amaud Bourge. "Enabling introduction of stereoscopic (3d) video: Formats and compression standards." In Image Processing, 2007. ICIP 2007. IEEE International Conference on, vol. 1, pp. I-89. IEEE, 2007.




Christianson, David B., Sean E. Anderson, Li-wei He, David H. Salesin, Daniel S. Weld, and Michael F. Cohen. "Declarative camera control for automatic cinematography." In AAAI/IAAI, Vol. 1, pp. 148-155. 1996.




Gleicher, Michael L., Rachel M. Heck, and Michael N. Wallick. "A framework for virtual videography." In Proceedings of the 2nd international symposium on Smart graphics, pp. 9-16. ACM, 2002.




He, Li-wei, Michael F. Cohen, and David H. Salesin. "The virtual cinematographer: a paradigm for automatic real-time camera control and directing." In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, pp. 217-224. ACM, 1996.




Jones, Eagle, Andrea Vedaldi, and Stefano Soatto. "Inertial structure from motion with autocalibration." In Proc. IEEE Int’l Conf. Computer Vision Workshop on Dynamical Vision, Rio de Janeiro, Brazil. 2007.




Kelly, Jonathan, and Gaurav S. Sukhatme. "Visual-inertial sensor fusion: Localization, mapping and sensor-to-sensor self-calibration." The International Journal of Robotics Research 30, no. 1 (2011): 56-79.




Li, Mingyang, and Anastasios I. Mourikis. "High-precision, consistent EKF-based visual–inertial odometry." The International Journal of Robotics Research32, no. 6 (2013): 690-711.




Merkle, Philipp, Aljoscha Smolic, Karsten Muller, and Thomas Wiegand. "Efficient prediction structures for multiview video coding." Circuits and Systems for Video Technology, IEEE Transactions on 17, no. 11 (2007): 1461-1473.




Merkle, Philipp, Aljoscha Smolic, Karsten Muller, and Thomas Wiegand. "Multi-view video plus depth representation and coding." In Image Processing, 2007. ICIP 2007. IEEE International Conference on, vol. 1, pp. I-201. IEEE, 2007.




Nieuwenhuisen, Dennis, and Mark H. Overmars. "Motion planning for camera movements." In Robotics and Automation, 2004. Proceedings. ICRA'04. 2004 IEEE International Conference on, vol. 4, pp. 3870-3876. IEEE, 2004.




Roumeliotis, Stergios I., Andrew E. Johnson, and James F. Montgomery. "Augmenting inertial navigation with image-based motion estimation." In Robotics and Automation, 2002. Proceedings. ICRA'02. IEEE International Conference on, vol. 4, pp. 4326-4333. IEEE, 2002.




Rui, Yong, Anoop Gupta, and Jonathan Grudin. "Videography for telepresentations." In Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 457-464. ACM, 2003.




Smolic, Aljoscha, Karsten Mueller, Philipp Merkle, Christoph Fehn, Peter Kauff, Peter Eisert, and Thomas Wiegand. "3d video and free viewpoint video-technologies, applications and mpeg standards." In Multimedia and Expo, 2006 IEEE International Conference on, pp. 2161-2164. IEEE, 2006.




Smolic, Aljoscha, Karsten Mueller, Nikolce Stefanoski, Joern Ostermann, Atanas Gotchev, Gözde B. Akar, Georgios Triantafyllidis, and Alper Koz. "Coding algorithms for 3DTV—a survey." Circuits and Systems for Video Technology, IEEE Transactions on 17, no. 11 (2007): 1606-1621.