Streaming and Presentation Architectures for Extended Video Streams

ABSTRACT

Mobile devices able to capture multimedia streams (audio and video) have now the capability to produce numerous associated data (GPS, Gyroscope, etc.). The real-time exploitation of these extra-data, in different application scenarios, raise the issue of integrating these data in existing broadcasting architectures. These architectures are designed to work with the audiovisual data and should be extended to match the extra-data requirements (processing time, bandwidth, visualization techniques etc.), and be able to adapt to their environment (network, device) accordingly. The major part of the applications utilizing these data are developed in an "ad-hoc" way, without taking all of their characteristics in account, and require complex maintenance and update efforts in case new data types or new network/device support is introduced. Our study is focused on optimizing the present distribution and presentation architectures for Audiovisual (AV) content, in order to find an efficient way to represent the associated data.

References

1. Min Chen, Sergio Gonzalez, Athanasios Vasilakos, Huasong Cao, and Victor CM Leung. 2011. Body area networks: A survey. Mobile networks and applications 16, 2 (2011), 171--193.
2. Cyril Concolato, Jean Le Feuvre, and Emmanouil Potetsianakis. 2015. Synchronized Delivery of 3D Scenes With Audio and Video. In Proceedings of the 20th International Conference on 3D Web Technology. ACM, 245--248.
3. Ricardo Mendes Costa Segundo and Celso Alberto Saibel Santos. 2014. Systematic Review of Multiple Contents Synchronization in Interactive Television Scenario. ISRN Communications and Networking 2014 (2014).
4. Emmanouil Potetsianakis, Jean Le Feuvre and Cyril Concolato. 2016. Extended Video Streams for Spatiotemporal Navigation. In The Graphical Web. Exeter, Devon, UK.
5. Zixia Huang, Klara Nahrstedt, and Ralf Steinmetz. 2013. Evolution of temporal multimedia synchronization principles: A historical viewpoint. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 9, 1s (2013), 34.
6. Yutaka Ishibashi and Shuji Tasaka. 2000. A comparative survey of synchronization algorithms for continuous media in network environments. In Local Computer Networks, 2000. LCN 2000. Proceedings. 25th Annual IEEE Conference on. IEEE, 337--348.
7. Rose Johnson, Kenton O'Hara, Abigail Sellen, Claire Cousins, and Antonio Criminisi. 2011. Exploring the potential for touchless interaction in image-guided interventional radiology. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3323--3332.
8. Le Feuvre, Jean and Concolato, Cyril and Moissinac, Jean-Claude. 2007. GPAC: Open Source Multimedia Framework. In Proceedings of the 15th International Conference on Multimedia (MULTIMEDIA '07). ACM, New York, NY, USA, 1009--1012.
9. Shih-Yao Lin, Yun-Chien Lai, Li-Wei Chan, and Yi-Ping Hung. 2010. Real-time 3D model-based gesture tracking for multimedia control. In Pattern Recognition (ICPR), 2010 20th International Conference on. IEEE, 3822--3825.
10. Ying Lu, Hien To, Abdullah Alfarrarjeh, Seon Ho Kim, Yifang Yin, Roger Zimmermann, and Cyrus Shahabi. 2016. GeoUGV: User-generated mobile video dataset with fine granularity spatial metadata. In Proceedings of the 7th International Conference on Multimedia Systems. ACM, 43.
11. E. Potetsianakis, E. Ksylakis, and G. Triantafyllidis. 2014. A Kinect-based Framework For Better User Experience in Real-Time Audiovisual Content Manipulation. In Telecommunications and Multimedia (TEMU), 2014 International Conference on. 238--242.
12. Emmanouil Potetsianakis and Jean Le Feuvre. 2016. Streaming of Kinect Data for Interactive In-Browser Audio Performances. In Proceedings of the Audio Mostly 2016 (AM '16). ACM, New York, NY, USA, 258--265.
13. Christian Timmerer, S Hasegawa, and SK Kim. 2009. Working Draft of ISO/IEC 23005 Sensory Information. ISO/IEC JTC 1/SC 29/WG 11 N 10618 (2009).
14. M. O. van Deventer, H. Stokking, M. Hammond, J. Le Feuvre, and P. Cesar. 2016. Standards for multi-stream and multi-device media synchronization. IEEE Communications Magazine 54, 3 (March 2016), 16--21.
15. Liviu-Octavian Varga, Gabriele Romaniello, Malifia Vučinić, Michel Favre, Andrei Banciu, Roberto Guizzetti, Christophe Planat, Pascal Urard, Martin Heusse, Franck Rousseau, and others. 2015. Greennet: An energy-harvesting ip-enabled wireless sensor network. IEEE Internet of Things Journal 2, 5 (2015), 412--426.
16. Andrea Zanella, Nicola Bui, Angelo Castellani, Lorenzo Vangelista, and Michele Zorzi. 2014. Internet of things for smart cities. IEEE Internet of Things journal 1, 1 (2014), 22--32.

Index Terms

• Information systems

  • Information retrieval

  • Information storage systems

  • Information systems applications

    • Multimedia information systems

• Software and its engineering

  • Software organization and properties

    • Extra-functional properties

      • Interoperability