Afshin Taghavi Nasrabadi
Ravi Prakash
ABSTRACT
Virtual reality and 360-degree video streaming are growing rapidly, yet, streaming high-quality 360-degree video is still challenging due to high bandwidth requirements. Existing solutions reduce bandwidth consumption by streaming high-quality video only for the user's viewport. However, adding the spatial domain (viewport) to the video adaptation space prevents the existing solutions from buffering future video chunks for a duration longer than the interval that user's viewport is predictable. This makes playback more prone to video freezes due to rebuffering, which severely degrades the user's Quality of Experience especially under challenging network conditions. We propose a new method that alleviates the restrictions on buffer duration by utilizing scalable video coding. Our method significantly reduces the occurrence of rebuffering on links with varying bandwidth without compromising playback quality or bandwidth efficiency compared to the existing solutions. We demonstrate the efficiency of our proposed method using experimental results with real world cellular network bandwidth traces.
- Saamer Akhshabi, Ali C Begen, and Constantine Dovrolis. 2011. An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP Proceedings of the second annual ACM conference on Multimedia systems. ACM, 157--168. Google Scholar
Digital Library
- Gisle Bjontegaard. 2001. Calcuation of average PSNR differences between RD-curves. Doc. VCEG-M33 ITU-T Q6/16, Austin, TX, USA, 2-4 April 2001 (2001).Google Scholar
- Jill M Boyce, Yan Ye, Jianle Chen, and Adarsh K Ramasubramonian. 2016. Overview of SHVC: scalable extensions of the high efficiency video coding standard. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 26, 1 (2016), 20--34.Google ScholarDigital Library
- HM. 2016. High Efficiency Video Coding (HEVC) reference software. https://hevc.hhi.fraunhofer.de/. (2016). Access date: November 2016.Google Scholar
- M. Hosseini and V. Swaminathan. 2016. Adaptive 360 VR Video Streaming: Divide and Conquer 2016 IEEE International Symposium on Multimedia (ISM). 107--110.Google Scholar
- Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2015. A buffer-based approach to rate adaptation: Evidence from a large video streaming service. ACM SIGCOMM Computer Communication Review Vol. 44, 4 (2015), 187--198. Google ScholarDigital Library
- Evgeny Kuzyakov and David Pio. 2015. Under the hood: Building 360 video. https://code.facebook.com/posts/1638767863078802/under-the-hood-building-360-video/. (2015). Access date: April 2017.Google Scholar
- Evgeny Kuzyakov and David Pio. 2016. Next-generation video encoding techniques for 360 video and VR. https://code.facebook.com/posts/1126354007399553/next-generatio-video-encoding-techniques-for-360-video-and-vr/. (2016). Access date: April 2017.Google Scholar
- Ricky KP Mok, Edmond WW Chan, and Rocky KC Chang. 2011. Measuring the quality of experience of HTTP video streaming 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops. IEEE, 485--492.Google Scholar
- Ravi Netravali and others. October 2014. Mahimahi: A Lightweight Toolkit for Reproducible Web Measurement. ACM SIGCOMM Computer Communication Review Vol. 44, 4 (. October 2014), 129--130. Google ScholarDigital Library
- Pixvan. 2017. An Intro to FOVAS: Field of View Adaptive Streaming for Virtual Reality. http://blog.pixvana.com/intro-to-field-of-view-adaptive-streaming-for-vr. (2017). Access date: April 2017.Google Scholar
- Feng Qian, Lusheng Ji, Bo Han, and Vijay Gopalakrishnan. 2016. Optimizing 360 video delivery over cellular networks Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges. 1--6. Google ScholarDigital Library
- Patrice Rondao Alface, Jean-Franccois Macq, and Nico Verzijp. 2012. Interactive Omnidirectional Video Delivery: A Bandwidth-Effective Approach. Bell Labs Technical Journal Vol. 16, 4 (2012), 135--147. Google ScholarDigital Library
- SHVC. 2016. HEVC Scalability Extension reference software. (2016). https://hevc.hhi.fraunhofer.de/shvc.Google Scholar
- Kevin Spiteri, Rahul Urgaonkar, and Ramesh K Sitaraman. 2016. BOLA: near-optimal bitrate adaptation for online videos Computer Communications, IEEE INFOCOM 2016-The 35th Annual IEEE International Conference on. IEEE, 1--9.Google ScholarDigital Library
- Kashyap Kammachi Sreedhar, Alireza Aminlou, Miska M Hannuksela, and Moncef Gabbouj. 2016. Viewport-Adaptive Encoding and Streaming of 360-Degree Video for Virtual Reality Applications. In Multimedia (ISM), 2016 IEEE International Symposium on. IEEE, 583--586.Google ScholarCross Ref
- Gary J Sullivan, Jens Ohm, Woo-Jin Han, and Thomas Wiegand. 2012. Overview of the high efficiency video coding (HEVC) standard. IEEE Transactions on circuits and systems for video technology, Vol. 22, 12 (2012), 1649--1668. Google ScholarDigital Library
- Afshin TaghaviNasrabadi, Anahita Mahzari, Joseph D Beshay, and Ravi Prakash. 2017. Adaptive 360-degree video streaming using layered video coding Virtual Reality (VR), 2017 IEEE. IEEE, 347--348.Google Scholar
- Alireza Zare, Alireza Aminlou, Miska M Hannuksela, and Moncef Gabbouj. 2016. HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications Proceedings of the 2016 ACM on Multimedia Conference. ACM, 601--605. Google ScholarDigital Library
Index Terms
- Adaptive 360-Degree Video Streaming using Scalable Video Coding
Recommendations
A DASH video streaming system for immersive contents
MMSys '18: Proceedings of the 9th ACM Multimedia Systems ConferenceVirtual Reality/Augmented Reality applications require streaming 360° videos to implement new services in a diverse set of fields such as entertainment, art, e-health, e-learning, and smart factories. Providing a high Quality of Experience when ...
Adaptive scalable video streaming in wireless networks
MMSys '12: Proceedings of the 3rd Multimedia Systems ConferenceIn this paper, we investigate the optimal streaming strategy for dynamic adaptive streaming over HTTP (DASH). Specifically, we focus on the rate adaptation algorithm for streaming scalable video (H.264/SVC) in wireless networks. We model the rate ...
Layer-Assisted Adaptive Video Streaming
NOSSDAV '18: Proceedings of the 28th ACM SIGMM Workshop on Network and Operating Systems Support for Digital Audio and VideoHTTP Adaptive Streaming (HAS) is the widely adopted solution for video streaming over the Internet. When network throughput is highly variable, designing an optimal HAS solution that maximizes Quality of Experience (QoE) becomes challenging. Each chunk ...
Comments