Feng Qian
ABSTRACT
As an important component of the virtual reality (VR) technology, 360-degree videos provide users with panoramic view and allow them to freely control their viewing direction during video playback. Usually, a player displays only the visible portion of a 360 video. Thus, fetching the entire raw video frame wastes bandwidth. In this paper, we consider the problem of optimizing 360 video delivery over cellular networks. We first conduct a measurement study on commercial 360 video platforms. We then propose a cellular-friendly streaming scheme that delivers only 360 videos' visible portion based on head movement prediction. Using viewing data collected from real users, we demonstrate the feasibility of our approach, which can reduce bandwidth consumption by up to 80% based on a trace-driven simulation.
- 2015 Speedtest results for U.S. ISPs and Mobile Networks. http://www.speedtest.net/awards/us.Google Scholar
- Augmented/Virtual Reality revenue forecast revised to hit $120 billion by 2020. http://goo.gl/Lxf4Sy.Google Scholar
- Facebook Surround 360. https://facebook360.fb.com/facebook-surround-360/.Google Scholar
- Google Cardboard. https://vr.google.com/cardboard/index.html.Google Scholar
- mitmproxy. https://mitmproxy.org/.Google Scholar
- Next-generation video encoding techniques for 360 video and VR. https://goo.gl/DvYivQ.Google Scholar
- OpenTrack: head tracking software. https://github.com/opentrack/opentrack.Google Scholar
- Under the hood: Building 360 video. https://code.facebook.com/posts/1638767863078802.Google Scholar
- YouTube Live encoder settings, bitrates and resolutions. https://support.google.com/youtube/answer/2853702.Google Scholar
- YouTube live in 360 degrees encoder settings. https://support.google.com/youtube/answer/6396222.Google Scholar
- X. Bao, S. Fan, A. Varshavsky, K. A. Li, and R. R. Choudhury. Your Reactions Suggest You Liked the Movie: Automatic Content Rating via Reaction Sensing. In UbiComp, 2013. Google ScholarDigital Library
- M. Belshe, R. Peon, and M. Thomson. Hypertext Transfer Protocol Version 2 (HTTP/2). RFC 7540, 2015.Google Scholar
- J. Chen, R. Mahindra, M. A. Khojastepour, S. Rangarajan, and M. Chiang. A Scheduling Framework for Adaptive Video Delivery over Cellular Networks. In MobiCom, 2013. Google ScholarDigital Library
- M. A. Hoque, M. Siekkinen, and J. K. Nurminen. Using Crowd-Sourced Viewing Statistics to Save Energy in Wireless Video Streaming. In Mobicom, 2013. Google ScholarDigital Library
- H. Huang, B. Zhang, S.-H. G. Chan, G. Cheung, and P. Frossard. Coding and Replication Co-Design for Interactive Multiview Video Streaming. In INFOCOM, 2012.Google ScholarCross Ref
- J. Huang, F. Qian, A. Gerber, Z. M. Mao, S. Sen, and O. Spatscheck. A Close Examination of Performance and Power Characteristics of 4G LTE Networks. In Mobisys, 2012. Google ScholarDigital Library
- T.-Y. Huang, R. Johari, N. McKeown, M. Trunnell, and M. Watson. A Buffer-Based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service. In SIGCOMM, 2014. Google ScholarDigital Library
- J. Jiang, V. Sekar, and H. Zhang. Improving Fairness, Efficiency, and Stability in HTTP-based Adaptive Video Streaming with FESTIVE. In CoNEXT, 2012. Google ScholarDigital Library
- J.-G. Lou, H. Cai, and J. Li. A real-time interactive multi-view video system. In ACM Multimedia, 2005. Google ScholarDigital Library
- R. Szeliski. Image Alignment and Stitching: A Tutorial. Technical Report MSR-TR-2004-92, Microsoft Research.Google Scholar
- X. Xie, X. Zhang, S. Kumar, and L. E. Li. piStream: Physical Layer Informed Adaptive Video Streaming Over LTE. In MobiCom, 2015. Google ScholarDigital Library
- Y. Xu, Z. Wang, W. K. Leong, and B. Leong. An End-to-End Measurement Study of Modern Cellular Data Networks. In PAM, 2014. Google ScholarDigital Library
- X. Yin, A. Jindal, V. Sekar, and B. Sinopoli. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In SIGCOMM, 2015. Google ScholarDigital Library
- Z. Zhu, G. Xu, E. M. Riseman, and A. R. Hanson. Fast generation of dynamic and multi-resolution 360° panorama from video sequences. In IEEE Intl. Conf. on Multimedia Computing and Systems, 1999. Google ScholarDigital Library
Index Terms
- Optimizing 360 video delivery over cellular networks
Recommendations
360-Video Navigation for 360-Multimedia Delivery Systems: Research Challenges and Opportunities
MM '20: Proceedings of the 28th ACM International Conference on MultimediaWith the emergence of new 360-degree cameras, ambisonic microphones, and VR/AR display devices, more diverse multi-modal content has become available, and with it the demand for the capability of streaming 360-degree videos to enhance users? 360-...
360-Degree Video Head Movement Dataset
MMSys'17: Proceedings of the 8th ACM on Multimedia Systems ConferenceWhile Virtual Reality applications are increasingly attracting the attention of developers and business analysts, the behaviour of users watching 360-degree (i.e. omnidirectional) videos has not been thoroughly studied yet. This paper introduces a ...
Your Attention is Unique: Detecting 360-Degree Video Saliency in Head-Mounted Display for Head Movement Prediction
MM '18: Proceedings of the 26th ACM international conference on MultimediaHead movement prediction is the key enabler for the emerging 360-degree videos since it can enhance both streaming and rendering efficiency. To achieve accurate head movement prediction, it becomes imperative to understand user's visual attention on 360-...
Comments