Ultra Wide View Based Panoramic VR Streaming

ABSTRACT

Online VR streaming faces great challenges such as the high throughput and real time interaction requirement. In this paper, we propose a novel ultra wide view based method to stream high quality VR on Internet at low bandwidth and little computation cost. First, we only transmit the region where user is looking at instead of full 360° view to save bandwidth. To achieve this goal, we split the source VR into small grid videos in advance. The grid videos are able to reconstruct any view flexibly in user end. Second, according to the fact that users generally interact at low speed, we expand the view that user requested to meet the real time interaction requirement. Besides, a low resolution full view stream is supplied to handle exceptional cases such as high speed view change. We test our solution in an experimental network. The results show remarkable bandwidth saving of over 60% in average at little computation cost while supplying the same quality of experience as local VR.

References

1. Michael Abrash. 2014. What VR could, should, and almost certainly will be within two years. Steam Dev Days, Seattle (2014).
2. Flavio Bonomi, Rodolfo Milito, Jiang Zhu, and Sateesh Addepalli. 2012. Fog computing and its role in the internet of things. In Proceedings of the first edition of the MCC workshop on Mobile cloud computing. ACM, 13--16.
3. William Bussone. 2005. Linear and angular head accelerations in daily life. Ph.D. Dissertation. Virginia Tech.
4. Shenchang Eric Chen. 1995. Quicktime VR: An image-based approach to virtual environment navigation. In Proceedings of the 22nd annual conference on Computer graphics and interactive techniques. ACM, 29--38.
5. Xavier Corbillon, Alisa Devlic, Gwendal Simon, and Jacob Chakareski. 2016. Viewport-Adaptive Navigable 360-Degree Video Delivery. arXiv preprint arXiv:1609.08042 (2016).
6. Jeffrey Dean. 2012. Achieving Rapid Response Times in Large Online Services. (2012). http://research.google.com/people/jeff/latency.html
7. David Pio Evgeny Kuzyakov. 2016. Next-generation video encoding techniques for 360 video and VR. (2016). https://code.facebook.com/posts/1126354007399553/next-generation-video-encoding-techniques-for-360-video-and-vr/.
8. Chi-Wing Fu, Liang Wan, Tien-Tsin Wong, and Chi-Sing Leung. 2009. The rhombic dodecahedron map: An efficient scheme for encoding panoramic video. IEEE Transactions on Multimedia 11, 4 (2009), 634--644.
9. Li Li, Bernard D Adelstein, and Stephen R Ellis. 2009. Perception of image motion during head movement. ACM Transactions on Applied Perception (TAP) 6, 1 (2009), 5.
10. King-To Ng, Shing-Chow Chan, and Heung-Yeung Shum. 2005. Data compression and transmission aspects of panoramic videos. IEEE Transactions on Circuits and Systems for Video Technology 15, 1 (2005), 82--95.
11. Yago Sánchez, Robert Skupin, and Thomas Schierl. 2015. Compressed domain video processing for tile based panoramic streaming using HEVC. In Image Processing (ICIP), 2015 IEEE International Conference on. IEEE, 2244--2248.
12. Shu Shi, Cheng-Hsin Hsu, Klara Nahrstedt, and Roy Campbell. 2011. Using graphics rendering contexts to enhance the real-time video coding for mobile cloud gaming. In Proceedings of the 19th ACM international conference on Multimedia. ACM, 103--112.
13. Kashyap Kammachi Sreedhar, Alireza Aminlou, Miska M Hannuksela, and Moncef Gabbouj. 2016. Viewport-Adaptive Encoding and Streaming of 360-Degree Video for Virtual Reality Applications. In Multimedia (ISM), 2016 IEEE International Symposium on. IEEE, 583--586.
14. Zhe Wu and Harsha V Madhyastha. 2013. Understanding the latency benefits of multi-cloud webservice deployments. ACM SIGCOMM Computer Communication Review 43, 2 (2013), 13--20.
15. Shanhe Yi, Cheng Li, and Qun Li. 2015. A survey of fog computing: concepts, applications and issues. In Proceedings of the 2015 Workshop on Mobile Big Data. ACM, 37--42.

Index Terms

• Networks

  • Network types

    • Overlay and other logical network structures

      • World Wide Web (network structure)