Abstract
Zoomable video streaming refers to a new class of interactive video applications, where users can zoom into a video stream to view a selected region of interest in higher resolutions and pan around to move the region of interest. The zoom and pan effects are typically achieved by breaking the source video into a grid of independently decodable tiles. Streaming the tiles to a set of heterogeneous users using broadcast is challenging, as users have different link rates and different regions of interest at different resolution levels. In this article, we consider the following problem: Given the subset of tiles that each user requested, the link rate of each user, and the available time slots, at which resolution should each tile be sent, to maximize the overall video quality received by all users. We design an efficient algorithm to solve this problem and evaluate the solution on a testbed using 10 mobile devices. Our method is able to achieve up to 12dB improvements over other heuristic methods.
- IEEE 802.11-2007. 2007. Wireless LAN medium access control (MAC) and physical layer (PHY) specifications. IEEE 802.11 LAN Standards 2007.Google Scholar
- John Charles Bicket. 2005. Bit-rate selection in wireless networks. Ph.D. dissertation, Massachusetts Institute of Technology.Google Scholar
- Ranveer Chandra, Sandeep Karanth, Thomas Moscibroda, Vishnu Navda, Jitendra Padhye, Ramachandran Ramjee, and Lenin Ravindranath. 2009. Dircast: A practical and efficient wi-fi multicast system. In Proceedings of the 17th IEEE International Conference on Network Protocols (ICNP). IEEE, 161--170. Google ScholarDigital Library
- Philip A. Chou and Zhourong Miao. 2006. Rate-distortion optimized streaming of packetized media. IEEE Trans. Multimed. 8, 2, 390--404. Google ScholarDigital Library
- Supratim Deb, Sharad Jaiswal, and Kanthi Nagaraj. 2008. Real-time video multicast in WiMAX networks. In Proceedings of the 27th IEEE International Conference on Computer Communications (INFOCOM). IEEE.Google ScholarCross Ref
- Wu-chi Feng, Thanh Dang, John Kassebaum, and Tim Bauman. 2011. Supporting region-of-interest cropping through constrained compression. ACM Trans. Multimed. Comput. Commun. Appl. 7, 3, 17. Google ScholarDigital Library
- George A. Gescheider. 1997. Psychophysics: The Fundamentals. Psychology Press.Google Scholar
- Sherif Halawa, Derek Pang, Ngai-Man Cheung, and Bernd Girod. 2011. ClassX: An open source interactive lecture StreamingSystem. In Proceedings of the 19th ACM International Conference on Multimedia. (AZ). ACM, 719--722. Google ScholarDigital Library
- Eddie Kohler, Robert Morris, Benjie Chen, John Jannotti, and M. Frans Kaashoek. 2000. The Click modular router. ACM Trans. Comput. Syst. 18, 3, 263--297. Google ScholarDigital Library
- Peilong Li, Honghai Zhang, Baohua Zhao, and Sampath Rangarajan. 2009. Scalable video multicast in multi-carrier wireless data systems. In Proceedings of the 17th IEEE International Conference on Network Protocols (ICNP). IEEE, N.J., 141--150. Google ScholarDigital Library
- Peilong Li, Honghai Zhang, Baohua Zhao, and Sampath Rangarajan. 2010. Scalable video multicast with joint layer resource allocation in broadband wireless networks. In Proceedings of the 18th IEEE International Conference on Network Protocols (ICNP). IEEE, 295--304. Google ScholarDigital Library
- Jiangchuan Liu, Bo Li, and Ya-Qin Zhang. 2003. Adaptive video multicast over the Internet. IEEE MultiMedia 10, 1, 22--33. Google ScholarDigital Library
- Aditya Mavlankar, Piyush Agrawal, Derek Pang, Sherif Halawa, Ngai-Man Cheung, and Bernd Girod. 2010. An interactive region-of-interest video streaming system for online lecture viewing. In Proceedings of the 18th International Packet Video Workshop (PV). IEEE, 64--71.Google ScholarCross Ref
- Aditya Mavlankar, Pierpaolo Baccichet, David Varodayan, and Bernd Girod. 2007a. Optimal slice size for streaming regions of high resolution video with virtual pan/tilt/zoom functionality. In Proceedings of 15th European Signal Processing Conference (EUSIPCO).Google Scholar
- Aditya Mavlankar, David Varodayan, and Bernd Girod. 2007b. Region-of-interest prediction for interactively streaming regions of high resolution video. In Proceedings of Packet Video 2007. IEEE, 68--77.Google ScholarCross Ref
- Ioannis Pefkianakis, S. Wong, Hao Yang, S. Lee, and Songwu Lu. 2013. Towards history-aware robust 802.11 rate adaptation. IEEE Trans. Mobile Comput. 12, 3, 502--515. Google ScholarDigital Library
- Kandaraj Piamrat, Adlen Ksentini, J.-M. Bonnin, and César Viho. 2009. Q-DRAM: QoE-based dynamic rate adaptation mechanism for multicast in wireless networks. In Proceedings of the Global Telecommunications Conference (GLOBECOM'09). 1--6. Google ScholarDigital Library
- Ngo Quang Minh Khiem, Guntur Ravindra, Axel Carlier, and Wei Tsang Ooi. 2010. Supporting zoomable video streams with dynamic region-of-interest cropping. In Proceedings of the 1st Annual ACM SIGMM Conference on Multimedia Systems. (AZ). ACM, 259--270. Google ScholarDigital Library
- Ngo Quang Minh Khiem, Guntur Ravindra, and Wei Tsang Ooi. 2011. Adaptive encoding of zoomable video streams based on user access pattern. In Proceedings of the 2nd Annual ACM Conference on Multimedia systems. (A). ACM, 211--222. Google ScholarDigital Library
- Sayandeep Sen, Neel Kamal Madabhushi, and Suman Banerjee. 2010. Scalable WiFi media delivery through adaptive broadcasts. In Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation (NSDI). USENIX Association, 13. Google ScholarDigital Library
- Arash Shafiei, Quang Minh Khiem Ngo, Ravindra Guntur, Mukesh Kumar Saini, Cong Pang, and Wei Tsang Ooi. 2012. Jiku live: A live zoomable video streaming system. In Proceedings of the 20th ACM International Conference on Multimedia. ACM, 1265--1266. Google ScholarDigital Library
- Ray van Brandenburg, Omar Niamut, Martin Prins, and Hans Stokking. 2011. Spatial segmentation for immersive media delivery. In Proceedings of the 15th International Conference on Intelligence in Next Generation Networks (ICIN). IEEE, 151--156.Google ScholarCross Ref
- Hui Wang, Vu-Thanh Nguyen, Wei Tsang Ooi, and Mun Choon Chan. 2014. Mixing tile resolutions in tiled video: A perceptual quality assessment. In Proceedings of Network and Operating System Support on Digital Audio and Video Workshop (NOSSDAV). 25--30. Google ScholarDigital Library
- Starsky H. Y. Wong, Ramya Raghavendra, Yang Song, and Kang-Won Lee. 2013. X-WING: A high-speed wireless broadcasting framework for IEEE 802.11 networks. In Proceedings of the 10th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON). IEEE, 344--352.Google ScholarCross Ref
- Starsky H. Y. Wong, Hao Yang, Songwu Lu, and Vaduvur Bharghavan. 2006. Robust rate adaptation for 802.11 wireless networks. In Proceedings of the 12th ACM Annual International Conference on Mobile Computing and Networking. 146--157. Google ScholarDigital Library
- Jongwon Yoon, Honghai Zhang, Suman Banerjee, and Sampath Rangarajan. 2012. MuVi: A multicast video delivery scheme for 4G cellular networks. In Proceedings of the 18th ACM Annual International Conference on Mobile Computing and Networking (MobiCom). 209--220. Google ScholarDigital Library
Index Terms
- Wireless Multicast for Zoomable Video Streaming
Recommendations
On tile assignment for region-of-interest video streaming in a wireless LAN
NOSSDAV '12: Proceedings of the 22nd international workshop on Network and Operating System Support for Digital Audio and VideoWe consider the following problem in this paper: A video is encoded as a set of tiles T and is streamed to multiple users via a one-hop wireless LAN. Each user selects a region-of-interest (RoI), represented as a subset of T, in the video to watch. The ...
Adaptive encoding of zoomable video streams based on user access pattern
Zoomable video allows users to selectively zoom and pan into regions of interest within the video for viewing at higher resolutions. Such interaction requires dynamic cropping of RoIs on the source video. We have previously explored two different ways ...
Towards understanding user tolerance to network latency in zoomable video streaming
MM '11: Proceedings of the 19th ACM international conference on MultimediaWe conducted a user study with 35 participants viewing 5 video clips to understand user tolerance to network latency when zooming and panning in zoomable video streams. With zooming or panning, unseen spatial regions in a frame are revealed and ...
Comments