Ruiguang Zhong
ABSTRACT
All existing high-quality virtual reality (VR) systems (e.g., HTC Vive and Oculus Rift) are tethered, requiring an HDMI cable to connect the head mounted display (HMD) to a PC for rendering rich graphic contents. Such a tethered design not only limits user mobility but also imposes hazards to users. To get rid of the cable, "cable replacement" solutions have been proposed but without any programmability at the HMD side. In this paper, we explore how to build a programmable wireless high-quality VR system using commodity hardware. With programmability at both the PC side and the HMD side, our system provides extensibility and flexibility for exploring various new ideas and software-based techniques in high-quality VR. We present our system design, describe challenges, explore possible solutions to cut the wire, and compare the performance of different approaches for transmitting the high-volume graphics data over a wireless link. We share our experience and report preliminary findings. Experimental results show that building a wireless high-quality VR system is very challenging, and needs extensive effort on both the software and hardware sides in order to meet the performance requirements.
- 60 GHz: Taking the VR Experience to the Next Level. http://www.sibeam.com/en/Blogs/2016/March/60GHZTakingtheVRExperience.aspx.Google Scholar
- CUDA Toolkit. https://developer.nvidia.com/cuda-toolkit.Google Scholar
- Dell Wireless Dock. http://www.dell.com/en-us/shop/accessories/apd/452-bbux?sku=452-BBUX.Google Scholar
- Google Cardboard. https://vr.google.com/cardboard/.Google Scholar
- GPUDirect RDMA. http://docs.nvidia.com/cuda/gpudirect-rdma/index.html.Google Scholar
- HTC Vive. https://www.vive.com/.Google Scholar
- HTC Vive TPCAST wireless upgrade kit. https://www.vive.com/cn/accessory/tpcast/.Google Scholar
- Intel Tri-Band Wireless-AC 17265. https://www.intel.com/content/www/us/en/wireless-products/tri-band-wireless-ac-17265.html.Google Scholar
- Microsoft Remote Desktop Clients. https://technet.microsoft.com/en-us/library/dn473009(v=ws.11).aspx.Google Scholar
- Oculus Rift. https://www.oculus.com/rift/.Google Scholar
- Optoma's wireless VR headset frees you from PC cables. http://www.pcworld.com/article/3044542/virtual-reality/optomas-new-wireless-vr-headset-frees-you-from-pc-cables.html.Google Scholar
- RealVNC: Remote Access Software for Desktop and Mobile. https://www.realvnc.com/.Google Scholar
- Samsung Gear VR. http://www.samsung.com/global/galaxy/gear-vr/.Google Scholar
- The Lab VR game. http://store.steampowered.com/app/450390/.Google Scholar
- The NVIDIA Video Codes SDK. https://developer.nvidia.com/nvidia-video-codec-sdk.Google Scholar
- Wireless gigabit Alliance. http://www.wigig.org/.Google Scholar
- WirelessHD. http://www.wirelesshd.org/.Google Scholar
- O. Abari, D. Bharadia, A. Duffield, and D. Katabi. Enabling high-quality untethered virtual reality. In Proceedings of the NSDI'17, 2017.Google ScholarDigital Library
- O. Abari, H. Hassanieh, M. Rodriguez, and D. Katabi. Millimeter wave communications: From point-to-point links to agile network connections. In Proceedings of the HotNets'16, 2016. Google ScholarDigital Library
- K. Boos, D. Chu, and E. Cuervo. Flashback: Immersive virtual reality on mobile devices via rendering memoization. In Proceedings of the MobiSys'16, 2016. Google ScholarDigital Library
- E. Cuervoy, A. Wolmany, L. P. Coxz, K. Lebeck, A. Razeenz, S. Saroiuy, and M. Musuvathi. Kahawai: High-quality mobile gaming using gpu offload. In Proceedings of the MobiSys'15, 2015. Google ScholarDigital Library
- S. Kato, J. Aumiller, and S. Brandt. Zero-copy i/o processing for low-latency gpu computing. In Proceedings of the ICCPS'13, 2013. Google ScholarDigital Library
- K. Lee, D. Chu, E. Cuervo, J. Kopf, Y. Degtyarev, S. Grizan, A. Wolman, and J. Flinn. Outatime: Using speculation to enable low-latency continuous interaction for cloud gaming. In Proceedings of the MobiSys'15, 2015. Google ScholarDigital Library
- T. Nitsche, A. B. Flores, E. W. Knightly, and J. Widmer. Steering with eyes closed: Mm-wave beam steering without in-band measurement. In Proceedings of the INFOCOM'15, 2015. Google ScholarCross Ref
- M. E. Rasekh, Z. Marzi, Y. Zhu, U. Madhow, and H. Zheng. Noncoherent mmwave path tracking. In Proceedings of the HotMobile'17, 2017. Google ScholarDigital Library
- S. Sur, X. Zhang, P. Ramanathan, and R. Chandra. Beamspy: Enabling robust 60 ghz links under blockage. In Proceedings of the NSDI'16, 2016.Google Scholar
Recommendations
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User InteractionTwo major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Building and Employing Cross-Reality
This issue's Works in Progress department lists five projects with a focus on cross reality. The first two involve using Project Wonderland for collaborative projects. The next three use virtual and augmented reality to enhance user capabilities and ...
Virtual Fieldwork: Designing Augmented Reality Applications Using Virtual Reality Worlds
Virtual, Augmented and Mixed RealityAbstractAR technology continues to develop and is expected to be used in a much wider range of fields. However, existing head-mounted displays for AR are still inadequate for use in daily life. Therefore, we focused on using VR to develop AR services and ...
Comments