Eduardo Cuervo
Krishna Chintalapudi
ABSTRACT
As Virtual Reality (VR) Head Mounted Displays (HMD) push the boundaries of technology, in this paper, we try and answer the question, "What would it take to make the visual experience of a VR-HMD Life-Like, i.e., indistinguishable from physical reality?" Based on the limits of human perception, we first try and establish the specifications for a Life-Like HMD. We then examine crucial technological trends and speculate on the feasibility of Life-Like VR headsets in the near future. Our study indicates that while display technology will be capable of Life-Like VR, rendering computation is likely to be the key bottleneck. Life-Like VR solutions will likely involve frames rendered on a separate machine and then transmitted to the HMD. Can we transmit Life-Like VR frames wirelessly to the HMD and make the HMD cable-free? We find that current wireless and compression technology may not be sufficient to accommodate the bandwidth and latency requirements. We outline research directions towards achieving Life-Like VR.
- Ranovus announces availability of world's first 200g cfp2 direct detect optical transceiver to enable 38.4 terabits per data center interconnect rack. http://ranovus.com/.Google Scholar
- Visual acuity. https://en.wikipedia.org/wiki/Visual_acuity.Google Scholar
- Abari, O., Bharadia, D., Duffield, A., and Katabi, D. Enabling high-quality untethered virtual reality.Google Scholar
- Abrash, M. Latency, the sine qua non of ar and vr. http://blogs.valvesoftware.com/abrash/latency-the-sine-qua-non-of-ar-and-vr/.Google Scholar
- Abrash, M. Down the vr rabbit hole: Fixing judder. http://blogs.valvesoftware.com/abrash/down-the-vr-rabbit-hole-fixing-judder/, July 2013.Google Scholar
- Andersen, S. R. The history of the ophthalmological society of copenhagen 1900--50. Acta Ophthalmologica 80, s234 (2002), 6--17.Google ScholarCross Ref
- Beeler, D., Hutchins, E., and Pedriana, P. Asynchronous spacewarp. https://developer.oculus.com/blog/asynchronous-spacewarp/.Google Scholar
- Boitard, R., Mantiuk, R. K., and Pouli, T. Evaluation of color encodings for high dynamic range pixels. In Proceedings Volume 9394, Human Vision and Electronic Imaging (2015).Google Scholar
- Bomb, G. How long is your average gaming session? https://www.giantbomb.com/forums/general-discussion-30/how-long-is-your-average-gaming-session-1438129/.Google Scholar
- Boos, K., Chu, D., and Cuervo, E. Flashback: Immersive virtual reality on mobile devices via rendering memoization. In Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services (2016), ACM, pp. 291--304. Google ScholarDigital Library
- Britannica. Sensory reception: Human vision: Structure and function of the human eye, 1987.Google Scholar
- Carney, T., and Klien, S. Resolution acuity is better than vernier acuity. Vision Research 37, 5 (1997), 525--539.Google ScholarCross Ref
- Committee, V. F. Visual acuity measurement standard. May 2015.Google Scholar
- Cuervo, E., Balasubramanian, A., Cho, D.-k., Wolman, A., Saroiu, S., Chandra, R., and Bahl, P. Maui: Making smartphones last longer with code offload. In MobiSys 2010 (2010). Google ScholarDigital Library
- Cuervo, E., and Chu, D. Poster: Mobile virtual reality for head-mounted displays with interactive streaming video and likelihood-based foveation. In Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services Companion (2016), ACM, pp. 130--130. Google ScholarDigital Library
- Cuervo, E., et al. Kahawai: High-quality mobile gaming using gpu offload. In MobiSys (May 2015). Google ScholarDigital Library
- Cui, Y., Xiao, S., Wang, X., Yang, Z., Yan, S., Zhu, C., Li, X.-Y., and Ge, N. Diamond: Nesting the data center network with wireless rings in 3-d space. IEEE/ACM Transactions on Networking (2017).Google Scholar
- Curran, M., Rahman, M. S., Gupta, H., Zheng, K., Longtin, J., Das, S. R., and Mohamed, T. Fsonet: A wireless backhaul for multi-gigabit picocells using steerable free space optics. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking (New York, NY, USA, 2017), MobiCom '17, ACM, pp. 154--166. Google ScholarDigital Library
- EIZO. Focus on the foris fg2421. http://gaming.eizo.com/news/the-gaming-monitor-weve-all-been-waiting-for/, June 2014.Google Scholar
- Guenter, B., Finch, M., Drucker, S., Tan, D., and Snyder, J. Foveated 3d graphics. ACM Trans. Graph. 31, 6 (Nov. 2012), 164:1--164:10. Google ScholarDigital Library
- Hamedazimi, N., Qazi, Z., Gupta, H., Sekar, V., Das, S. R., Longtin, J. P., Shah, H., and Tanwer, A. Firefly: A reconfigurable wireless data center fabric using free-space optics. In ACM SIGCOMM Computer Communication Review (2014), vol. 44, ACM, pp. 319--330. Google ScholarDigital Library
- Hansen, C. J. Wigig: Multi-gigabit wireless communications in the 60 ghz band. IEEE Wireless Communications 18, 6 (2011).Google ScholarCross Ref
- Hruska, J. Lg new 440 ppi display is way too much of a good thing. https://www.extremetech.com/computing/130051-lgs-new-440-ppi-display-is-way-too-much-of-a-good-thing, May 2012.Google Scholar
- HTC. Htc vive. https://www.htcvive.com/us/, Apr. 2016.Google Scholar
- IEEE. International roadmap for devices and systems 2016, more moore white paper. https://irds.ieee.org/images/files/pdf/2016_MM.pdf.Google Scholar
- Lang, B. Nvidia demonstrates experimental zero latency display running at 1,700hz. https://www.roadtovr.com/nvidia-demonstrates-experimental-zero-latency-display-running-at-17000hz/.Google Scholar
- Larsen, R. Review: Samsung 2233rz: First 120hz and 3d-monitor. http://www.flatpanelshd.com/review.php'subaction=showfull&id=1239184512, May 2009.Google Scholar
- LaValle, S. M., Yershova, A., Katsev, M., and Antonov, M. Head tracking for the oculus rift. In Robotics and Automation (ICRA), 2014 IEEE International Conference on (2014), IEEE, pp. 187--194.Google ScholarCross Ref
- Mark, W. R., McMillan, L., and Bishop, G. Post-rendering 3d warping. In Proceedings of the 1997 Symposium on Interactive 3D Graphics (New York, NY, USA, 1997), I3D '97, ACM, pp. 7--ff. Google ScholarDigital Library
- Moore, S. T., Hirasaki, E., Raphan, T., and Cohen, B. The human vestibulo-ocular reflex during linear locomotion. Annals of the New York Academy of Sciences 942, 1 (2001), 139--147.Google Scholar
- Patney, A., Salvi, M., Kim, J., Kaplanyan, A., Wyman, C., Benty, N., Luebke, D., and Lefohn, A. Towards foveated rendering for gaze-tracked virtual reality. ACM Transactions on Graphics (TOG) 35, 6 (2016), 179. Google ScholarDigital Library
- Purves, D., Augustine, G., Fitzpatrick, D., et al. Neuroscience. 2nd edition. https://www.ncbi.nlm.nih.gov/books/NBK10991/, 2001. Types of Eye Movements and Their Functions.Google Scholar
- Reed, B. Lg new 440 ppi display is way too much of a good thing. http://bgr.com/2013/08/21/lg-display-538-ppi/, May 2012.Google Scholar
- Reinert, B., Kopf, J., Ritschel, T., Cuervo, E., Chu, D., and Seidel, H.-P. Proxy-guided image-based rendering for mobile devices. Computer Graphics Forum 35, 7 (2016), 353--362. Google ScholarDigital Library
- Sony. Xperia z5 premium. https://www.sonymobile.com/global-en/products/phones/xperia-z5-premium/.Google Scholar
- StarVR. Starvr. https://www.starvr.com/, July 2013.Google Scholar
- Sullivan, G., and Ohm, J.-R. Meeting report of the 13th meeting of the joint collaborative team on video coding (jct-vc). http://phenix.it-sudparis.eu/jct/doc_end_user/current_document.php?id=7746.Google Scholar
- Technology, P. Pimax 8k. https://www.pimaxvr.com/en/8k/.Google Scholar
- TPCast. Tpcast vive. https://www.tpcastvr.com/.Google Scholar
- https://www.oculus.com/en-us/rift/. Oculus rift, Mar. 2016.Google Scholar
- Valve, H. Vive pro. https://www.vive.com/us/product/vive-pro/.Google Scholar
- VR, F. Fove 0 eye tracking vr devkit. https://www.getfove.com/.Google Scholar
- Walls, F., and MacInnis, S. Vesa display stream compression. http://www.vesa.org/wp-content/uploads/2014/04/VESA_DSC-ETP200.pdf.Google Scholar
- WirelessHD. Wirelesshd. https://www.wirelesshd.org/.Google Scholar
- Yokoyama, K., Hirasa, S., Miyairi, N., Dozen, Y., Sasaki, T., Jimbo, Y., Toyotaka, K., Kaneyasu, M., Miyake, H., Seo, S., et al. Ultra-high-resolution 1058-ppi oled displays with 2.78-in size using caac-igzo fets with tandem oled device and single oled device. Journal of the Society for Information Display 24, 3 (2016), 159--167.Google ScholarCross Ref
- Zisworks. Zisworks zws 480hz: Engineering sample purchase. http://www.zisworks.com/shop.html, 2017 Aug.Google Scholar
Index Terms
- Creating the Perfect Illusion: What will it take to Create Life-Like Virtual Reality Headsets?
Recommendations
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...
Using Perceptual Illusions for Redirected Walking
Redirected walking (RDW) gives users the ability to explore a virtual world by walking in a confined physical space. It inconspicuously guides them on a physical path that might differ from the path they perceive in the virtual world. Exploiting three ...
Beaming: An Asymmetric Telepresence System
The Beaming project recreates, virtually, a real environment; using immersive VR, remote participants can visit the virtual model and interact with the people in the real environment. The real environment doesn't need extensive equipment and can be a ...
Comments