skip to main content
10.1145/1450579.1450605acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
research-article

An image-warping VR-architecture: design, implementation and applications

Published: 27 October 2008 Publication History

Abstract

We describe an architecture that provides a programmable display layer in order to allow the execution of custom programs on consecutive display frames. This replaces the default display behavior of repeating application frames until an update is available. The architecture is implemented using a multi-GPU system. We will show three applications of the architecture typical to VR. First, smooth motion is provided by generating intermediate display frames by per-pixel depth-image warping using 3D motion fields. Smooth motion can be beneficial for walk-throughs of large scenes. Second, we implement fine-grained latency reduction at the display frame level using a synchronized prediction of simulation objects and the viewpoint. This improves the average quality and consistency of latency reduction. Third, a crosstalk reduction algorithm for consecutive display frames is implemented, which improves the quality of stereoscopic images.

References

[1]
Bex, P. J., Edgar, G. K., and Smith, A. T. 1995. Multiple images appear when motion energy detection fails. Journal of Experimental Psychology: Human Perception and Performance 21, 231--238.
[2]
Bles, W., and Wertheim, A. 2000. Appropriate use of virtual environments to minimise motion sickness. RTO MP58, 7.1--7.9.
[3]
Cheng, L., Bhushan, A., Pajarola, R., and Zarki, M. E. 2004. Real-time 3d graphics streaming using MPEG-4. In Proc. IEEE/ACM Workshop on Broadband Wireless Services and Applications.
[4]
Farrell, J. E., Pavel, M., and Sperling, G. 1990. The visible persistence of stimuli in stroboscopic motion. Vision Research 30, 6, 921--936.
[5]
Kijima, R., and Ojika, T. 2002. Reflex hmd to compensate lag and correction of derivative deformation. In Proc. IEEE VR, 172.
[6]
Mark, W. R., McMillan, L., and Bishop, G. 1997. Post-rendering 3d warping. In Symposium on Interactive 3D Graphics, 7--16, 180.
[7]
McMillan, L., and Bishop, G. 1995. Plenoptic modeling: An image-based rendering system. Computer Graphics 29, Annual Conference Series, 39--46.
[8]
Mine, M. R. 1993. Characterization of end-to-end delays in head-mounted display systems. Tech. rep.
[9]
Olano, M., Cohen, J., Mine, M., and Bishop, G. 1995. Combatting rendering latency. In Proc. ACM SI3D, 19--ff.
[10]
Popescu, V. S., Lastra, A., Aliaga, D. G., and de Oliveira Neto, M. M. 1998. Efficient warping for architectural walkthroughs using layered depth images. In IEEE Visualization '98, 211--216.
[11]
Shade, J. W., Gortler, S. J., He, L.-W., and Szeliski, R. 1998. Layered depth images. Computer Graphics 32, Annual Conference Series, 231--242.
[12]
Shaw, C., Green, M., Liang, J., and Sun, Y. 1993. Decoupled simulation in virtual reality with the MR toolkit. Information Systems 11, 3, 287--317.
[13]
Smit, F. A., van Liere, R., and Fröhlich, B. 2007. The design and implementation of a vr-architecture for smooth motion. In Proc. ACM VRST, 153--156.
[14]
Smit, F., van Liere, R., and Froehlich, B. 2007. Non-uniform crosstalk reduction for dynamic scenes. In Proc. IEEE Virtual Reality, March 2007, 139--146.
[15]
Smit, F., van Liere, R., and Froehlich, B. 2007. Three extensions to subtractive crosstalk reduction. In Proc. Eurographics EGVE, 85--92.
[16]
Springer, J. P., Beck, S., Weiszig, F., Reiners, D., and Froehlich, B. 2007. Multi-frame rate rendering and display. In Proc. IEEE VR, 195--202.
[17]
Stewart, J., Bennett, E. P., and McMillan, L. 2004. Pixelview: a view-independent graphics rendering architecture. In Proc. ACM HWWS, 75--84.
[18]
Wallach, D. S., Kunapalli, S., and Cohen, M. F. 1994. Accelerated MPEG compression of dynamic polygonal scenes. Computer Graphics 28, 193--196.
[19]
Woods, A. J., and Tan, S. S. 2002. Characteristic sources of ghosting in time-sequential stereoscopic video displays. In Proc. SPIE Vol. 4660, 66--77.

Cited By

View all
  • (2023)Towards an Evolved Immersive Experience: Exploring 5G- and Beyond-Enabled Ultra-Low-Latency Communications for Augmented and Virtual RealitySensors10.3390/s2307368223:7(3682)Online publication date: 2-Apr-2023
  • (2021)OpenUVR: an Open-Source System Framework for Untethered Virtual Reality Applications2021 IEEE 27th Real-Time and Embedded Technology and Applications Symposium (RTAS)10.1109/RTAS52030.2021.00026(223-236)Online publication date: May-2021
  • (2019)Selective Timewarp Based on Embedded Motion Vectors for Interactive Cloud Virtual RealityIEEE Access10.1109/ACCESS.2018.28887007(3031-3045)Online publication date: 2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '08: Proceedings of the 2008 ACM symposium on Virtual reality software and technology
October 2008
288 pages
ISBN:9781595939517
DOI:10.1145/1450579
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. VR
  2. crosstalk
  3. image-warping
  4. judder
  5. latency
  6. motion
  7. stereoscopic display

Qualifiers

  • Research-article

Conference

VRST08

Acceptance Rates

VRST '08 Paper Acceptance Rate 12 of 68 submissions, 18%;
Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)19
  • Downloads (Last 6 weeks)0
Reflects downloads up to 22 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Towards an Evolved Immersive Experience: Exploring 5G- and Beyond-Enabled Ultra-Low-Latency Communications for Augmented and Virtual RealitySensors10.3390/s2307368223:7(3682)Online publication date: 2-Apr-2023
  • (2021)OpenUVR: an Open-Source System Framework for Untethered Virtual Reality Applications2021 IEEE 27th Real-Time and Embedded Technology and Applications Symposium (RTAS)10.1109/RTAS52030.2021.00026(223-236)Online publication date: May-2021
  • (2019)Selective Timewarp Based on Embedded Motion Vectors for Interactive Cloud Virtual RealityIEEE Access10.1109/ACCESS.2018.28887007(3031-3045)Online publication date: 2019
  • (2017)Makeup LampsComputer Graphics Forum10.5555/3128975.312900436:2(311-323)Online publication date: 1-May-2017
  • (2017)Makeup Lamps: Live Augmentation of Human Faces via ProjectionComputer Graphics Forum10.1111/cgf.1312836:2(311-323)Online publication date: 23-May-2017
  • (2017)Motion CapturingWeb-basierte Anwendungen Virtueller Techniken10.1007/978-3-662-52956-0_5(219-262)Online publication date: 7-Apr-2017
  • (2016)The asynchronous time warp for virtual reality on consumer hardwareProceedings of the 22nd ACM Conference on Virtual Reality Software and Technology10.1145/2993369.2993375(37-46)Online publication date: 2-Nov-2016
  • (2016)Laplacian VisionProceedings of the 7th Augmented Human International Conference 201610.1145/2875194.2875227(1-8)Online publication date: 25-Feb-2016
  • (2016)From Motion to Photons in 80 Microseconds: Towards Minimal Latency for Virtual and Augmented RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2016.251803822:4(1367-1376)Online publication date: 21-Apr-2016
  • (2014)Image warping for enhancing consumer applications of head-mounted displaysProceedings of the Fifteenth Australasian User Interface Conference - Volume 15010.5555/2667657.2667663(47-55)Online publication date: 20-Jan-2014
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media