skip to main content
10.1145/1077534.1077557acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
Article

Modeling and rendering of walkthrough environments with panoramic images

Published: 10 November 2004 Publication History

Abstract

An important, potential application of image-based techniques is to create photo-realistic image-based environments for interactive walkthrough. However, existing image-based studies are based on different assumptions with different focuses. There is a lack of a general framework or architecture for evaluation and development of a practical image-based system. In this paper, we propose an architecture to unify different image-based methods. Based on the architecture, we propose an image-based system to support interactive walkthrough of scalable environments. In particular, we introduce the concept of angular range, which is useful for designing a scalable configuration, recovering geometric proxy as well as rendering. We also propose a new method to recover geometry information even from outdoor scenes and a new rendering method to address the problem of abrupt visual changes in a scalable environment.

References

[1]
E. Adelson and J. Bergen, "Chapter 1: The Plenoptic Function and the Elements of Early Vision," Computational Models of Visual Processing, Landy and Movshon (Eds), MIT Press, 1991.]]
[2]
D. Aliaga and I. Carlbom, "Plenoptic Stitching: A Scalable Method for Reconstructing 3D Interactive Walkthroughs," Proc. ACM SIGGRAPH, pp. 443--450, 2001.]]
[3]
Y. Altunbasak and A. Tekalp, "Occlusion-Adaptive, Content-Based Mesh Design and Forward Tracking," IEEE Trans. on Image Processing, 6(9), 1997.]]
[4]
C. Buehler, M. Bosse, L. McMillan et al., "Unstructured Lumigraph Rendering," Proc. ACM SIGGRAPH, 2001.]]
[5]
J. Chai, X. Tong, S. Chan, and H. Shum. "Plenoptic Sampling," Proc. ACM SIGGRAPH, pp. 307--318, 2000.]]
[6]
E. Chen, "QuickTime VR: An Image-based Approach to Virtual Environment Navigation," Proc. ACM SIGGRAPH, 1995.]]
[7]
K. Cornelis, M. Pollefeys, and L. van Gool, "Tracking Based Structure and Motion Recovery for Augmented Video Productions," Proc. of ACM VRST, pp. 17--24, Nov. 2001.]]
[8]
P. Debevec, G. Borshukov, and Y. Yu. "Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping," Proc. of EG Rendering Workshop, 1998.]]
[9]
O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint, MIT Press, 1993.]]
[10]
O. Faugeras, L. Robert, S. Laveau, G. Csurka, C. Zeller, C. Gauclin, and I. Zoghlami, "3-D Reconstruction of Urban Scenes from Image Sequences," CVIU, 69(3):292--309, 1998.]]
[11]
S. Gortler, R. Gizeszczuk, R. Szeliski, and M. Cohen, "The Lumigraph," Proc. of ACM SIGGRAPH, 1996.]]
[12]
R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, 2000.]]
[13]
M. Levoy and P. Hanrahan, "Light Field Rendering," Proc. of ACM SIGGRAPH, pp. 31--42, 1996.]]
[14]
M. Lhuillier and L. Quan, "Image Interpolation by Joint View Triangulation," Proc. of CVPR, 2, pp. 139--145, 1999.]]
[15]
L. McMillan and G. Bishop, "Plenoptic Modelling: An Image-based Rendering System," Proc. ACM SIGGRAPH, pp. 39--46, 1995.]]
[16]
W. Niem and R. Bushmann, "Automatic Modelling of 3D Natural Objects from Multiple Views," Image Processing for Broadcast and Video Production, Springer-Verlag, 1994.]]
[17]
S. Roy and I. Cox, "A Maximum-flow Formulation of the N-Camera Stereo Correspondence Problem," Proc. ICCV, 1998.]]
[18]
H. Shum, A. Kalai, and S. Seitz, "Omnivergent Stereo," Proc. ICCV, pp. 22--29, 1999.]]
[19]
A. Siu and R. W. H. Lau, "Relief Occlusion-Adaptive Meshes for 3D Imaging," Proc. ICME, pp. 101--104, 2003.]]
[20]
A. Siu and R. W. H. Lau, "Image Registration for Image-based Rendering," IEEE Trans. on Image Processing (to appear).]]
[21]
M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis, and Machine Vision, PWS, 1998.]]
[22]
J. Sun, H. Shum, and N. Zheng, "Stereo Matching using Belief Propagation," IEEE Trans. on PAMI, 2003.]]
[23]
P. Torr, A Fitzgibbon, and A. Zisserman, "Maintaining Multiple Motion Model Hypotheses over Many Views to Recover Matching and Structure," Proc. of ICCV, p.727--732, 1998.]]
[24]
A. Wan, A. Siu, and R. W. H. Lau, "Recovering Camera Pose from Omni-directional Images," Proc. BMVC (to appear), 2004.]]

Cited By

View all
  • (2021)Instant Panoramic Texture Mapping with Semantic Object Matching for Large-Scale Urban Scene ReproductionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.306776827:5(2746-2756)Online publication date: May-2021
  • (2014)Virtual cubic panorama synthesis based on triangular reprojectionComputer Animation and Virtual Worlds10.1002/cav.154125:2(143-154)Online publication date: 1-Mar-2014
  • (2006)Educative visuals - digital delivery of architectural information for (potential) heritage buildingsProceedings of the 7th International conference on Virtual Reality, Archaeology and Intelligent Cultural Heritage10.5555/2384301.2384315(91-99)Online publication date: 30-Oct-2006
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '04: Proceedings of the ACM symposium on Virtual reality software and technology
November 2004
226 pages
ISBN:1581139071
DOI:10.1145/1077534
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 November 2004

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D reconstruction
  2. geometric proxy
  3. image-based methods
  4. image-based modeling
  5. image-based rendering

Qualifiers

  • Article

Conference

VRST04

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)1
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Instant Panoramic Texture Mapping with Semantic Object Matching for Large-Scale Urban Scene ReproductionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.306776827:5(2746-2756)Online publication date: May-2021
  • (2014)Virtual cubic panorama synthesis based on triangular reprojectionComputer Animation and Virtual Worlds10.1002/cav.154125:2(143-154)Online publication date: 1-Mar-2014
  • (2006)Educative visuals - digital delivery of architectural information for (potential) heritage buildingsProceedings of the 7th International conference on Virtual Reality, Archaeology and Intelligent Cultural Heritage10.5555/2384301.2384315(91-99)Online publication date: 30-Oct-2006
  • (2006)Scanning Scene Tunnel for City TraversingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2006.3712:2(155-167)Online publication date: 1-Mar-2006

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media