research-article

Finding paths through the world's photos

Authors:

Steven M. Seitz,

Richard SzeliskiAuthors Info & Claims

SIGGRAPH '08: ACM SIGGRAPH 2008 papers

Article No.: 15, Pages 1 - 11

https://doi.org/10.1145/1399504.1360614

Published: 01 August 2008 Publication History

Abstract

When a scene is photographed many times by different people, the viewpoints often cluster along certain paths. These paths are largely specific to the scene being photographed, and follow interesting regions and viewpoints. We seek to discover a range of such paths and turn them into controls for image-based rendering. Our approach takes as input a large set of community or personal photos, reconstructs camera viewpoints, and automatically computes orbits, panoramas, canonical views, and optimal paths between views. The scene can then be interactively browsed in 3D using these controls or with six degree-of-freedom free-viewpoint control. As the user browses the scene, nearby views are continuously selected and transformed, using control-adaptive reprojection techniques.

Supplementary Material

FLV File (12.flv)

Download
105.20 MB

MOV File (a15-snavely.mov)

Download
56.63 MB

References

[1]

Aliaga, D. G., and Carlbom, I. 2001. Plenoptic stitching: A scalable method for reconstructing 3D interactive walkthroughs. In SIGGRAPH Conf. Proc., 443--450.

Digital Library

[2]

Bookstein, F. L. 1989. Principal warps: Thin-plate splines and the decomposition of deformations. IEEE Trans. on Pattern Analysis and Machine Intelligence 11, 6, 567--585.

Digital Library

[3]

Buehler, C., Bosse, M., McMillan, L., Gortler, S., and Cohen, M. 2001. Unstructured lumigraph rendering. In SIGGRAPH Conf. Proc., 425--432.

Digital Library

[4]

Chen, S., and Williams, L. 1993. View interpolation for image synthesis. In SIGGRAPH Conf. Proc., 279--288.

Digital Library

[5]

Chen, S. E. 1995. QuickTime VR - an image-based approach to virtual environment navigation. In SIGGRAPH Conf. Proc., 29--38.

Digital Library

[6]

Debevec, P. E., Taylor, C. J., and Malik, J. 1996. Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In SIGGRAPH Conf. Proc., 11--20.

Digital Library

[7]

Drucker, S. M., and Zeltzer, D. 1994. Intelligent camera control in a virtual environment. In Proc. of Graphics Interface, 190--199.

[8]

Epshtien, B., Ofek, E., Wexler, Y., and Zhang, P. 2007. Hierarchical photo organization using geometric relevance. In ACM Int. Symp. on Advances in Geographic Information Systems.

Digital Library

[9]

Fischler, M., and Bolles, R. 1987. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Readings in computer vision: issues, problems, principles, and paradigms, 726--740.

Digital Library

[10]

Galyean, T. A. 1995. Guided navigation of virtual environments. In SI3D '95: Proc. Symposium on Interactive 3D Graphics, 103--104.

Digital Library

[11]

Goesele, M., Snavely, N., Seitz, S. M., Curless, B., and Hoppe, H. 2007. Multi-view stereo for community photo collections. In Proc. Int. Conf. on Computer Vision.

[12]

Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The lumigraph. In SIGGRAPH Conf. Proc., 43--54.

Digital Library

[13]

Kanade, T., 2001. Carnegie Mellon goes to the Superbowl. http://www.ri.cmu.edu/events/sb35/tksuperbowl.html.

[14]

Kang, S. B., Sloan, P.-P., and Seitz, S. M. 2000. Visual tunnel analysis for visibility prediction and camera planning. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 2195--2202.

[15]

Levoy, M., and Hanrahan, P. 1996. Light field rendering. In SIGGRAPH Conf. Proc., 31--42.

Digital Library

[16]

Lippman, A. 1980. Movie maps: An application of the optical videodisc to computer graphics. In SIGGRAPH Conf. Proc., 32--43.

Digital Library

[17]

Lowe, D. 2004. Distinctive image features from scale-invariant keypoints. Int. J. of Computer Vision 60, 2, 91--110.

Digital Library

[18]

McMillan, L., and Bishop, G. 1995. Plenoptic modeling: An image-based rendering system. In SIGGRAPH Conf. Proc., 39--46.

Digital Library

[19]

Pollefeys, M., van Gool, L., Vergauwen, M., est, F. V., Cornelis, K., Tops, J., and Koch, R. 2004. Visual modeling with a hand-held camera. Int. J. of Computer Vision 59, 3, 207--232.

Digital Library

[20]

Seitz, S. M., and Dyer, C. M. 1996. View morphing. In SIGGRAPH Conf. Proc., 21--30.

Digital Library

[21]

Shum, H.-Y., and He, L.-W. 1999. Rendering with concentric mosaics. In SIGGRAPH Conf. Proc., 299--306.

Digital Library

[22]

Simon, I., Snavely, N., and Seitz, S. M. 2007. Scene summarization for online image collections. In Proc. Int. Conf. on Computer Vision.

[23]

Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: exploring photo collections in 3D. In SIGGRAPH Conf. Proc., 835--846.

Digital Library

[24]

Snavely, N., Seitz, S. M., and Szeliski, R. 2008. Skeletal sets for efficient structure from motion. In Proc. Computer Vision and Pattern Recognition (to appear).

[25]

Sutherland, I. E. 1968. A head-mounted three dimensional display. In Proc. Fall Joint Computer Conf., 757--764.

Digital Library

[26]

Tan, D. S., Robertson, G. G., and Czerwinski, M. 2001. Exploring 3d navigation: combining speed-coupled flying with orbiting. In Proc. Conf. on Human Factors in Computing Systems, ACM Press, 418--425.

Digital Library

[27]

Taylor, C. J. 2002. VideoPlus: a method for capturing the structure and appearance of immersive environments. IEEE Transactions on Visualization and Computer Graphics 8, 2 (April-June), 171--182.

Digital Library

[28]

Uyttendaele, M., Criminisi, A., Kang, S. B., Winder, S., Szeliski, R., and Hartley, R. 2004. Image-based interactive exploration of real-world environments. IEEE Computer Graphics and Applications 24, 3, 52--63.

Digital Library

[29]

Ware, C., and Osborne, S. 1990. Exploration and virtual camera control in virtual three dimensional environments. In Proc. Symposium on Interactive 3D Graphics, ACM Press, 175--183.

Digital Library

Cited By

Skarlatos DAgrafiotis P(2020)Image-Based Underwater 3D Reconstruction for Cultural Heritage: From Image Collection to 3D. Critical Steps and ConsiderationsVisual Computing for Cultural Heritage10.1007/978-3-030-37191-3_8(141-158)Online publication date: 8-Apr-2020
https://doi.org/10.1007/978-3-030-37191-3_8
Tachibana MFujimoto T(2018)Image montage for constructing photorealistic virtual world from different real scene images2018 International Workshop on Advanced Image Technology (IWAIT)10.1109/IWAIT.2018.8369729(1-4)Online publication date: Jan-2018
https://doi.org/10.1109/IWAIT.2018.8369729
Girdhar RPanda JJawahar C(2018)Mobile Visual Search for Digital Heritage ApplicationsDigital Hampi: Preserving Indian Cultural Heritage10.1007/978-981-10-5738-0_19(317-336)Online publication date: 1-Apr-2018
https://doi.org/10.1007/978-981-10-5738-0_19
Show More Cited By

Index Terms

Finding paths through the world's photos
1. Computing methodologies

Recommendations

Factoring repeated content within and among images
SIGGRAPH '08: ACM SIGGRAPH 2008 papers

We reduce transmission bandwidth and memory space for images by factoring their repeated content. A transform map and a condensed epitome are created such that all image blocks can be reconstructed from transformed epitome patches. The transforms may ...
Finding paths through the world's photos

When a scene is photographed many times by different people, the viewpoints often cluster along certain paths. These paths are largely specific to the scene being photographed, and follow interesting regions and viewpoints. We seek to discover a range ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '08: ACM SIGGRAPH 2008 papers

August 2008

887 pages

ISBN:9781450301121

DOI:10.1145/1399504

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

Conference

SIGGRAPH '08

Sponsor:

SIGGRAPH

SIGGRAPH '08: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 11 - 15, 2008

California, Los Angeles

Acceptance Rates

SIGGRAPH '08 Paper Acceptance Rate 90 of 518 submissions, 17%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

66
Total Citations
View Citations
2,145
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Skarlatos DAgrafiotis P(2020)Image-Based Underwater 3D Reconstruction for Cultural Heritage: From Image Collection to 3D. Critical Steps and ConsiderationsVisual Computing for Cultural Heritage10.1007/978-3-030-37191-3_8(141-158)Online publication date: 8-Apr-2020
https://doi.org/10.1007/978-3-030-37191-3_8
Tachibana MFujimoto T(2018)Image montage for constructing photorealistic virtual world from different real scene images2018 International Workshop on Advanced Image Technology (IWAIT)10.1109/IWAIT.2018.8369729(1-4)Online publication date: Jan-2018
https://doi.org/10.1109/IWAIT.2018.8369729
Girdhar RPanda JJawahar C(2018)Mobile Visual Search for Digital Heritage ApplicationsDigital Hampi: Preserving Indian Cultural Heritage10.1007/978-981-10-5738-0_19(317-336)Online publication date: 1-Apr-2018
https://doi.org/10.1007/978-981-10-5738-0_19
Mo ZShi BYeung SMatsushita Y(2017)Radiometric Calibration for Internet Photo Collections2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2017.37(275-283)Online publication date: Jul-2017
https://doi.org/10.1109/CVPR.2017.37
Marks DElmore PBlain CBourgeois BPetry FFerrini V(2017)A variable resolution right TIN approach for gridded oceanographic dataComputers & Geosciences10.1016/j.cageo.2017.07.008109:C(59-66)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1016/j.cageo.2017.07.008
Park JTai YSinha SKweon I(2016)Efficient and Robust Color Consistency for Community Photo Collections2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2016.53(430-438)Online publication date: Jun-2016
https://doi.org/10.1109/CVPR.2016.53
Verleysen CDe Vleeschouwer C(2016)Piecewise-Planar 3D Approximation from Wide-Baseline Stereo2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2016.362(3327-3336)Online publication date: Jun-2016
https://doi.org/10.1109/CVPR.2016.362
Chassagne RObidegwu DDambrine JMacBeth C(2016)Binary 4D seismic history matching, a metric studyComputers & Geosciences10.1016/j.cageo.2016.08.01396:C(159-172)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1016/j.cageo.2016.08.013
Zhang CZarrouk SArcher R(2016)A mixed finite element solver for natural convection in porous media using automated solution techniquesComputers & Geosciences10.1016/j.cageo.2016.08.01296:C(181-192)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1016/j.cageo.2016.08.012
Chiang YLeyk SHonarvar Nazari NMoghaddam STan T(2016)Assessing the impact of graphical quality on automatic text recognition in digital mapsComputers & Geosciences10.1016/j.cageo.2016.04.01393:C(21-35)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1016/j.cageo.2016.04.013
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten