skip to main content
research-article

Interactive 3D architectural modeling from unordered photo collections

Published: 01 December 2008 Publication History

Abstract

We present an interactive system for generating photorealistic, textured, piecewise-planar 3D models of architectural structures and urban scenes from unordered sets of photographs. To reconstruct 3D geometry in our system, the user draws outlines overlaid on 2D photographs. The 3D structure is then automatically computed by combining the 2D interaction with the multi-view geometric information recovered by performing structure from motion analysis on the input photographs. We utilize vanishing point constraints at multiple stages during the reconstruction, which is particularly useful for architectural scenes where parallel lines are abundant. Our approach enables us to accurately model polygonal faces from 2D interactions in a single image. Our system also supports useful operations such as edge snapping and extrusions.
Seamless texture maps are automatically generated by combining multiple input photographs using graph cut optimization and Poisson blending. The user can add brush strokes as hints during the texture generation stage to remove artifacts caused by unmodeled geometric structures. We build models for a variety of architectural scenes from collections of up to about a hundred photographs.

Supplementary Material

JPG File (a159-sinha-mp4_hi.jpg)
MOV File (a159-sinha-mp4_hi.mov)

References

[1]
Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. In ACM Trans. on Graphics (SIGGRAPH'04), 294--302.
[2]
Aliaga, D. G., Rosen, P. A., and Bekins, D. R. 2007. Style grammars for interactive visualization of architecture. IEEE Trans. on Visualization and Computer Graphics 13, 4, 786--797.
[3]
Baillard, C., and Zisserman, A. 2001. Automatic reconstruction of piecewise planar models from multiple views. In CVPR, 559--565.
[4]
Brown, M., and Lowe, D. G. 2005. Unsupervised 3d object recognition and reconstruction in unordered datasets. In 3DIM '05, IEEE Computer Society, Washington, DC, USA, 56--63.
[5]
Cipolla, R., and Robertson, D. 1999. 3d models of architectural scenes from uncalibrated images and vanishing points. ICIAP 00.
[6]
Criminisi, A., Reid, I. D., and Zisserman, A. 2000. Single view metrology. Int. J. of Computer Vision 40, 2, 123--148.
[7]
Debevec, P. E., Taylor, C. J., and Malik, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In SIGGRAPH 1996, Computer Graphics Proceedings, 11--20.
[8]
Dick, A. R., Torr, P. H. S., and Cipolla, R. 2004. Modelling and interpretation of architecture from several images. Int. J. Comput. Vision 60, 2, 111--134.
[9]
El-Hakim, S., Whiting, E., and Gonzo, L. 2005. 3d modeling with reusable and integrated building blocks. The 7th Conference on Optical 3-D Measurement Techniques.
[10]
Fischler, M. A., and Bolles, R. C. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 6, 381--395.
[11]
Gibson, S., Hubbold, R., Cook, J., and Howard, T. 2003. Interactive reconstruction of virtual environments from video sequences. Computers and Graphics 27, 2.
[12]
Goesele, M., Snavely, N., Curless, B., Hoppe, H., and Seitz, S. M. 2007. Multi-view stereo for community photo collections. In ICCV.
[13]
Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. In SIGGRAPH 2005, Computer Graphics Proceedings.
[14]
Igarashi, T., and Hughes, J. F. 2001. A suggestive interface for 3d drawing. In UIST, 173--181.
[15]
Kim, S. J., and Pollefeys, M. 2008. Robust radiometric calibration and vignetting correction. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 4, 562--576.
[16]
Lempitsky, V. S., and Ivanov, D. V. 2007. Seamless mosaicing of image-based texture maps. In CVPR.
[17]
Mueller, P., Zeng, G., Wonka, P., and Gool, L. V. 2007. Image-based procedural modeling of facades. ACM Trans. on Graphics (SIGGRAPH 2007) 26, 3, 85:1--85:9.
[18]
Oh, B. M., Chen, M., Dorsey, J., and Durand, F. 2001. Image-based modeling and photo editing. In SIGGRAPH 2001, Computer Graphics Proceedings, 433--442.
[19]
Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. on Graphics (SIGGRAPH'03) 22, 3, 313--318.
[20]
Pollefeys, M., Gool, L. V., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., and Koch, R. 2004. Visual modeling with a hand-held camera. Int. J. of Comput. Vision 59, 3, 207--232.
[21]
Pollefeys, M., Nister, D., Frahm, J.-M., Akbarzadeh, A., Mordohai, P., et al. 2008. Detailed real-time urban 3d reconstruction from video. Int. J. of Computer Vision (in press).
[22]
Rother, C. 2002. A new approach for vanishing point detection in architectural environments. In BMVC, vol. 20, 382--391.
[23]
Sketchup. http://www.sketchup.com.
[24]
Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: exploring photo collections in 3d. ACM Trans. on Graphics (SIGGRAPH'06), 835--846.
[25]
Triggs, B., McLauchlan, P., Hartley, R., and Fitzgibbon, A. 2000. Bundle adjustment -- A modern synthesis. In Vision Algorithms: Theory and Practice, W. Triggs, A. Zisser-man, and R. Szeliski, Eds., LNCS. Springer Verlag, 298--375.
[26]
van den Hengel, A., Dick, A., Thormahlen, T., Torr, P. H. S., and B. Ward. 2006. Fitting multiple models to multiple images with minimal user interaction. In the Intl. Workshop on the Representation and use of Prior Knowledge in Vision.
[27]
van den Hengel, A., Dick, A., Thormählen, T., Ward, B., and Torr, P. H. S. 2007. Videotrace: rapid interactive scene modelling from video. ACM Trans. on Graphics (SIG-GRAPH'07), 86.
[28]
Werner, T., and Zisserman, A. 2002. New techniques for automated architecture reconstruction from photographs. In ECCV (2), 541--555.
[29]
Wilczkowiak, M., Sturm, P., and Boyer, E. 2005. Using geometric constraints through parallelepipeds for calibration and 3d modeling. IEEE Trans. on PAMI 27, 2, 194--207.
[30]
Zeleznik, R., Herndon, K., and Hughes, J. 1996. Sketch: An interface for sketching 3D scenes. ACM Trans. on Graphics (SIGGRAPH'96), 163--170.
[31]
Ziegler, R., Matusik, W., Pfister, H., and McMillan, L. 2003. 3d reconstruction using labeled image regions. In SGP '03: Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, 248--259.

Cited By

View all
  • (2024)Human–AI Collaboration for Remote Sighted Assistance: Perspectives from the LLM EraFuture Internet10.3390/fi1607025416:7(254)Online publication date: 18-Jul-2024
  • (2024)Semantic Image Translation for Repairing the Texture Defects of Building ModelsIEEE Transactions on Geoscience and Remote Sensing10.1109/TGRS.2023.333896262(1-20)Online publication date: 2024
  • (2024)AirPlanes: Accurate Plane Estimation via 3D-Consistent Embeddings2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00504(5270-5280)Online publication date: 16-Jun-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 27, Issue 5
December 2008
552 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1409060
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2008
Published in TOG Volume 27, Issue 5

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)43
  • Downloads (Last 6 weeks)2
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Human–AI Collaboration for Remote Sighted Assistance: Perspectives from the LLM EraFuture Internet10.3390/fi1607025416:7(254)Online publication date: 18-Jul-2024
  • (2024)Semantic Image Translation for Repairing the Texture Defects of Building ModelsIEEE Transactions on Geoscience and Remote Sensing10.1109/TGRS.2023.333896262(1-20)Online publication date: 2024
  • (2024)AirPlanes: Accurate Plane Estimation via 3D-Consistent Embeddings2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00504(5270-5280)Online publication date: 16-Jun-2024
  • (2024)Evaluating Image-Based Interactive 3D Modeling ToolsIEEE Access10.1109/ACCESS.2024.343458412(104138-104152)Online publication date: 2024
  • (2023)MoReLab: A Software for User-Assisted 3D ReconstructionSensors10.3390/s2314645623:14(6456)Online publication date: 17-Jul-2023
  • (2023)Texture-Mapping Error Removal Based on the BRIEF Operator in Image-Based Three-Dimensional ReconstructionRemote Sensing10.3390/rs1502053615:2(536)Online publication date: 16-Jan-2023
  • (2023)TwinTex: Geometry-Aware Texture Generation for Abstracted 3D Architectural ModelsACM Transactions on Graphics10.1145/361832842:6(1-14)Online publication date: 5-Dec-2023
  • (2023)Computer Vision Techniques in ManufacturingIEEE Transactions on Systems, Man, and Cybernetics: Systems10.1109/TSMC.2022.316639753:1(105-117)Online publication date: Jan-2023
  • (2023)Historic building information modeling using image: Example of port city Massawa, EritreaJournal of Building Engineering10.1016/j.jobe.2023.10766278(107662)Online publication date: Nov-2023
  • (2023)Procedural generation of semantically plausible small-scale townsGraphical Models10.1016/j.gmod.2023.101170126(101170)Online publication date: Apr-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media