Low-cost model reconstruction from image sequences

ABSTRACT

A system that constructs a three dimensional model using two dimensional images taken from multiple view-points is presented. This system improves upon existing work by including several optimisations and extensions to cater for poor lighting. This system was developed with the modeling of African artworks in mind. As these artifacts are often located in remote areas, our system has to be robust enough to deal with less than ideal lighting conditions.The images used as input are obtained by filming an object, which is being rotated on a turntable. The modeling process begins with the extraction of "silhouettes" from the input images. These silhouettes are used in conjunction with the camera model to construct a volumetric representation. Following this, a surface model, consisting of a triangular mesh, is created. Finally, the surface model is texture mapped.

REFERENCES

• 1: Alexei A. Efros , Thomas K. Leung, Texture Synthesis by Non-Parametric Sampling, Proceedings of the International Conference on Computer Vision-Volume 2, p.1033, September 20-25, 1999
• 2: Andrew W. Fitzgibbon , Geoff Cross , Andrew Zisserman, Automatic 3D Model Construction for Turn-Table Sequences, Proceedings of the European Workshop on 3D Structure from Multiple Images of Large-Scale Environments, p.155-170, June 06-07, 1998
• 3: Fusiello, A. Roberto, V. and Trucco, E. Efficient stereo with multiple windowing. Technical report, Machine Vision Laboratory, Dept. of Informatics, University of Udine, Italy, 1997.
• 4: D. P. Gibson, N. W. Campbell, and B. T. Thomas. Iterative generation of 3-d models from a set of 2-d images. In Eurographics UK 1998, pages 135-145. Leeds University, March 1998.
• 5: J. J. Koenderink. What does the occluding contour tell us about solid shape. Perception, 13:321-330, 1984.
• 6: Aldo Laurentini, How Far 3D Shapes Can Be Understood from 2D Silhouettes, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.17 n.2, p.188-195, February 1995 [doi>10.1109/34.368170 ]
• 7: S. Laveau and Z. Zhang. Computation of the epipolar geometry, http://www-sop.inria.fr/robotvis/demo/f-http/html/. July 1995.
• 8: Marc Levoy , Kari Pulli , Brian Curless , Szymon Rusinkiewicz , David Koller , Lucas Pereira , Matt Ginzton , Sean Anderson , James Davis , Jeremy Ginsberg , Jonathan Shade , Duane Fulk, The digital Michelangelo project: 3D scanning of large statues, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.131-144, July 2000 [doi>10.1145/344779.344849]
• 9: William E. Lorensen , Harvey E. Cline, Marching cubes: A high resolution 3D surface construction algorithm, ACM SIGGRAPH Computer Graphics, v.21 n.4, p.163-169, July 1987
• 10: W. Niem. Robust and fast modelling of 3d natural objects from multiple views. In SPIE Proceedings, Image and Video Processing II, volume 2182, pages 388-397, 1994.
• 11: W. Niem. Error analysis for silhouette-based 3D shape estimation from multiple views. In In Proc. Int. Workshop on Synthetic-Natural Hybrid Coding and Three-Dimensional Imaging, 1997.
• 12: W. Niem , J. Wingbermuhle, Automatic reconstruction of 3D objects using a mobile monoscopic camera, Proceedings of the International Conference on Recent Advances in 3-D Digital Imaging and Modeling, p.173, May 12-15, 1997
• 13: F. Nooruddin and G. Turk. Simplification and repair of polygonal models using volumetric techniques. Technical Report GIT-GVU-99-37, Graphics, Visualization and Usability Center, Georgia Institute of Technology, 1999.
• 14: Eyal Ofek , Erez Shilat , Ari Rappoport , Michael Werman, Multiresolution Textures from Image Sequences, IEEE Computer Graphics and Applications, v.17 n.2, p.18-29, March 1997 [doi>10.1109/38.574667 ]
• 15: Marc Pollefeys , Reinhard Koch , Luc Van Gool, Self-Calibration and Metric Reconstruction in spite of Varying and Unknown Internal Camera Parameters, Proceedings of the Sixth International Conference on Computer Vision, p.90, January 04-07, 1998
• 16: Pedro V. Sander , Xianfeng Gu , Steven J. Gortler , Hugues Hoppe , John Snyder, Silhouette clipping, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.327-334, July 2000 [doi>10.1145/344779.344935]
• 17: Gabriel Taubin, A signal processing approach to fair surface design, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.351-358, September 1995 [doi>10.1145/218380.218473]
• 18: J.T. Tou and R. C. Gonzalez. Pattern Recognition Principles. Addison-Wesley, Reading, Massachusetts, U.S.A., 1974.
• 19: Roger Y. Tsai, A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses, Radiometry, Jones and Bartlett Publishers, Inc., 1992
• 20: G. Xu, J. ichi Terai, and H.-Y. Shum. A Linea Algorithm for Camera Self-Calibration, Motion and Structure Recovery for Multi-Planar Scenes from Two Perspective Images. Proc of IEEE Conference on Computer Vision and Pattern Recognition, (II):474-479, June 2000.
• 21: Y. Yakimovsky and R. Cunningham. A system for extracting three-dimensional measurements from a stereo pair of tv cameras. In Computer Graphics and Image Processing, volume 7, pages 1995-2010, 1978.
• 22: Zhang,Z.,Deriche,R.,Faugeras,O. and Luong,Q-T. A Robust Technique for Matching Two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry. Technical Report N 2273, INRIA - Institut National de Recherche Informatique et en Automatique, 1994.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
      I.4.5 Reconstruction
      I.4.6 Segmentation

General Terms:
Algorithms

Keywords:
Camera Calibration, Image Processing, Iso-surface, Model Reconstruction, Texture Mapping, Volume Carving