Free-form modelling for surface inpainting

ABSTRACT

In this paper, we describe a novel approach to 3D shape modelling, targeting at the reconstruction and repair of digitised models -- a task that is frequently encountered in particular in the fields of cultural heritage and archaeology. In these fields, faithfully digitised models are often to be restorated in order to visualise the object in its original state, reversing the effects of aging or decay. In our approach, we combine intuitive free-form modelling techniques with automatic 3D surface completion to derive a powerful modelling methodology that on the one hand is capable of including a user's expertise into the surface completion process. The automatic completion, on the other hand, reconstructs the required surface detail in the modelled region and thus frees the user from the need to model every last detail manually. The power and feasibility of our approach is demonstrated with several examples.

REFERENCES

• 1: Brett Allen , Brian Curless , Zoran Popović, The space of human body shapes: reconstruction and parameterization from range scans, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 2: Alan H. Barr, Global and local deformations of solid primitives, ACM SIGGRAPH Computer Graphics, v.18 n.3, p.21-30, July 1984
• 3: G. H. Bendels , R. Klein, Mesh forging: editing of 3D-meshes using implicitly defined occluders, Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, June 23-25, 2003, Aachen, Germany
• 4: Bendels, G. H., Schnabel, R., and Klein, R. 2005. Detail-preserving surface inpainting. In Proceedings of the 6th International Symposium on Virtual Reality, Archaeology and Cultural Heritage, Eurographics Association, 41--48.
• 5: Paul J. Besl , Neil D. McKay, A Method for Registration of 3-D Shapes, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.14 n.2, p.239-256, February 1992 [doi>10.1109/34.121791 ]
• 6: Paul Borrel , Ari Rappoport, Simple constrained deformations for geometric modeling and interactive design, ACM Transactions on Graphics (TOG), v.13 n.2, p.137-155, April 1994 [doi>10.1145/176579.176581]
• 7: Mario Botsch , Leif Kobbelt, An intuitive framework for real-time freeform modeling, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 8: Botsch, M., and Kobbelt, L. 2005. Real-time shape editing using radial basis functions. Computer Graphics Forum 24, 3, 611--621.
• 9: U. Clarenz , U. Diewald , G. Dziuk , M. Rumpf , R. Rusu, A finite element method for surface restoration with smooth boundary conditions, Computer Aided Geometric Design, v.21 n.5, p.427-445, May 2004 [doi>10.1016/j.cagd.2004.02.004]
• 10: Sabine Coquillart, Extended free-form deformation: a sculpturing tool for 3D geometric modeling, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.187-196, September 1990, Dallas, TX, USA
• 11: Brian Curless , Marc Levoy, A volumetric method for building complex models from range images, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.303-312, August 1996 [doi>10.1145/237170.237269]
• 12: Davis, J., Marschner, S. R., Garr, M., and Levoy, M. 2002. Filling holes in complex surfaces using volumetric diffusion. In Proceedings of the 1st International Symposium on 3D Data Processing Visualization and Transmission (3DPVT02), IEEE Computer Society, Padova, Italy, G. M. Cortelazzo and C. Guerra, Eds., 428--438.
• 13: Eric Ferley , Marie-Paule Cani , Jean-Dominique Gascuel, Resolution adaptive volume sculpting, Graphical Models, v.63 n.6, p.459-478, November 2001 [doi>10.1006/gmod.2001.0558]
• 14: James Gain , Patrick Marais, Warp Sculpting, IEEE Transactions on Visualization and Computer Graphics, v.11 n.2, p.217-227, March 2005 [doi>10.1109/TVCG.2005.36]
• 15: Jing Hua , Hong Qin, Haptics-based volumetric modeling using dynamic spline-based implicit functions, Proceedings of the 2002 IEEE symposium on Volume visualization and graphics, October 28-29, 2002, Boston, Massachusetts
• 16: Takeo Igarashi , Satoshi Matsuoka , Hidehiko Tanaka, Teddy: a sketching interface for 3D freeform design, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.409-416, July 1999 [doi>10.1145/311535.311602]
• 17: Karpenko, O., Hughes, J. F., and Raskar, R. 2002. Free-form sketching with variational implicit surfaces. Computer Graphics Forum 21, 3 (September).
• 18: Klein, J., and Zachmann, G. 2004. Proximity graphs for defining surfaces over point clouds. In Eurographics Symposium on Point-Based Grahics (SPBG'04), 131--138.
• 19: Leif Kobbelt , Swen Campagna , Jens Vorsatz , Hans-Peter Seidel, Interactive multi-resolution modeling on arbitrary meshes, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.105-114, July 1998 [doi>10.1145/280814.280831]
• 20: Kraevoy, V., and Sheffer, A. 2005. Template-based mesh completion. In Eurographics Symposium on Geometry Processing 2005, 13--22.
• 21: Lee, S. 1999. Interactive multiresolution editing of arbitrary meshes. In Proc. of Eurographics '99, P. Brunet and R. Scopigno, Eds., C-73-C82.
• 22: David Levin, The approximation power of moving least-squares, Mathematics of Computation, v.67 n.224, p.1517-1531, Oct. 1998 [doi>10.1090/S0025-5718-98-00974-0 ]
• 23: Peter Liepa, Filling holes in meshes, Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, June 23-25, 2003, Aachen, Germany
• 24: Ignacio Llamas , Byungmoon Kim , Joshua Gargus , Jarek Rossignac , Chris D. Shaw, Twister: a space-warp operator for the two-handed editing of 3D shapes, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 25: Andrew Nealen , Olga Sorkine , Marc Alexa , Daniel Cohen-Or, A sketch-based interface for detail-preserving mesh editing, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 26: Mark Pauly , Richard Keiser , Leif P. Kobbelt , Markus Gross, Shape modeling with point-sampled geometry, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 27: Pauly, M., Mitra, N. J., Giesen, J., Gross, M., and Guibas, L. 2005. Example-based 3d scan completion. In Symposium on Geometry Processing, 23--32.
• 28: Ronald N. Perry , Sarah F. Frisken, Kizamu: a system for sculpting digital characters, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.47-56, August 2001 [doi>10.1145/383259.383264]
• 29: R. Raffin, Neveu, M., and Jaar, F. 2000. Curvilinear displacement of free-form-based deformation. The Visual Computer 16, 1, 38--46.
• 30: Schnabel, R. 2005. Detecting holes in surfaces. Central European Seminar on Computer Graphics (CESCG05), May.
• 31: Thomas W. Sederberg , Scott R. Parry, Free-form deformation of solid geometric models, Proceedings of the 13th annual conference on Computer graphics and interactive techniques, p.151-160, August 1986
• 32: Andrei Sharf , Marc Alexa , Daniel Cohen-Or, Context-based surface completion, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 33: O. Sorkine , D. Cohen-Or , Y. Lipman , M. Alexa , C. Rössl , H.-P. Seidel, Laplacian surface editing, Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing, July 08-10, 2004, Nice, France [doi>10.1145/1057432.1057456]
• 34: Jian Sun , Lu Yuan , Jiaya Jia , Heung-Yeung Shum, Image completion with structure propagation, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 35: Verdera, J., Caselles, V., Bertalmio, M., and Sapiro, G. 2003. Inpainting surface holes. In IEEE International Conference on Image Processing (ICIP 2003).
• 36: William Welch , Andrew Witkin, Variational surface modeling, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.157-166, July 1992
• 37: Zayer, R., Rössl, C., Karni, Z., and Seidel, H.-P. 2005. Harmonic guidance for surface deformation. In Computer Graphics Forum, Proceedings of Eurographics 2005, Blackwell, Dublin, Ireland, Eurographics.
• 38: Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 [doi>10.1145/237170.237238]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques