skip to main content
10.1145/1457515.1409102acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
research-article

A virtual restoration stage for real-world objects

Published: 01 December 2008 Publication History

Abstract

In this paper, we introduce a system to virtually restore damaged or historically significant objects without needing to physically change the object in any way. Our work addresses both creating a restored synthetic version of the object as viewed from a camera and projecting the necessary light, using digital projectors, to give the illusion of the object being restored. The restoration algorithm uses an energy minimization method to enforce a set of criteria over the surface of the object and provides an interactive tool to the user which can compute a restoration in a few minutes. The visual compensation method develops a formulation that is particularly concerned with obtaining bright compensations under a specified maximum amount of light. The bound on the amount of light is of crucial importance when viewing and restoring old and potentially fragile objects. Finally, we demonstrate our system by restoring several deteriorated and old objects enabling the observer to view the original or restored object at will.

Supplementary Material

MOV File (a149-aliaga-mp4_hi.mov)

References

[1]
Aliaga, D., and Xu, Y. 2008. Photogeometric Structured Light: A Self-Calibrating and Multi-Viewpoint Framework for Accurate 3D Modeling. In Proc. of IEEE Computer Vision and Pattern Recognition, 1--8.
[2]
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., and MacIntyre, B. 2001. Recent Advances in Augmented Reality, IEEE Comp. Graphics & Applications, 21, 6, 34--47.
[3]
Barrett, W. A., and Cheney, A. S. 2002. Object-based Image Editing. ACM Trans. on Graphics, 21, 3, 777--784.
[4]
Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, V. C. 2000. Image Inpainting. In Proc. of ACM SIGGRAPH 2000, 417--424.
[5]
Bertalmio, M., Vese, L., Sapiro, G., and Osher, S. 2003. Simultaneous Structure and Texture Image Inpainting. IEEE Trans. on Image Processing, 12, 8, 882--889.
[6]
Bimber, O., Frohlich, B., Schmalsteig, D., and Encarnação, L. M., 2001. The Virtual Showcase, IEEE Computer Graphics & Applications, 21, 6, 48--55.
[7]
Bornard, R., Lecan, E., Laborelli, L., and Chenot, J. H. 2002. Missing Data Correction in Still Images and Image Sequences. International Multimedia Conference, 355--361.
[8]
Chan, T. F., and Shen, J., 2001, Nontexture Inpainting by Curvature-Driven Diffusions. Journal of Visual Communication and Image Representation, 12, 4, 436--449.
[9]
Comaniciu, D., and Meer, P. 2002. Mean Shift: A Robust Approach Toward Feature Space Analysis. IEEE Trans. Pattern Analysis Machine Intelligence, 24, 5, 603--619.
[10]
Criminisi, A., Perez, P., and Toyama, K. 2003. Object Removal by Exemplar-based Inpainting. In Proc. of IEEE Computer Vision and Pattern Recognition, 2, 721--728.
[11]
Drori, I., Cohen-Or, D., and Yeshurun, H. 2003. Fragment-based Image Completion. ACM Trans. on Graphics, 22, 3, 303--312.
[12]
Durand, F., and Dorsey, J. 2002. Fast Bilateral Filtering for the Display of High-Dynamic-Range Images. In Proc. of ACM SIGGRAPH 2002, 257--266.
[13]
Efros, A. A., and Leung T. K. 1999. Texture Synthesis by Non-Parametric Sampling. In Proc. of IEEE International Conference on Computer Vision, 2, 1033--1038.
[14]
Felzenszwalb, P. F., and Huttenlocher, D. P. 2004. Efficient Graph-Based Image Segmentation. International Journal of Computer Vision, 59, 2, 167--181.
[15]
Fujii, K., Grossberg, M. D., and Nayar, S. K. 2005. A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments. In Proc. of IEEE Computer Vision and Pattern Recognition, 1, 814--821.
[16]
Grossberg, M. D., Peri, H., Nayar, S. K., and Belhumeur, P. N. 2004. Making One Object Look Like Another: Controlling Appearance using a Projector-Camera System. In Proc. of IEEE Computer Vision and Pattern Recognition, 1, 452--459.
[17]
Igehy, H., and Pereira, L. 1997. Image Replacement through Texture Synthesis. In Proc. of International Conference on Image Processing, 3, 186--189.
[18]
Jia, J., and Tang, C. K. 2003. Image Repairing: Robust Image Synthesis by Adaptive ND Tensor Voting. In Proc. of IEEE Computer Vision and Pattern Recognition, 1, 643--650.
[19]
Levin, A., Zomet, A., and Weiss, Y. 2003. Learning How to Inpaint from Global Image Statistics. In Proc. of IEEE International Conference on Computer Vision, 1, 305--312.
[20]
Mitsunaga, T., Nayar, S. K. 1999. Radiometric Self Calibration. IEEE Comp. Vision & Pattern Recognition, 1, 374--380.
[21]
Nayar, S. K., Peri, H., Grossberg, M. D., and Belhumeur, P. N. 2003. A Projection System with Radiometric Compensation for Screen Imperfections. ICCV Workshop on Projector-Camera Systems.
[22]
Perona, P., and Malik, J. 1990. Scale-Space and Edge Detection Using Anisotropic Diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12, 7, 629--639.
[23]
Raskar, R., Welch, G., Low, K. L., and Bandyopadhyay, D. 2001. Shader Lamps: Animating Real Objects With Image-Based Illumination. In Proc. of Eurographics Workshop on Rendering Techniques, 89--102.
[24]
Sen, P., Chen, B., Garg, G., Marschner, S. R., Horowitz, M., Levoy, M., and Lensch, H. P. A. 2005. Dual Photography. In Proc. of ACM SIGGRAPH 2005, 745--755.
[25]
Sun, J., Yuan, L., Jia, J., and Shum, H. Y. 2005. Image Completion with Structure Propagation. ACM Trans. on Graphics, 24, 3, 861--868.
[26]
Tomasi, C., and Manduchi, R. 1998. Bilateral Filtering for Gray and Color Images. In Proc. of IEEE International Conf. on Computer Vision, 836--846.
[27]
Wei, L. Y., and Levoy, M. 2000. Fast Texture Synthesis Using Tree-structured Vector Quantization. In Proc. of ACM SIGGRAPH 2000, 479--488.
[28]
Weiss, B. 2006. Fast Median and Bilateral Filtering. ACM Trans. of Graphics, 25, 3, 519--526.
[29]
Wetzstein, G., and Bimber, O. 2007. Radiometric Compensation through Inverse Light Transport. In Proc. of Pacific Graphics, 391--399.

Cited By

View all
  • (2021)A new lighting method for cultural materials using selective chromatic lightLighting Research & Technology10.1177/1477153521102540454:3(287-305)Online publication date: 31-Jul-2021
  • (2019)Shadow-based Illusion of Depth and Transparency in Printed ImagesACM Transactions on Applied Perception10.1145/334235016:2(1-12)Online publication date: 13-Aug-2019
  • (2014)Artifact Reduction in Radiometric Compensation of Projector-Camera Systems for Steep Reflectance VariationsIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2014.230983224:9(1631-1638)Online publication date: Sep-2014
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH Asia '08: ACM SIGGRAPH Asia 2008 papers
December 2008
581 pages
ISBN:9781450318310
DOI:10.1145/1457515
  • Editor:
  • John C. Hart
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. digitization
  2. energy minimization
  3. image completion
  4. light transport
  5. radiometric calibration
  6. restoration

Qualifiers

  • Research-article

Funding Sources

Conference

SIGGRAPH '08
Sponsor:

Acceptance Rates

SIGGRAPH Asia '08 Paper Acceptance Rate 59 of 320 submissions, 18%;
Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2021)A new lighting method for cultural materials using selective chromatic lightLighting Research & Technology10.1177/1477153521102540454:3(287-305)Online publication date: 31-Jul-2021
  • (2019)Shadow-based Illusion of Depth and Transparency in Printed ImagesACM Transactions on Applied Perception10.1145/334235016:2(1-12)Online publication date: 13-Aug-2019
  • (2014)Artifact Reduction in Radiometric Compensation of Projector-Camera Systems for Steep Reflectance VariationsIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2014.230983224:9(1631-1638)Online publication date: Sep-2014
  • (2013)Truthful Color Reproduction in Spatial Augmented Reality ApplicationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2012.14619:2(236-248)Online publication date: 1-Feb-2013
  • (2013)Real-Time Appearance Modification of Textured Object Using Superimposed ProjectionProceedings of the 2013 International Conference on Computer-Aided Design and Computer Graphics10.1109/CADGraphics.2013.85(437-438)Online publication date: 16-Nov-2013
  • (2011)Interactive visualization technique for truthful color reproduction in spatial augmented reality applicationsProceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality10.1109/ISMAR.2011.6092381(157-164)Online publication date: 26-Oct-2011
  • (2010)Illuminating the past: state of the artVirtual Reality10.1007/s10055-010-0154-x14:3(155-182)Online publication date: 20-Feb-2010

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media