article

Removing camera shake from a single photograph

Authors:

Aaron Hertzmann,

William T. FreemanAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 25, Issue 3

Pages 787 - 794

https://doi.org/10.1145/1141911.1141956

Published: 01 July 2006 Publication History

Abstract

Camera shake during exposure leads to objectionable image blur and ruins many photographs. Conventional blind deconvolution methods typically assume frequency-domain constraints on images, or overly simplified parametric forms for the motion path during camera shake. Real camera motions can follow convoluted paths, and a spatial domain prior can better maintain visually salient image characteristics. We introduce a method to remove the effects of camera shake from seriously blurred images. The method assumes a uniform camera blur over the image and negligible in-plane camera rotation. In order to estimate the blur from the camera shake, the user must specify an image region without saturation effects. We show results for a variety of digital photographs taken from personal photo collections.

Supplementary Material

JPG File (p787-fergus-high.jpg)

Download
14.41 KB

JPG File (p787-fergus-low.jpg)

Download
11.37 KB

High Resolution (p787-fergus-high.mov)

Download
49.23 MB

Low Resolution (p787-fergus-low.mov)

Download
17.41 MB

References

[1]

Apostoloff, N., and Fitzgibbon, A. 2005. Bayesian video matting using learnt image priors. In Conf. on Computer Vision and Pattern Recognition, 407--414.

[2]

Bascle, B., Blake, A., and Zisserman, A. 1996. Motion Deblurring and Super-resolution from an Image Sequence. In ECCV(2), 573--582.

Digital Library

[3]

Ben-Ezra, M., and Nayar, S. K. 2004. Motion-Based Motion Deblurring. IEEE Trans. on Pattern Analysis and Machine Intelligence 26, 6, 689--698.

Digital Library

[4]

Biggs, D., and Andrews, M. 1997. Acceleration of iterative image restoration algorithms. Applied Optics 36, 8, 1766--1775.

[5]

Canon Inc., 2006. What is optical image stabilizer? http://www.canon.com/bctv/faq/optis.html.

[6]

Caron, J., Namazi, N., and Rollins, C. 2002. Noniterative blind data restoration by use of an extracted filter function. Applied Optics 41, 32 (November), 68--84.

[7]

Field, D. 1994. What is the goal of sensory coding? Neural Computation 6, 559--601.

Digital Library

[8]

Geman, D., and Reynolds, G. 1992. Constrained restoration and the recovery of discontinuities. IEEE Trans. on Pattern Analysis and Machine Intelligence 14, 3, 367--383.

Digital Library

[9]

Gull, S. 1998. Bayesian inductive inference and maximum entropy. In Maximum Entropy and Bayesian Methods, J. Skilling, Ed. Kluwer, 54--71.

[10]

Jalobeanu, A., Blanc-Fraud, L., and Zerubia, J. 2002. Estimation of blur and noise parameters in remote sensing. In Proc. of Int. Conf. on Acoustics, Speech and Signal Processing.

[11]

Jansson, P. A. 1997. Deconvolution of Images and Spectra. Academic Press.

Digital Library

[12]

Jordan, M., Ghahramani, Z., Jaakkola, T., and Saul, L. 1999. An introduction to variational methods for graphical models. In Machine Learning, vol. 37, 183--233.

Digital Library

[13]

Kundur, D., and Hatzinakos, D. 1996. Blind image deconvolution. IEEE Signal Processing Magazine 13, 3 (May), 43--64.

[14]

Levin, A., and Weiss, Y. 2004. User Assisted Separation of Reflections from a Single Image Using a Sparsity Prior. In ICCV, vol. 1, 602--613.

[15]

Levin, A., Zomet, A., and Weiss, Y. 2003. Learning How to Inpaint from Global Image Statistics. In ICCV, 305--312.

Digital Library

[16]

Liu, X., and Gamal, A. 2001. Simultaneous image formation and motion blur restoration via multiple capture. In Proc. Int. Conf. Acoustics, Speech, Signal Processing, vol. 3, 1841--1844.

Digital Library

[17]

Lucy, L. 1974. Bayesian-based iterative method of image restoration. Journal of Astronomy 79, 745--754.

[18]

Miskin, J., and MacKay, D. J. C. 2000. Ensemble Learning for Blind Image Separation and Deconvolution. In Adv. in Independent Component Analysis, M. Girolani, Ed. Springer-Verlag.

[19]

Miskin, J., 2000. Train ensemble library. http://www.inference.phy.cam.ac.uk/jwm1003/train_ensemble.tar.gz.

[20]

Miskin, J. W. 2000. Ensemble Learning for Independent Component Analysis. PhD thesis, University of Cambridge.

[21]

Neelamani, R., Choi, H., and Baraniuk, R. 2004. Forward: Fourier-wavelet regularized deconvolution for ill-conditioned systems. IEEE Trans. on Signal Processing 52 (Feburary), 418--433.

Digital Library

[22]

Rav-Acha, A., and Peleg, S. 2005. Two motion-blurred images are better than one. Pattern Recognition Letters, 311--317.

Digital Library

[23]

Richardson, W. 1972. Bayesian-based iterative method of image restoration. Journal of the Optical Society of America A 62, 55--59.

[24]

Roth, S., and Black, M. J. 2005. Fields of Experts: A Framework for Learning Image Priors. In CVPR, vol. 2, 860--867.

Digital Library

[25]

Simoncelli, E. P. 2005. Statistical modeling of photographic images. In Handbook of Image and Video Processing, A. Bovik, Ed. ch. 4.

[26]

Tappen, M. F., Russell, B. C., and Freeman, W. T. 2003. Exploiting the sparse derivative prior for super-resolution and image demosaicing. In SCTV.

[27]

Tsumuraya, F., Miura, N., and Baba, N. 1994. Iterative blind deconvolution method using Lucy's algorithm. Astron. Astrophys. 282, 2 (Feb), 699--708.

[28]

Weiss, Y. 2001. Deriving intrinsic images from image sequences. In ICCV, 68--75.

[29]

Zarowin, C. 1994. Robust, noniterative, and computationally efficient modification of van Cittert deconvolution optical figuring. Journal of the Optical Society of America A 11, 10 (October), 2571--83.

Cited By

Khan SMahmood M(2025)A Teacher-Learning-Based Optimization Approach for Blur Detection in Defocused ImagesMathematics10.3390/math1302018713:2(187)Online publication date: 8-Jan-2025
https://doi.org/10.3390/math13020187
Yu RYue TLiang LGao Z(2025)Blur-Deblur Algorithm for Pressure-Sensitive Paint Image Based on Variable Attention ConvolutionComputers, Materials & Continua10.32604/cmc.2025.05907782:3(5239-5256)Online publication date: 2025
https://doi.org/10.32604/cmc.2025.059077
Zhao YPo LYe XXu YYan Q(2025)Modeling Dual-Exposure Quad-Bayer Patterns for Joint Denoising and DeblurringIEEE Transactions on Image Processing10.1109/TIP.2024.351587334(350-364)Online publication date: 2025
https://doi.org/10.1109/TIP.2024.3515873
Show More Cited By

Index Terms

Removing camera shake from a single photograph
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Image manipulation
2. Mathematics of computing
  1. Probability and statistics

Recommendations

Removing camera shake from a single photograph
SIGGRAPH '06: ACM SIGGRAPH 2006 Papers

Camera shake during exposure leads to objectionable image blur and ruins many photographs. Conventional blind deconvolution methods typically assume frequency-domain constraints on images, or overly simplified parametric forms for the motion path during ...
Recording and playback of camera shake: benchmarking blind deconvolution with a real-world database
ECCV'12: Proceedings of the 12th European conference on Computer Vision - Volume Part VII

Motion blur due to camera shake is one of the predominant sources of degradation in handheld photography. Single image blind deconvolution (BD) or motion deblurring aims at restoring a sharp latent image from the blurred recorded picture without knowing ...
Space-variant single-image blind deconvolution for removing camera shake
NIPS'10: Proceedings of the 24th International Conference on Neural Information Processing Systems - Volume 1

Modelling camera shake as a space-invariant convolution simplifies the problem of removing camera shake, but often insufficiently models actual motion blur such as those due to camera rotation and movements outside the sensor plane or when objects in the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 25, Issue 3

July 2006

742 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1141911

Issue’s Table of Contents

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2006

Published in TOG Volume 25, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,242
Total Citations
View Citations
5,957
Total Downloads

Downloads (Last 12 months)81
Downloads (Last 6 weeks)7

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Khan SMahmood M(2025)A Teacher-Learning-Based Optimization Approach for Blur Detection in Defocused ImagesMathematics10.3390/math1302018713:2(187)Online publication date: 8-Jan-2025
https://doi.org/10.3390/math13020187
Yu RYue TLiang LGao Z(2025)Blur-Deblur Algorithm for Pressure-Sensitive Paint Image Based on Variable Attention ConvolutionComputers, Materials & Continua10.32604/cmc.2025.05907782:3(5239-5256)Online publication date: 2025
https://doi.org/10.32604/cmc.2025.059077
Zhao YPo LYe XXu YYan Q(2025)Modeling Dual-Exposure Quad-Bayer Patterns for Joint Denoising and DeblurringIEEE Transactions on Image Processing10.1109/TIP.2024.351587334(350-364)Online publication date: 2025
https://doi.org/10.1109/TIP.2024.3515873
Cao QDing JLiu ZKuang ZShao YShen Y(2025)VC-GS: view-consistent deblurring Gaussian splatting via alternating branch optimizationThe Visual Computer10.1007/s00371-025-03806-yOnline publication date: 23-Jan-2025
https://doi.org/10.1007/s00371-025-03806-y
Arslan AGultekin GSaranli A(2024)IMU-aided adaptive mesh-grid based video motion deblurringPeerJ Computer Science10.7717/peerj-cs.254010(e2540)Online publication date: 25-Nov-2024
https://doi.org/10.7717/peerj-cs.2540
Saqib MDawood HAlghamdi ADawood H(2024)Weber's Law-based Regularization for Blind Image DeblurringEngineering, Technology & Applied Science Research10.48084/etasr.657614:1(12937-12943)Online publication date: 8-Feb-2024
https://doi.org/10.48084/etasr.6576
Wang ZLiu HCheng LLyu ZGao LJiang NHe ZLiu Y(2024)Improvement of Whole-body Bone Planar Images on a Bone-dedicated Single-photon Emission Computed Tomography Scanner by Blind Deconvolution AlgorithmJournal of Medical Physics10.4103/jmp.jmp_127_2349:1(110-119)Online publication date: 30-Mar-2024
https://doi.org/10.4103/jmp.jmp_127_23
Wu TFeng CLi Z(2024)Blind image deblurring using kernel error for p-shrinkage operator optimization modelInverse Problems and Imaging10.3934/ipi.2024003(0-0)Online publication date: 2024
https://doi.org/10.3934/ipi.2024003
Ho QDuong MLee SHong M(2024)EHNet: Efficient Hybrid Network with Dual Attention for Image DeblurringSensors10.3390/s2420654524:20(6545)Online publication date: 10-Oct-2024
https://doi.org/10.3390/s24206545
Zhu MLiu JWang F(2024)Blind Deblurring Method for CASEarth Multispectral Images Based on Inter-Band Gradient Similarity PriorSensors10.3390/s2419625924:19(6259)Online publication date: 27-Sep-2024
https://doi.org/10.3390/s24196259
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents