skip to main content
10.1145/1399504.1360670acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

Motion-invariant photography

Published: 01 August 2008 Publication History

Abstract

Object motion during camera exposure often leads to noticeable blurring artifacts. Proper elimination of this blur is challenging because the blur kernel is unknown, varies over the image as a function of object velocity, and destroys high frequencies. In the case of motions along a 1D direction (e.g. horizontal) we show that these challenges can be addressed using a camera that moves during the exposure. Through the analysis of motion blur as space-time integration, we show that a parabolic integration (corresponding to constant sensor acceleration) leads to motion blur that is invariant to object velocity. Thus, a single deconvolution kernel can be used to remove blur and create sharp images of scenes with objects moving at different speeds, without requiring any segmentation and without knowledge of the object speeds. Apart from motion invariance, we prove that the derived parabolic motion preserves image frequency content nearly optimally. That is, while static objects are degraded relative to their image from a static camera, a reliable reconstruction of all moving objects within a given velocities range is made possible. We have built a prototype camera and present successful deblurring results over a wide variety of human motions.

Supplementary Material

FLV File (30.flv)
MOV File (a71-levin.mov)

References

[1]
Bar, L., Berkels, B., Sapiro, G., and Rumpf:, M. 2007. A variational framework for simultaneous motion estimation and restoration of motion-blurred video. In ICCV.
[2]
Bascle, B., Blake, A., and Zisserman, A. 1996. Motion deblurring and superresolution from an image sequence. In ECCV.
[3]
Ben-Ezra, M., and Nayar, S. K. 2004. Motion-based motion deblurring. PAMI.
[4]
Canon. 2003. EF Lens Work III, The Eyes of EOS. Canon Inc. Lens Product Group.
[5]
Cathey, W., and Dowski, R. 1995. A new paradigm for imaging systems. Applied Optics 41, 1859--1866.
[6]
Chai, J.-X., Tong, X., Chan, S.-C., and Shum, H.-Y. 2000. Plenoptic sampling. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 307--318.
[7]
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., and Freeman, W. T. 2006. Removing camera shake from a single photograph. ACM Transactions on Graphics 25, 3 (July), 787--794.
[8]
Horn, B. K. 1986. Robot Vision. McGraw-Hill Higher Education.
[9]
Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 297--306.
[10]
Levin, A., Fergus, R., Durand, F., and Freeman, W. T. 2007. Image and depth from a conventional camera with a coded aperture. ACM Transactions on Graphics 26, 3 (July), 70:1--70:9.
[11]
Levin, A. 2006. Blind motion deblurring using image statistics. In Advances in Neural Information Processing Systems (NIPS).
[12]
Lucy, L. 1974. Bayesian-based iterative method of image restoration. Journal of Astronomy.
[13]
Raskar, R., Agrawal, A., and Tumblin, J. 2006. Coded exposure photography: motion deblurring using fluttered shutter. ACM Transactions on Graphics 25, 3 (July), 795--804.
[14]
Rav-Acha, A., and Peleg, S. 2005. Two motion-blurred images are better than one. Pattern Recognition Letters.
[15]
Shi, M., and Zheng, J. 2005. A slit scanning depth of route panorama from stationary blur. In Proc. IEEE Conf. Comput. Vision Pattern Recog.
[16]
Yuan, L., Sun, J., Quan, L., and Shum, H.-Y. 2007. Image deblurring with blurred/noisy image pairs. ACM Transactions on Graphics 26, 3 (July), 1:1--1:10.

Cited By

View all
  • (2023)Spatiotemporal Phase Aperture Coding for Motion DeblurringCoded Optical Imaging10.1007/978-3-031-39062-3_7(109-130)Online publication date: 1-Aug-2023
  • (2019)Visual Deprojection: Probabilistic Recovery of Collapsed Dimensions2019 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV.2019.00026(171-180)Online publication date: Oct-2019
  • (2018)Inverse Error Function Trajectories for Image Reconstruction*This material is based upon work supported by the National Science Foundation under Grant No. 16620292018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS.2018.8594315(7527-7532)Online publication date: Oct-2018
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH '08: ACM SIGGRAPH 2008 papers
August 2008
887 pages
ISBN:9781450301121
DOI:10.1145/1399504
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. coded imaging
  2. computational photography
  3. motion deblurring
  4. space-time

Qualifiers

  • Research-article

Funding Sources

Conference

SIGGRAPH '08
Sponsor:

Acceptance Rates

SIGGRAPH '08 Paper Acceptance Rate 90 of 518 submissions, 17%;
Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Spatiotemporal Phase Aperture Coding for Motion DeblurringCoded Optical Imaging10.1007/978-3-031-39062-3_7(109-130)Online publication date: 1-Aug-2023
  • (2019)Visual Deprojection: Probabilistic Recovery of Collapsed Dimensions2019 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV.2019.00026(171-180)Online publication date: Oct-2019
  • (2018)Inverse Error Function Trajectories for Image Reconstruction*This material is based upon work supported by the National Science Foundation under Grant No. 16620292018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS.2018.8594315(7527-7532)Online publication date: Oct-2018
  • (2015)Computational cameras for moving iris recognitionBiometric and Surveillance Technology for Human and Activity Identification XII10.1117/12.2181770(94570C)Online publication date: 14-May-2015
  • (2015)Fast spatially varying object motion blur estimation2015 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP.2015.7350878(646-650)Online publication date: Sep-2015
  • (2014)[Paper] Space-Time Coded Imaging for Robust Depth and Motion DeblurringITE Transactions on Media Technology and Applications10.3169/mta.2.1922:2(192-198)Online publication date: 2014
  • (2014)Motion and Depth Deblurring Using Integrated PSFThe Journal of The Institute of Image Information and Television Engineers10.3169/itej.68.J39968:9(J399-J407)Online publication date: 2014
  • (2014)Apskritiminių rastrinių skalių kompaktinėje laikmenoje tyrimas10.20334/2296-MOnline publication date: 2014
  • (2014)Coded exposure HDR light-field video recordingComputer Graphics Forum10.1111/cgf.1228833:2(33-42)Online publication date: 1-May-2014
  • (2014)Robust optical flow estimation for continuous blurred scenes using RGB-motion imaging and directional filteringIEEE Winter Conference on Applications of Computer Vision10.1109/WACV.2014.6836022(792-799)Online publication date: Mar-2014
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media