Article

Flash photography enhancement via intrinsic relighting

Authors:

Elmar Eisemann,

Frédo DurandAuthors Info & Claims

SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

Pages 673 - 678

https://doi.org/10.1145/1186562.1015778

Published: 01 August 2004 Publication History

Abstract

We enhance photographs shot in dark environments by combining a picture taken with the available light and one taken with the flash. We preserve the ambiance of the original lighting and insert the sharpness from the flash image. We use the bilateral filter to decompose the images into detail and large scale. We reconstruct the image using the large scale of the available lighting and the detail of the flash. We detect and correct flash shadows. This combines the advantages of available illumination and flash photography.

Supplemental Material

MOV File

Download
11.66 KB

References

[1]

AKERS, LOSASSO, KLINGNER, AGRAWALA, RICK, AND HANRAHAN. 2003. Conveying shape and features with image-based relighting. In Visualization.

Digital Library

[2]

ASHIKHMIN. 2002. A tone mapping algorithm for high contrast images. In Eurographics Workshop on Rendering, 145--156.

Digital Library

[3]

BARROW, AND TENENBAUM. 1978. Recovering intrinsic scene characteristics from images. In Computer Vision Systems. Academic Press.

[4]

CHIU, HERF, SHIRLEY, SWAMY, WANG, AND ZIMMERMAN. 1993. Spatially nonuniform scaling functions for high contrast images. In Graphics Interface.

[5]

CHOUDHURY, AND TUMBLIN. 2003. The trilateral filter for high contrast images and meshes. In Eurographics Symposium on Rendering.

Digital Library

[6]

COHEN, COLBURN, AND DRUCKER. 2003. Image stacks. Tech. Rep. 40, MSR.

[7]

DEBEVEC, AND MALIK. 1997. Recovering high dynamic range radiance maps from photographs. In Proc. SIGGRAPH.

Digital Library

[8]

DICARLO, J., AND WANDELL, B. 2000. Rendering high dynamic range images. Proc. SPIE: Image Sensors 3965, 392--401.

[9]

DICARLO, J. M., XIAO, F., AND WANDELL, B. A. 2001. Illuminating illumination. In 9th Color Imaging Conference, 27--34.

[10]

DURAND, AND DORSEY. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. on Graphics 21, 3.

Digital Library

[11]

GAUBATZ, AND ULICHNEY. 2002. Automatic red-eye detection and correction. In IEEE Int. Conf. on Image Processing.

[12]

HOPPE, AND TOYAMA. 2003. Continuous flash. Tech. Rep. 63, MSR.

[13]

JOBSON, RAHMAN, AND WOODELL. 1997. A multi-scale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. on Image Processing 6, 965--976.

Digital Library

[14]

KANG, UYTTENDAELE, WINDER, AND SZELISKI. 2003. High dynamic range video. ACM Trans. on Graphic 22, 3.

Digital Library

[15]

MANN, AND PICARD. 1995. Being 'undigital' with digital cameras: Extending dynamic range by combining differently exposed pictures. In Proc. IS&T 46th ann. conference.

[16]

MARSCHNER, AND GREENBERG. 1997. Inverse lighting for photography. In Proc. IS&T/SID 5th Color Imaging Conference.

[17]

OH, CHEN, DORSEY, AND DURAND. 2001. Image-based modeling and photo editing. In Proc. SIGGRAPH.

Digital Library

[18]

PETSCHNIGG, AGRAWALA, HOPPE, SZELISKI, COHEN, AND TOYAMA. 2004. Digital photography with flash and no-flash image pairs. ACM Trans. on Graphics in this volume.

Digital Library

[19]

RASKAR, ILIE, AND YU. 2004. Image fusion for context enhancement. In Proc. NPAR.

Digital Library

[20]

REINHARD, STARK, SHIRLEY, AND FERWERDA. 2002. Photographic tone reproduction for digital images. ACM Trans. on Graphics, 21, 3.

Digital Library

[21]

SATO, SATO, AND IKEUCHI. 1999. Illumination distribution from brightness in shadows: Adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions. In ICCV.

[22]

SMITH, S. M., AND BRADY, J. M. 1997. SUSAN - a new approach to low level image processing. IJCV 23, 45--78.

Digital Library

[23]

TAPPEN, M. F., FREEMAN, W. T., AND ADELSON, E. H. 2003. Recovering intrinsic images from a single image. In NIPS.

[24]

TOMASI, C., AND MANDUCHI, R. 1998. Bilateral filtering for gray and color images. In ICCV, 836--846.

Digital Library

[25]

TUMBLIN, AND TURK. 1999. Lcis: A boundary hierarchy for detail-preserving contrast reduction. In Proc. SIGGRAPH.

Digital Library

[26]

TUMBLIN, HODGINS, AND GUENTER. 1999. Two methods for display of high contrast images. ACM Trans. on Graphics 18, 1.

Digital Library

[27]

WARD. 2004. Fast, robust image registration for compositing high dynamic range photographs from handheld exposures. J. of Graphics Tools 8, 2.

[28]

WEISS. 2001. Deriving intrinsic images from image sequences. In ICCV.

[29]

YU, DEBEVEC, MALIK, AND HAWKINS. 1999. Inverse global illumination: Recovering reflectance models of real scenes from photographs from. In Proc. SIGGRAPH.

Digital Library

[30]

ZHANG, AND LENDERS. 2000. Knowledge-based eye detection for human face recognition,. In Conf. on Knowledge-based Intelligent Systems and Allied Technologies.

Cited By

Koren Ivančević TStanić Loknar NRudolf MBratić D(2023)Manipulating Pixels in Computer Graphics by Converting Raster Elements to Vector Shapes as a Function of HueJournal of Imaging10.3390/jimaging90601069:6(106)Online publication date: 23-May-2023
https://doi.org/10.3390/jimaging9060106
Yu JNie YLong CXu WZhang QLi G(2021)Monte Carlo denoising via auxiliary feature guided self-attentionACM Transactions on Graphics10.1145/3478513.348056540:6(1-13)Online publication date: 10-Dec-2021
https://dl.acm.org/doi/10.1145/3478513.3480565
Qiao YJiao LLi WRichardt CCosker DShen HZhuang YSmith JYang YCesar PMetze FPrabhakaran B(2021)Fast, High-Quality Hierarchical Depth-Map Super-ResolutionProceedings of the 29th ACM International Conference on Multimedia10.1145/3474085.3475595(4444-4453)Online publication date: 17-Oct-2021
https://dl.acm.org/doi/10.1145/3474085.3475595
Show More Cited By

Index Terms

Flash photography enhancement via intrinsic relighting
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Image manipulation
      1. Image processing

Index terms have been assigned to the content through auto-classification.

Recommendations

Digital photography with flash and no-flash image pairs

Digital photography has made it possible to quickly and easily take a pair of images of low-light environments: one with flash to capture detail and one without flash to capture ambient illumination. We present a variety of applications that analyze and ...
Flash photography enhancement via intrinsic relighting

We enhance photographs shot in dark environments by combining a picture taken with the available light and one taken with the flash. We preserve the ambiance of the original lighting and insert the sharpness from the flash image. We use the bilateral ...
Interactive relighting with dynamic BRDFs

We present a technique for interactive relighting in which source radiance, viewing direction, and BRDFs can all be changed on the fly. In handling dynamic BRDFs, our method efficiently accounts for the effects of BRDF modification on the reflectance and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

August 2004

684 pages

ISBN:9781450378239

DOI:10.1145/1186562

Editor:
Joe Marks
Mitsubishi Electric Research Laboratories (MERL)

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH04

Sponsor:

SIGGRAPH

SIGGRAPH04: Special Interest Group on Computer Graphics and Interactive Techniques

August 8 - 12, 2004

California, Los Angeles

Acceptance Rates

SIGGRAPH '04 Paper Acceptance Rate 83 of 478 submissions, 17%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

81
Total Citations
View Citations
2,596
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Koren Ivančević TStanić Loknar NRudolf MBratić D(2023)Manipulating Pixels in Computer Graphics by Converting Raster Elements to Vector Shapes as a Function of HueJournal of Imaging10.3390/jimaging90601069:6(106)Online publication date: 23-May-2023
https://doi.org/10.3390/jimaging9060106
Yu JNie YLong CXu WZhang QLi G(2021)Monte Carlo denoising via auxiliary feature guided self-attentionACM Transactions on Graphics10.1145/3478513.348056540:6(1-13)Online publication date: 10-Dec-2021
https://dl.acm.org/doi/10.1145/3478513.3480565
Qiao YJiao LLi WRichardt CCosker DShen HZhuang YSmith JYang YCesar PMetze FPrabhakaran B(2021)Fast, High-Quality Hierarchical Depth-Map Super-ResolutionProceedings of the 29th ACM International Conference on Multimedia10.1145/3474085.3475595(4444-4453)Online publication date: 17-Oct-2021
https://dl.acm.org/doi/10.1145/3474085.3475595
Blasinski HFarrell JWandell B(2021)An iterative algorithm for spectral estimation with spatial smoothing2015 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP.2015.7350937(936-940)Online publication date: 9-Mar-2021
https://dl.acm.org/doi/10.1109/ICIP.2015.7350937
Galetto FDeng GAl-Nasrawi MWaheed W(2021)Edge-Aware Filter Based on Adaptive Patch Variance Weighted AverageIEEE Access10.1109/ACCESS.2021.31069079(118291-118306)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3106907
Liu WZhang PHuang XYang JShen CReid I(2020)Real-time Image Smoothing via Iterative Least SquaresACM Transactions on Graphics10.1145/338888739:3(1-24)Online publication date: 6-Jun-2020
https://dl.acm.org/doi/10.1145/3388887
Young SGirod BTaubman D(2020)Gaussian Lifting for Fast Bilateral and Nonlocal Means FilteringIEEE Transactions on Image Processing10.1109/TIP.2020.298435729(6082-6095)Online publication date: 2020
https://doi.org/10.1109/TIP.2020.2984357
Li YHuang JAhuja NYang M(2019)Joint Image Filtering with Deep Convolutional NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2018.289062341:8(1909-1923)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1109/TPAMI.2018.2890623
Ladefoged KMadsen C(2019)Spatially-Varying Diffuse Reflectance Capture Using Irradiance Map Rendering for Image-Based Modeling Applications2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR.2019.00-27(46-54)Online publication date: Oct-2019
https://doi.org/10.1109/ISMAR.2019.00-27
Madmad TDe Vleeschouwer C(2019)Bilateral Histogram Equalization for X-Ray Image Tone Mapping2019 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP.2019.8803516(3507-3511)Online publication date: Sep-2019
https://doi.org/10.1109/ICIP.2019.8803516
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten