Abstract
Glare arises due to multiple scattering of light inside the camera's body and lens optics and reduces image contrast. While previous approaches have analyzed glare in 2D image space, we show that glare is inherently a 4D ray-space phenomenon. By statistically analyzing the ray-space inside a camera, we can classify and remove glare artifacts. In ray-space, glare behaves as high frequency noise and can be reduced by outlier rejection. While such analysis can be performed by capturing the light field inside the camera, it results in the loss of spatial resolution. Unlike light field cameras, we do not need to reversibly encode the spatial structure of the ray-space, leading to simpler designs. We explore masks for uniform and non-uniform ray sampling and show a practical solution to analyze the 4D statistics without significantly compromising image resolution. Although diffuse scattering of the lens introduces 4D low-frequency glare, we can produce useful solutions in a variety of common scenarios. Our approach handles photography looking into the sun and photos taken without a hood, removes the effect of lens smudges and reduces loss of contrast due to camera body reflections. We show various applications in contrast enhancement and glare manipulation.
Supplemental Material
- Adelson, T., and Wang, J. 1992. Single lens stereo with a plenoptic camera. IEEE Trans. Pattern Anal. Machine Intell. 14, 99--106. Google ScholarDigital Library
- Apogee Instruments. Blooming vs. anti-blooming by ccd university. http://www.ccd.com/ccd102.html.Google Scholar
- Bitlis, B., Jansson, P. A., and Allebach, J. P. 2007. Parametric point spread function modeling and reduction of stray light effects in digital still cameras. Computational Imaging V, SPIE 6498, 29--31.Google Scholar
- Boykov, Y., and Kolmogorov, V. 2004. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Machine Intell. 26 (Sept.), 1124--1137. Google ScholarDigital Library
- Debevec, P. E., and Malik, J. 1997. Recovering high dynamic range radiance maps from photographs. In SIGGRAPH '97, 369--378. Google ScholarDigital Library
- Garg, G., Talvala, E.-V., Levoy, M., and Lensch, H. P. A. 2006. Symmetric photography: Exploiting data-sparseness in reflectance fields. In Rendering Techniques 2006: 17th Eurographics Workshop on Rendering, 251--262. Google ScholarCross Ref
- Georgiev, T., Zheng, C., Nayar, S., Curless, B., Salasin, D., and Intwala, C. 2006. Spatio-angular resolution tradeoffs in integral photography. In Eurographics Symposium on Rendering, 263--272. Google ScholarCross Ref
- Gortler, S., Grzeszczuk, R., Szeliski, R., and Cohen, M. 1996. The lumigraph. In SIGGRAPH '96, 43--54. Google ScholarDigital Library
- Goszczynska, H., Doria-Dernalowicz, J., Purzycki, Z., and Leszcznski, L. 2000. Estimation of the x-ray scatter and veiling glare rate in coronarographic densitometric measurements. In Engineering in Medicine and Biology Society, 2000. Proc. 22nd Annual Intl. Conf. IEEE, vol. 3, 1714--1716.Google Scholar
- Hanrahan, P., and Ng, R. 2006. Digital correction of lens aberrations in light field photography. In International Optical Design, Optical Society of America, WB2.Google Scholar
- International Organization For Standardization. 1994. Optics and optical instruments veiling glare of image forming systems definitions and methods of measurement. ISO 9358:1994.Google Scholar
- Kakimoto, M., Matsuoka, K., Nishita, T., Naemura, T., and Harashima, H. 2005. Glare generation based on wave optics. Computer Graphics Forum 24, 2 (June), 185--194.Google ScholarCross Ref
- Knoll Light Factory. Glare creation software. http://www.digitalanarchy.com/knollPS/ (Photoshop Plugin).Google Scholar
- Levoy, M., and Hanrahan, P. 1996. Light field rendering. In SIGGRAPH 96, 31--42. Google ScholarDigital Library
- Levoy, M., Ng, R., Adams, A., Footer, M., and Horowitz, M. 2006. Light field microscopy. ACM Trans. Graph 25, 924--934. Google ScholarDigital Library
- Mccann, J. J., and Rizzi, A. 2007. Veiling glare: The dynamic range limit of hdr images. In Human Vision and Electronic Imaging XII, SPIE, vol. 6492.Google Scholar
- Nayar, S. K., Krishnan, G., Grossberg, M. D., and Raskar, R. 2006. Fast separation of direct and global components of a scene using high frequency illumination. ACM Trans. Graph. 25, 3 (July), 935--944. Google ScholarDigital Library
- Ng, R., Levoy, M., Brdif, M., Duval, G., Horowitz, M., and Hanrahan, P. 2005. Light field photography with a hand-held plenoptic camera. Tech. rep., Stanford Univ.Google Scholar
- Ray, S. F. 2002. Applied Photographic Optics: Lenses and Optical Systems for Photography, 3rd edition ed. Focal Press.Google Scholar
- Reinhard, E., Ward, G., Pattanaik, S., and Debevec, P. 2006. High Dynamic Range Imaging - Acquisition, Display and Image-based Lighting. Morgan Kaufman Publishers, 500 Sansome Street, Suite 400, San Francisco, CA 94111. Google ScholarDigital Library
- Seibert, J. A., Nalcioglu, O., and Roeck, W. 1985. Removal of image intensifier veiling glare by mathematical deconvolution techniques. Medical physics 12, 3, 281288.Google Scholar
- Sen, P., Chen, B., Garg, G., Marschner, S., Horowitz, M., Levoy, M., and Hendrik, P. A. L. 2005. Dual photography. ACM Trans. Graph. 24, 745--755. Google ScholarDigital Library
- Skinner, G. K. 1988. X-Ray Imaging with Coded Masks. Scientific American 259 (Aug.), 84.Google ScholarCross Ref
- Spencer, G., Shirley, P. S., Zimmerman, K., and Greenberg, D. P. 1995. Physically-based glare effects for digital images. In SIGGRAPH '95, 325--334. Google ScholarDigital Library
- Talvala, E.-V., Adams, A., Horowitz, M., and Levoy, M. 2007. Veiling glare in high dynamic range imaging. ACM Trans. Graph. 26, 3 (July), 37:1--37:9. Google ScholarDigital Library
- Vaish, V., Levoy, M., Szeliski, R., Zitnick, L., and Kang, S. 2006. Reconstructing occluded surfaces using synthetic apertures: Stereo, focus and robust measures. In Proc. Conf. Computer Vision and Pattern Recognition, vol. 2, 2331--2338. Google ScholarDigital Library
- Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., and Tumblin, J. 2007. Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph. 26, 3 (July), 69:1--69:12. Google ScholarDigital Library
Index Terms
Glare aware photography: 4D ray sampling for reducing glare effects of camera lenses
Recommendations
Physically-based glare effects for digital images
SIGGRAPH '95: Proceedings of the 22nd annual conference on Computer graphics and interactive techniquesVeiling glare in high dynamic range imaging
The ability of a camera to record a high dynamic range image, whether by taking one snapshot or a sequence, is limited by the presence of veiling glare - the tendency of bright objects in the scene to reduce the contrast everywhere within the field of ...
Shield fields: modeling and capturing 3D occluders
We describe a unified representation of occluders in light transport and photography using shield fields: the 4D attenuation function which acts on any light field incident on an occluder. Our key theoretical result is that shield fields can be used to ...
Comments