skip to main content
article

Dual photography

Published: 01 July 2005 Publication History

Abstract

We present a novel photographic technique called dual photography, which exploits Helmholtz reciprocity to interchange the lights and cameras in a scene. With a video projector providing structured illumination, reciprocity permits us to generate pictures from the viewpoint of the projector, even though no camera was present at that location. The technique is completely image-based, requiring no knowledge of scene geometry or surface properties, and by its nature automatically includes all transport paths, including shadows, inter-reflections and caustics. In its simplest form, the technique can be used to take photographs without a camera; we demonstrate this by capturing a photograph using a projector and a photo-resistor. If the photo-resistor is replaced by a camera, we can produce a 4D dataset that allows for relighting with 2D incident illumination. Using an array of cameras we can produce a 6D slice of the 8D reflectance field that allows for relighting with arbitrary light fields. Since an array of cameras can operate in parallel without interference, whereas an array of light sources cannot, dual photography is fundamentally a more efficient way to capture such a 6D dataset than a system based on multiple projectors and one camera. As an example, we show how dual photography can be used to capture and relight scenes.

Supplementary Material

MP4 File (pps042.mp4)

References

[1]
Debevec, P., and Malik, J. 1997. Recovering High Dynamic Range Radiance Maps from Photographs. In SIGGRAPH '97, 369--378.
[2]
Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the Reflectance Field of a Human Face. In SIGGRAPH '00, 145--156.
[3]
Goesele, M., Lensch, H. P. A., Lang, J., Fuchs, C., and Seidel, H.-P. 2004. DISCO: Acquisition of Translucent Objects. In SIGGRAPH '04, 835--844.
[4]
Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The Lumigraph. In SIGGRAPH '96, 43--54.
[5]
Levoy, M., and Hanrahan, P. 1996. Light Field Rendering. In SIGGRAPH '96, 31--42.
[6]
Levoy, M., Chen, B., Vaish, V., Horowitz, M., McDowall, I., and Bolas, M. 2004. Synthetic Aperture Confocal Imaging. In SIGGRAPH '04, 825--834.
[7]
Masselus, V., Peers, P., Dutré, P., and Willems, Y. D. 2003. Relighting with 4D Incident Light Fields. In SIGGRAPH '03, 613--620.
[8]
Matusik, W., Pfister, H., Ngan, A., Beardsley, P., and McMillan, L. 2002. Image-Based 3D Photography Using Opacity Hulls. In SIGGRAPH '02, 427--437.
[9]
Matusik, W., Pfister, H., Ziegler, R., Ngan, A., and McMillan, L. 2002. Acquisition and Rendering of Transparent and Refractive Objects. In Eurographics Symposium on Rendering, 277--288.
[10]
Matusik, W., Loper, M., and Pfister, H. 2004. Progressively-Refined Reflectance Functions for Natural Illumination. In Eurographics Symposium on Rendering, 299--308.
[11]
Peers, P., and Dutré, P. 2003. Wavelet Environment Matting. In Eurographics Symposium on Rendering. 157--166.
[12]
Rayleigh, J. W. S. B. 1900. On the Law of Reciprocity in Diffuse Reflexion. Philosophical Magazine 49, 324--325.
[13]
Robertson, M. A., S., and Stevenson, R. L. 1999. Dynamic Range Improvement through Multiple Exposures. In Proceedings of the IEEE Intl. Conference on Image Processing (ICIP'99), 159--163.
[14]
Rusinkiewicz, S., Hall-Holt, O., and Levoy, M. 2002. Real-time 3D Model Acquisition. In SIGGRAPH '02, 438--446.
[15]
Schechner, Y. Y., Nayar, S. K., and Belhumeur, P. N. 2003. A Theory of Multiplexed Illumination. In Proceedings of the IEEE Intl. Conference on Computer Vision (ICCV '03), 808--815.
[16]
Tu, P., Mendonca, P., Ross, J., and Miller, J. 2003. Surface Registration with a Helmholtz Reciprocity Image Pair. In IEEE Workshop on Color and Photometric Methods in Computer Vision.
[17]
Veach, E. 1997. Robust Monte Carlo Methods for Light Transport Simulation. PhD thesis, Stanford University.
[18]
Von Helmholtz, H. 1856. Treatise on Physiological Optics (1925). The Optical Society of America. Electronic edition (2001): University of Pennsylvania http://psych.upenn.edu/backuslab/helmholtz.
[19]
Whitted, T. 1980. An Improved Illumination Model for Shaded Display. Commun. ACM 23, 6, 343--349.
[20]
Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Levoy, M., and Horowitz, M. 2005. High Performance Imaging using Large Camera Arrays. In SIGGRAPH '05.
[21]
Zickler, T., Belhumeur, P., and Kriegman, D. 2002. Helmholtz Stereopsis: Exploiting Reciprocity for Surface Reconstruction. Intl. Journal of Computer Vision 49, 2--3, 215--227.
[22]
Zongker, D. E., Werner, D. M., Curless, B., and Salesin, D. H. 1999. Environment Matting and Compositing. In SIGGRAPH '99, 205--214.
[23]
Zotkin, D., Duraiswami, R., Grassi, E., and Gumerov, N. 2004. Fast Head Related Transfer Function Measurement via Reciprocity. Technical Report No. CS-4620, University of Maryland.

Cited By

View all
  • (2025)Research Progress and Applications of Single-Pixel Imaging TechnologyPhotonics10.3390/photonics1202016412:2(164)Online publication date: 18-Feb-2025
  • (2025)Full-color single pixel imaging based on spatial multiplexing Walsh-Hadamard tricolor coding strategyOptics & Laser Technology10.1016/j.optlastec.2024.111875181(111875)Online publication date: Feb-2025
  • (2024)Differential high-speed aperture-coding light field microscopy for dynamic sample observation with enhanced contrastAdvanced Imaging10.3788/AI.2024.100171:3(031002)Online publication date: 2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 24, Issue 3
July 2005
826 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1073204
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2005
Published in TOG Volume 24, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. dual photography
  2. image synthesis
  3. image-based relighting

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)72
  • Downloads (Last 6 weeks)8
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Research Progress and Applications of Single-Pixel Imaging TechnologyPhotonics10.3390/photonics1202016412:2(164)Online publication date: 18-Feb-2025
  • (2025)Full-color single pixel imaging based on spatial multiplexing Walsh-Hadamard tricolor coding strategyOptics & Laser Technology10.1016/j.optlastec.2024.111875181(111875)Online publication date: Feb-2025
  • (2024)Differential high-speed aperture-coding light field microscopy for dynamic sample observation with enhanced contrastAdvanced Imaging10.3788/AI.2024.100171:3(031002)Online publication date: 2024
  • (2024)Confocal structured illumination microscopy for improving the signal-to-noise ratio and depth of fluorescent optical section imagingOptics Express10.1364/OE.53671132:18(32550)Online publication date: 23-Aug-2024
  • (2024)Embodied Visions: Interactive Installations That Reimagine Bodily Presence in Digital Imaging Apparatuses as ShadowsSIGGRAPH Asia 2024 Art Papers10.1145/3680530.3695436(1-8)Online publication date: 3-Dec-2024
  • (2024)Projection Mapping with a Brightly Lit Surrounding Using a Mixed Light Field ApproachIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337213230:5(2217-2227)Online publication date: May-2024
  • (2024)Single-Pixel Imaging of Spatio-Temporal Flows Using Differentiable Latent DynamicsIEEE Transactions on Computational Imaging10.1109/TCI.2024.343454110(1124-1138)Online publication date: 2024
  • (2024)Reciprocal Visibility for Guided Occlusion Removal With DronesIEEE Geoscience and Remote Sensing Letters10.1109/LGRS.2024.345148621(1-5)Online publication date: 2024
  • (2024)Single-Pixel Imaging Of Dynamic Flows Using Neural Ode RegularizationICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10447584(2530-2534)Online publication date: 14-Apr-2024
  • (2024)Real-time scan-free non-line-of-sight imagingAPL Photonics10.1063/5.02356879:12Online publication date: 2-Dec-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media