ABSTRACT
Traditional flat screen displays present 2D images. 3D and 4D displays have been proposed making use of lenslet arrays to shape a fixed outgoing light field for horizontal or bidirectional parallax. In this article, we present different designs of multi-dimensional displays which passively react to the light of the environment behind. The prototypes physically implement a reflectance field and generate different light fields depending on the incident illumination, for example light falling through a window. We discretize the incident light field using an optical system, and modulate it with a 2D pattern, creating a flat display which is view and illumination-dependent. It is free from electronic components. For distant light and a fixed observer position, we demonstrate a passive optical configuration which directly renders a 4D reflectance field in the real-world illumination behind it. We further propose an optical setup that allows for projecting out different angular distributions depending on the incident light direction. Combining multiple of these devices we build a display that renders a 6D experience, where the incident 2D illumination influences the outgoing light field, both in the spatial and in the angular domain. Possible applications of this technology are time-dependent displays driven by sunlight, object virtualization and programmable light benders / ray blockers without moving parts.
Supplemental Material
Available for Download
- Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 145--156. Google ScholarDigital Library
- Fuchs, M., Blanz, V., Lensch, H. P. A., and Seidel, H.-P. 2007. Adaptive sampling of reflectance fields. ACM Transactions on Graphics (TOG) 26, 2 (June). Google ScholarDigital Library
- Georgiev, T., Zheng, K. C., Curless, B., Salesin, D., Nayar, S., and Intwala, C. 2006. Spatio-angular resolution trade-offs in integral photography. In Rendering Techniques 2006: Eurographics Symposium on Rendering, 263--272. Google ScholarDigital Library
- Gerrard, A., and Burch, J. M. 1975. Introduction to Matrix Methods in Optics. John Wiley & Sons, New York - Chichester - Brisbane.Google Scholar
- Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 297--306. Google ScholarDigital Library
- Javidi, B., and Okano, F. (Ed.). 2001. Three-dimensional video and display: devices and systems. SPIE, Washington, USA. Google ScholarDigital Library
- Koike, T., and Naemura, T. 2007. BRDF display. SIGGRAPH 2007 poster presentation. Google ScholarDigital Library
- Levoy, M., Ng, R., Adams, A., Footer, M., and Horowitz, M. 2006. Light field microscopy. ACM Trans. Graph. (Proc. SIGGRAPH) 25, 3, 924--934. Google ScholarDigital Library
- Lippmann, G. 1908. Epreuves reversibles donnant la sensation du relief. Journal of Physics 7, 821--825.Google Scholar
- Matusik, W., and Pfister, H. 2004. 3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. ACM Trans. Graph. (Proc. SIGGRAPH) 23, 3, 814--824. Google ScholarDigital Library
- Min, C., Wang, P., Jiao, X., Deng, Y., and Ming, H. 2007. Beam manipulating by metallic nano-optic lens containing nonlinear media. Opt. Express 15, 15, 9541--9546.Google ScholarCross Ref
- Nakajima, S., Nakamura, K., Masamune, K., Sakuma, I., and T., T. D. 2001. Three-dimensional medical imaging display with computer-generated integral photography. Computerized Medical Imaging and Graphics 25, 235--241.Google ScholarCross Ref
- Nayar, S. K., Belhumeur, P. N., and Boult, T. E. 2004. Lighting sensitive display. ACM Trans. Graph. 23, 4, 963--979. Google ScholarDigital Library
- Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., and Hanrahan, P. 2005. Light field photography with a hand-held plenoptic camera. Stanford University Computer Scienece Tech Report.Google Scholar
- Scharstein, H., Krotz-Vogel, W., and Scharstein, D. 1996. Digital sundial. In US patent 5 590 093, German patent 4 431 817.Google Scholar
- Sun, Z., and Kim, H. K. 2004. Refractive transmission of light and beam shaping with metallic nano-optic lenses. Appl. Phys. Lett. 85, 652.Google ScholarCross Ref
- Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., and Tumblin, J. 2007. Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3, 69. Google ScholarDigital Library
- Ziegler, R., Bucheli, S., Ahrenberg, L., Magnor, M., and Gross, M. 2007. A bidirectional light field - hologram transform. In Computer Graphics Forum (Proc. Eurographics), D. Cohen Or and P. Slavik, Eds., vol. 26, 435--446.Google Scholar
Index Terms
- Towards passive 6D reflectance field displays
Recommendations
Programmable aperture photography: multiplexed light field acquisition
SIGGRAPH '08: ACM SIGGRAPH 2008 papersIn this paper, we present a system including a novel component called programmable aperture and two associated post-processing algorithms for high-quality light field acquisition. The shape of the programmable aperture can be adjusted and used to ...
Light field transfer: global illumination between real and synthetic objects
SIGGRAPH '08: ACM SIGGRAPH 2008 papersWe present a novel image-based method for compositing real and synthetic objects in the same scene with a high degree of visual realism. Ours is the first technique to allow global illumination and near-field lighting effects between both real and ...
Comments