Towards passive 6D reflectance field displays

ABSTRACT

Traditional flat screen displays present 2D images. 3D and 4D displays have been proposed making use of lenslet arrays to shape a fixed outgoing light field for horizontal or bidirectional parallax. In this article, we present different designs of multi-dimensional displays which passively react to the light of the environment behind. The prototypes physically implement a reflectance field and generate different light fields depending on the incident illumination, for example light falling through a window. We discretize the incident light field using an optical system, and modulate it with a 2D pattern, creating a flat display which is view and illumination-dependent. It is free from electronic components. For distant light and a fixed observer position, we demonstrate a passive optical configuration which directly renders a 4D reflectance field in the real-world illumination behind it. We further propose an optical setup that allows for projecting out different angular distributions depending on the incident light direction. Combining multiple of these devices we build a display that renders a 6D experience, where the incident 2D illumination influences the outgoing light field, both in the spatial and in the angular domain. Possible applications of this technology are time-dependent displays driven by sunlight, object virtualization and programmable light benders / ray blockers without moving parts.

References

1. Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 145--156.
2. Fuchs, M., Blanz, V., Lensch, H. P. A., and Seidel, H.-P. 2007. Adaptive sampling of reflectance fields. ACM Transactions on Graphics (TOG) 26, 2 (June).
3. Georgiev, T., Zheng, K. C., Curless, B., Salesin, D., Nayar, S., and Intwala, C. 2006. Spatio-angular resolution trade-offs in integral photography. In Rendering Techniques 2006: Eurographics Symposium on Rendering, 263--272.
4. Gerrard, A., and Burch, J. M. 1975. Introduction to Matrix Methods in Optics. John Wiley & Sons, New York - Chichester - Brisbane.
5. Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 297--306.
6. Javidi, B., and Okano, F. (Ed.). 2001. Three-dimensional video and display: devices and systems. SPIE, Washington, USA.
7. Koike, T., and Naemura, T. 2007. BRDF display. SIGGRAPH 2007 poster presentation.
8. Levoy, M., Ng, R., Adams, A., Footer, M., and Horowitz, M. 2006. Light field microscopy. ACM Trans. Graph. (Proc. SIGGRAPH) 25, 3, 924--934.
9. Lippmann, G. 1908. Epreuves reversibles donnant la sensation du relief. Journal of Physics 7, 821--825.
10. Matusik, W., and Pfister, H. 2004. 3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. ACM Trans. Graph. (Proc. SIGGRAPH) 23, 3, 814--824.
11. Min, C., Wang, P., Jiao, X., Deng, Y., and Ming, H. 2007. Beam manipulating by metallic nano-optic lens containing nonlinear media. Opt. Express 15, 15, 9541--9546.
12. Nakajima, S., Nakamura, K., Masamune, K., Sakuma, I., and T., T. D. 2001. Three-dimensional medical imaging display with computer-generated integral photography. Computerized Medical Imaging and Graphics 25, 235--241.
13. Nayar, S. K., Belhumeur, P. N., and Boult, T. E. 2004. Lighting sensitive display. ACM Trans. Graph. 23, 4, 963--979.
14. Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., and Hanrahan, P. 2005. Light field photography with a hand-held plenoptic camera. Stanford University Computer Scienece Tech Report.
15. Scharstein, H., Krotz-Vogel, W., and Scharstein, D. 1996. Digital sundial. In US patent 5 590 093, German patent 4 431 817.
16. Sun, Z., and Kim, H. K. 2004. Refractive transmission of light and beam shaping with metallic nano-optic lenses. Appl. Phys. Lett. 85, 652.
17. Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., and Tumblin, J. 2007. Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3, 69.
18. Ziegler, R., Bucheli, S., Ahrenberg, L., Magnor, M., and Gross, M. 2007. A bidirectional light field - hologram transform. In Computer Graphics Forum (Proc. Eurographics), D. Cohen Or and P. Slavik, Eds., vol. 26, 435--446.

Index Terms

• Computing methodologies

  • Computer graphics

    • Image manipulation

      • Texturing

    • Rendering

      • Reflectance modeling