Precomputed local radiance transfer for real-time lighting design

Abstract

This paper introduces a new method for real-time relighting of scenes illuminated by local light sources. We extend previous work on precomputed radiance transfer for distant lighting to local lighting by introducing the concept of unstructured light clouds. The unstructured light cloud enables a compact representation of local lights in the model and real-time rendering of complex models with full global illumination due to local light sources. We use simplification of lights, and clustered PCA to obtain a compressed representation. When storing only the indirect component of the illumination, we are able to get high quality with only 8-16 lighting coefficients per vertex. Our results demonstrate real-time rendering of scenes with moving lights, dynamic cameras, glossy materials and global illumination.

References

1. Annen, T., Kautz, J., Durand, F., and Seidel, H.-P. 2004. Spherical Harmonic Gradients for Mid-Range Illumination. In Eurographics Symposium on Rendering, 331--336.
2. Assarsson, U., and Akenine-Möller, T. 2003. A Geometry-Based Soft Shadow Volume Algorithm using Graphics Hardware. ACM Transactions on Graphics, 22, 3, 511--520.
3. Bentley, J. L. 1975. Multidimensional Binary Search Trees Used for Associative Searching. Communications of the ACM 18, 9, 509--517.
4. Brière, N., and Poulin, P. 1996. Hierarchical View-Dependent Structures for Interactive Scene Manipulation. In Proceedings of ACM SIGGRAPH 96, ACM Press / ACM SIGGRAPH, New York, ACM, 83--90.
5. Chen, W.-C., Bouguet, J.-Y., Chu, M. H., and Grzeszczuk, R. 2002. Light Field Mapping: Efficient Representation and Hardware Rendering of Surface Light Fields. ACM Transactions on Graphics 21, 3, 447--456.
6. Dobashi, Y., Kaneda, K., Nakatani, H., and Yamashita, H. 1995. A Quick Rendering Method Using Basis Functions for Interactive Lighting Design. Computer Graphics Forum 14, 3, 229--240.
7. Dorsey, J. O., Sillion, F. X., and Greenberg, D. P. 1991. Design and Simulation of Opera Lighting and Projection Effects. In Computer Graphics (Proceedings of ACM SIGGRAPH 91), ACM, 41--50.
8. Dorsey, J., Arvo, J., and Greenberg, D. 1995. Interactive Design of Complex Time-Dependent Lighting. IEEE Computer Graphics & Applications 15, 2, 26--36.
9. Gershbein, R., and Hanrahan, P. 2000. A Fast Relighting Engine for Interactive Cinematic Lighting Design. In Proceedings of ACM SIGGRAPH 2000, ACM Press / ACM SIGGRAPH, New York, ACM, 353--358.
10. Jensen, H. W. 2001. Realistic Image Synthesis using Photon Mapping. AK Peters Ltd.
11. Johnson, R. A., and Wichern, D. W. 2002. Applied Multivariate Statistical Analysis. Prentice Hall.
12. Kajiya, J. T. 1986. The Rendering Equation. In Computer Graphics (Proceedings of ACM SIGGRAPH 86), ACM, 143--150.
13. Kambhatla, N., and Leen, T. K. 1997. Dimension Reduction by Local Principal Component Analysis. Neural Comput. 9, 7, 1493--1516.
14. Kautz, J., Sloan, P.-P., and Snyder, J. 2002. Fast, Arbitrary BRDF Shading for Low-Frequency Lighting using Spherical Harmonics. In Proceedings of the 13th Eurographics workshop on Rendering, 291--296.
15. Liu, X., Sloan, P.-P., Shum, H.-Y., and Snyder, J. 2004. All-Frequency Precomputed Radiance Transfer for Glossy Objects. In Eurographics Symposium on Rendering.
16. Ng, R., Ramamoorthi, R., and Hanrahan, P. 2003. All-Frequency Shadows using Non-Linear Wavelet Lighting Approximation. ACM Transactions on Graphics 22, 3, 376--381.
17. Ng, R., Ramamoorthi, R., and Hanrahan, P. 2004. Triple Product Wavelet Integrals for All-Frequency Relighting. ACM Transactions on Graphics 23, 3, 477--487.
18. Nimeroff, J. S., Simoncelli, E., and Dorsey, J. 1994. Efficient Re-rendering of Naturally Illuminated Environments. In Fifth Eurographics Workshop on Rendering, 359--373.
19. Ramamoorthi, R., and Hanrahan, P. 2002. Frequency Space Environment Map Rendering. ACM Transactions on Graphics 21, 3, 517--526.
20. Séquin, C. H., and Smyrl, E. K. 1989. Parameterized Ray Tracing. In Computer Graphics (Proceedings of ACM SIGGRAPH 89), ACM, 307--314.
21. Silverman, B. 1986. Density Estimation for Statistics and Data Analysis. Chapman and Hall.
22. Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments. ACM Transactions on Graphics 22, 3, 527--536.
23. Sloan, P.-P., Hall, J., Hart, J., and Snyder, J. 2003. Clustered Principal Components for Precomputed Radiance Transfer. ACM Transactions on Graphics 22, 3, 382--391.
24. Teo, P. C., Simoncelli, E. P., and Heeger, D. J. 1997. Efficient Linear Re-rendering for Interactive Lighting Design. Tech. Rep. STAN-CS-TN-97-60.
25. Wald, I., Kollig, T., Benthin, C., Keller, A., and Slusallek, P. 2002. Interactive Global Illumination using Fast Ray Tracing. In 13th Eurographics Workshop on Rendering, 15--24.
26. Wang, R., Tran, J., and Luebke, D. 2004. All-Frequency Relighting of Non-Diffuse Objects using Separable BRDF Approximation. In Eurographics Symposium on Rendering.
27. Wood, D. N., Azuma, D. I., Aldinger, K., Curless, B., Duchamp, T., Salesin, D. H., and Stuetzle, W. 2000. Surface Light Fields for 3D Photography. In Proceedings of ACM SIGGRAPH 2000, ACM Press / ACM SIGGRAPH, New York, ACM, 287--296.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Image and video acquisition

        • 3D imaging

  • Computer graphics

    • Animation