4D compression and relighting with high-resolution light transport matrices

ABSTRACT

This paper presents a method for efficient compression and relighting with high-resolution, precomputed light transport matrices. We accomplish this using a 4D wavelet transform, transforming the columns of the transport matrix, in addition to the 2D row transform used in previous work. We show that a standard 4D wavelet transform can actually inflate portions of the matrix, because high-frequency lights lead to high-frequency images that cannot easily be compressed. Therefore, we present an adaptive 4D wavelet transform that terminates at a level that avoids inflation and maximizes sparsity in the matrix data. Finally, we present an algorithm for fast relighting from adaptively compressed transport matrices. Combined with a GPU-based precomputation pipeline, this results in an image and geometry relighting system that performs significantly better than 2D compression techniques, on average 2x-3x better in terms of storage cost and rendering speed for equal quality matrices.

REFERENCES

• 1: Daubechies, I. 1988. Orthonormal bases of compactly supported wavelets. Communications on Pure and Applied Mathematics, 41, 909--996.
• 2: Xianfeng Gu , Steven J. Gortler , Hugues Hoppe, Geometry images, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 3: Miloš Hašan , Fabio Pellacini , Kavita Bala, Direct-to-indirect transfer for cinematic relighting, ACM SIGGRAPH 2006 Papers, July 30-August 03, 2006, Boston, Massachusetts
• 4: Jan Kautz , Peter-Pike Sloan , John Snyder, Fast, arbitrary BRDF shading for low-frequency lighting using spherical harmonics, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 5: Kautz, J., Lehtinen, J., and Aila, T. 2004. Hemispherical rasterization for self-shadowing of dynamic objects. In Eurographics Symposium on Rendering, Eurographics Association, Norrkping, Sweden, A. Keller and H. W. Jensen, Eds., 179--184.
• 6: Janne Kontkanen , Samuli Laine, Ambient occlusion fields, Proceedings of the 2005 symposium on Interactive 3D graphics and games, April 03-06, 2005, Washington, District of Columbia [doi>10.1145/1053427.1053434]
• 7: Kontkanen, J., Turquin, E., Holzschuch, N., and Sillion, F. 2006. Wavelet radiance transport for interactive indirect lighting. In Rendering Techniques 2006 (Eurographics Symposium on Rendering), W. Heidrich and T. Akenine-Möller, Eds., Eurographics.
• 8: Aaron W. F. Lee , Wim Sweldens , Peter Schröder , Lawrence Cowsar , David Dobkin, MAPS: multiresolution adaptive parameterization of surfaces, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.95-104, July 1998 [doi>10.1145/280814.280828]
• 9: Liu, X., Sloan, P.-P., Shum, H.-Y., and Snyder, J. 2004. All-frequency precomputed radiance transfer for glossy objects. 337--344.
• 10: Ren Ng , Ravi Ramamoorthi , Pat Hanrahan, All-frequency shadows using non-linear wavelet lighting approximation, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 11: Ren Ng , Ravi Ramamoorthi , Pat Hanrahan, Triple product wavelet integrals for all-frequency relighting, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 12: Overbeck, R., Ben-Artzi, A., Ramamoorthi, R., and Grinspun, E. 2006. Exploiting temporal coherence for incremental all-frequency relighting. In Eurographics Symposium on Rendering, Eurographics Association, 151--160.
• 13: Emil Praun , Hugues Hoppe, Spherical parametrization and remeshing, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 14: Zhong Ren , Rui Wang , John Snyder , Kun Zhou , Xinguo Liu , Bo Sun , Peter-Pike Sloan , Hujun Bao , Qunsheng Peng , Baining Guo, Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 15: Peter-Pike Sloan , Jan Kautz , John Snyder, Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 16: Peter-Pike Sloan , Jesse Hall , John Hart , John Snyder, Clustered principal components for precomputed radiance transfer, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 17: Peter-Pike Sloan , Ben Luna , John Snyder, Local, deformable precomputed radiance transfer, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 18: Weifeng Sun , Amar Mukherjee, Generalized wavelet product integral for rendering dynamic glossy objects, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 19: Yu-Ting Tsai , Zen-Chung Shih, All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 20: Wang, R., Tran, J., and Luebke, D. 2004. All-frequency relighting of non-diffuse objects using separable BRDF approximation. In Proceedings of the Eurographics Symposium on Rendering, 345--354.
• 21: Rui Wang , John Tran , David Luebke, All-frequency interactive relighting of translucent objects with single and multiple scattering, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 22: Wang, R., Ng, R., Luebke, D., and Humphreys, G. 2006. Efficient wavelet rotation for environment map rendering. In Eurographics Symposium on Rendering, Eurographics Association, 173--182.
• 23: Kun Zhou , Yaohua Hu , Stephen Lin , Baining Guo , Heung-Yeung Shum, Precomputed shadow fields for dynamic scenes, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation

Additional Classification:
  G. Mathematics of Computing
  G.1 NUMERICAL ANALYSIS
      G.1.2 Approximation
          Subjects: Wavelets and fractals; Nonlinear approximation

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Keywords:
nonlinear approximation, pre-computed radiance transfer, relighting, wavelet compression