Direct-to-indirect transfer for cinematic relighting

ABSTRACT

This paper presents an interactive GPU-based system for cinematic relighting with multiple-bounce indirect illumination from a fixed view-point. We use a deep frame-buffer containing a set of view samples, whose indirect illumination is recomputed from the direct illumination on a large set of gather samples, distributed around the scene. This direct-to-indirect transfer is a linear transform which is particularly large, given the size of the view and gather sets. This makes it hard to precompute, store and multiply with. We address this problem by representing the transform as a set of sparse matrices encoded in wavelet space. A hierarchical construction is used to impose a wavelet basis on the unstructured gather cloud, and an image-based approach is used to map the sparse matrix computations to the GPU. We precompute the transfer matrices using a hierarchical algorithm and a variation of photon mapping in less than three hours on one processor. We achieve high-quality indirect illumination at 10-20 frames per second for complex scenes with over 2 million polygons, with diffuse and glossy materials, and arbitrary direct lighting models (expressed using shaders). We compute per-pixel indirect illumination without the need of irradiance caching or other subsampling techniques.

REFERENCES

• 1: Annen, T., Kautz, J., Durand, F., and Seidel, H.-P. 2004. Spherical harmonic gradients for mid-range illumination. In Rendering Techniques 2004 Eurographics Symposium on Rendering, 331--336.
• 2: Arikan, O., Forsyth, D. A., and O'Brien, J. F. 2005. Fast and detailed approximate global illumination by irradiance decomposition. In Proceedings of ACM SIGGRAPH 2005, 1108--1114.
• 3: Bala, K., Dorsey, J., and Teller, S. 1999. Interactive ray-traced scene editing using ray segment trees. In 10th Eurographics Workshop on Rendering, 39--52.
• 4: Kavita Bala , Julie Dorsey , Seth Teller, Radiance interpolants for accelerated bounded-error ray tracing, ACM Transactions on Graphics (TOG), v.18 n.3, p.213-256, July 1999 [doi>10.1145/336414.336417]
• 5: Bala, K., Walter, B., and Greenberg, D. 2003. Combining edges and points for interactive high-quality rendering. In Proceedings of ACM SIGGRAPH 2003, 631--640.
• 6: Ronen Barzel, Lighting controls for computer cinematography, Journal of Graphics Tools, v.2 n.1, p.1-20, 1997
• 7: Bolz, J., Farmer, I., Grinspun, E., and Schröder, P. 2003. Sparse matrix solvers on the gpu: conjugate gradients and multigrid. Proceedings of ACM SIGGRAPH 2003, 917--924.
• 8: Normand Brière , Pierre Poulin, Hierarchical view-dependent structures for interactive scene manipulation, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.83-90, August 1996 [doi>10.1145/237170.237211]
• 9: Dayal, A., Woolley, C., Watson, B., and Luebke, D. 2005. Adaptive frameless rendering. In Proceedings of Eurographics Symposium on Rendering.
• 10: Kirill Dmitriev , Stefan Brabec , Karol Myszkowski , Hans-Peter Seidel, Interactive global illumination using selective photon tracing, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 11: George Drettakis , François X. Sillion, Interactive update of global illumination using a line-space hierarchy, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.57-64, August 1997 [doi>10.1145/258734.258772]
• 12: Gautron, P., Krivanek, J., Bouatouch, K., and Pattanaik, S. 2005. Radiance cache splatting: A gpu-friendly global illumination algorithm. In Proceedings of Eurographics Symposium on Rendering.
• 13: Reid Gershbein , Pat Hanrahan, A fast relighting engine for interactive cinematic lighting design, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.353-358, July 2000 [doi>10.1145/344779.344938]
• 14: Steven J. Gortler , Peter Schröder , Michael F. Cohen , Pat Hanrahan, Wavelet radiosity, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.221-230, September 1993 [doi>10.1145/166117.166146]
• 15: Pat Hanrahan , David Salzman , Larry Aupperle, A rapid hierarchical radiosity algorithm, Proceedings of the 18th annual conference on Computer graphics and interactive techniques, p.197-206, July 1991
• 16: Henrik Wann Jensen, Global illumination using photon maps, Proceedings of the eurographics workshop on Rendering techniques '96, p.21-30, December 1996, Porto, Portugal
• 17: Jan Kautz , Peter-Pike Sloan , John Snyder, Fast, arbitrary BRDF shading for low-frequency lighting using spherical harmonics, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 18: Kristensen, A. W., Akenine-Möller, T., and Jensen, H. W. 2005. Precomputed local radiance transfer for real-time lighting design. Proceedings of ACM SIGGRAPH 2005, 1208--1215.
• 19: Liu, X., Sloan, P.-P. J., Shum, H.-Y., and Snyder, J. 2004. All-frequency precomputed radiance transfer for glossy objects. In Proceedings of Eurographics Symposium on Rendering, 337--344.
• 20: Ng, R., Ramamoorthi, R., and Hanrahan, P. 2003. All-frequency shadows using non-linear wavelet lighting approximation. Proceedings of ACM SIGGRAPH 2003, 376--381.
• 21: Ng, R., Ramamoorthi, R., and Hanrahan, P. 2004. Triple product wavelet integrals for all-frequency relighting. Proceedings of ACM SIGGRAPH 2004, 477--487.
• 22: Pellacini, F., Vidimĉe?, K., Lefohn, A., Mohr, A., Leone, M., and Warren, J. 2005. Lpics: a hybrid hardware-accelerated relighting engine for computer cinematography. Proceedings of ACM SIGGRAPH 2005, 464--470.
• 23: Takafumi Saito , Tokiichiro Takahashi, Comprehensible rendering of 3-D shapes, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.197-206, September 1990, Dallas, TX, USA
• 24: Takafumi Saito , Tokiichiro Takahashi, Comprehensible rendering of 3-D shapes, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.197-206, September 1990, Dallas, TX, USA
• 25: C. H. Séquin , E. K. Smyrl, Parameterized Ray-tracing, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.307-314, July 1989
• 26: Peter-Pike Sloan , Jan Kautz , John Snyder, Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 27: Brian E. Smits , James R. Arvo , David H. Salesin, An importance-driven radiosity algorithm, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.273-282, July 1992
• 28: Tabellion, E., and Lamorlette, A. 2004. An approximate global illumination system for computer generated films. Proceedings of ACM SIGGRAPH 2005, 469--476.
• 29: Parag Tole , Fabio Pellacini , Bruce Walter , Donald P. Greenberg, Interactive global illumination in dynamic scenes, Proceedings of the 29th annual conference on Computer graphics and interactive techniques, July 23-26, 2002, San Antonio, Texas
• 30: Ingo Wald , Thomas Kollig , Carsten Benthin , Alexander Keller , Philipp Slusallek, Interactive global illumination using fast ray tracing, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 31: Walter, B., Drettakis, G., and Parker, S. 1999. Interactive rendering using the Render Cache. In 10th Eurographics Workshop on Rendering, 19--30.
• 32: Bruce Walter , George Drettakis , Donald P. Greenberg, Enhancing and optimizing the render cache, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 33: Walter, B., Fernandez, S., Arbree, A., Bala, K., Donikian, M., and Greenberg, D. P. 2005. Lightcuts: A scalable approach to illumination. In Proceedings of ACM SIGGRAPH 2005, 1098--1107.
• 34: Wang, R., Tran, J., and Luebke, D. P. 2004. All-frequency relighting of non-diffuse objects using separable brdf approximation. In Proceedings of Eurographics Symposium on Rendering, 345--354.
• 35: Wang, R., Tran, J., and Luebke, D. 2005. All-frequency interactive relighting of translucent objects with single and multiple scattering. Proceedings of ACM SIGGRAPH 2005, 1202--1207.
• 36: Gregory Ward , Maryann Simmons, The holodeck ray cache: an interactive rendering system for global illumination in nondiffuse environments, ACM Transactions on Graphics (TOG), v.18 n.4, p.361-368, Oct. 1999 [doi>10.1145/337680.337722]
• 37: Gregory J. Ward , Francis M. Rubinstein , Robert D. Clear, A ray tracing solution for diffuse interreflection, Proceedings of the 15th annual conference on Computer graphics and interactive techniques, p.85-92, June 1988

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

Keywords:
indirect illumination, precomputed radiance transfer, real-time rendering, relighting