Path tracing in production - part 1: production renderers

ABSTRACT

The last few years have seen a decisive move of the movie making industry towards rendering using physically-based methods, mostly implemented in terms of path tracing. Increasing demands on the realism of lighting, rendering and material modeling, paired with a working paradigm that very naturally models the behaviour of light like in the real world mean that more and more movies each year are created the physically-based way. This shift has also been recently recognised by the Academy of Motion Picture Arts and Sciences, which in this year's SciTech ceremony has awarded three ray tracing renderers for their crucial contribution to this move. While the language and toolkit available to the technical directors get closer and closer to natural language, an understanding of the techniques and algorithms behind the workings of the renderer of choice are still of fundamental importance to make efficient use of the available resources, especially when the hard-learned lessons and tricks from the previous world of rasterization-based rendering can introduce confusion and cause costly mistakes. In this course, the architectures and novel possibilities of the next generation of production renderers are introduced to a wide audience including technical directors, artists, and researchers.

This is the first part of a two part course. While the first part focuses on architecture and implementation, the second one focuses on usage patterns and workflows.

References

1. Subrahmanyan Chandrasekar. 1960. Radiative Transfer. Dover Publications Inc. ISBN 0-486-60590-6.
2. Sergej Mikhailovich Ermakow. 1975. Die Monte Carlo Methode und verwandte Fragen. VEB Deutscher Verlag der Wissenschaften.
3. Frederic J. Harris. 1978. On the use of windows for harmonic analysis with the discrete Fourier transform. Proc. IEEE 66, 1 (1978), 51--83.
4. James T. Kajiya. 1986. The rendering equation. Computer Graphics (Proc. SIGGRAPH) (1986), 143--150.
5. Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2017. Physically Based Rendering: From Theory to Implementation (3rd ed.). Morgan Kaufmann Publishers Inc.
6. Ilya Sobol'. 1994. A Primer for the Monte Carlo Method. CRC Press.
7. Eric Veach. 1998. Robust Monte Carlo Methods for Light Transport Simulation. Ph.D. Dissertation. Stanford, CA, USA. Advisor(s) Guibas, Leonidas J.
8. James Arvo. 2001. Stratified Sampling of 2-Manifolds.
9. Robert L. Cook, Thomas Porter, and Loren Carpenter. 1984. Distributed Ray Tracing. SIGGRAPH Comput. Graph. 18, 3 (Jan. 1984), 137--145.
10. Iliyan Georgiev and Marcos Fajardo. 2016. Blue-noise Dithered Sampling. In ACM SIGGRAPH 2016 Talks.
11. Andrew S. Glassner (Ed.). 1989. An Introduction to Ray Tracing. Academic Press Ltd., London, UK, UK.
12. Andrew S. Glassner. 1994. Principles of Digital Image Synthesis. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
13. Ibón Guillén, Carlos Ureña, Alan King, Marcos Fajardo, Iliyan Georgiev, Jorge López-Moreno, and Adrian Jarabo. 2017. Area-Preserving Parameterizations for Spherical Ellipses. Computer Graphics Forum (Proceedings of EGSR) 36, 4 (2017).
14. Eric Haines. 1987--2010. http://raytracingnews.org. (1987--2010).
15. Alan King, Christopher Kulla, Alejandro Conty, and Marcos Fajardo. 2013. BSSRDF Importance Sampling. In ACM SIGGRAPH 2013 Talks (SIGGRAPH '13).
16. Christopher Kulla and Marcos Fajardo. 2012. Importance Sampling Techniques for Path Tracing in Participating Media. Comput. Graph. Forum 31, 4 (June 2012).
17. Eric Lafortune and Yves Willems. 1993. Bi-Directional Path Tracing. In Proc. of COMPUGRAPHICS. 145--153.
18. Peter Shirley. 1992. Time Complexity of Monte Carlo Radiosity. (1992).
19. Peter Shirley and Kenneth Chiu. 1994. Notes on Adaptive Quadrature on the Hemisphere. (1994).
20. Peter S. Shirley. 1991. Physically Based Lighting Calculations for Computer Graphics. Ph.D. Dissertation. Champaign, IL, USA. UMI Order NO. GAX91-24487.
21. Carlos Ureña, Marcos Fajardo, and Alan King. 2013. An Area-preserving Parametrization for Spherical Rectangles. In Proceedings of the Eurographics Symposium on Rendering (EGSR '13).
22. Eric Veach and Leonidas Guibas. 1994. Bidirectional Estimators for Light Transport. 147--162.
23. Anthony Apodaca and Larry Gritz. 2000. Advanced RenderMan: Creating CGI for Motion Pictures. Morgan Kaufmann.
24. Brent Burley. 2015. Extending the Disney BRDF to a BSDF with integrated subsurface scattering. In 'Physically Based Shading in Theory and Practice' SIGGRAPH Course.
25. Per Christensen. 2008. Point-based approximate color bleeding. Technical Report 08-01. Pixar Animation Studios.
26. Per Christensen and Brent Burley. 2015. Approximate reflectance profiles for efficient subsurface scattering. Technical Report 15-04. Pixar Animation Studios.
27. Per Christensen, George Harker, Jonathan Shade, Brenden Schubert, and Dana Batali. 2012. Multiresolution radiosity caching for global illumination in movies. In SIGGRAPH Tech Talks.
28. Per Christensen, David Laur, Julian Fong, Wayne Wooten, and Dana Batali. 2003. Ray differentials and multiresolution geometry caching for distribution ray tracing in complex scenes. Computer Graphics Forum (Proceedings of Eurographics) 22, 3 (2003), 543--552.
29. Robert Cook, Loren Carpenter, and Edwin Catmull. 1987. The Reyes image rendering architecture. Computer Graphics (Proceedings of SIGGRAPH) 21, 4 (1987), 95--102.
30. Robert Cook, Thomas Porter, and Loren Carpenter. 1984. Distributed ray tracing. Computer Graphics (Proceedings of SIGGRAPH) 18, 3 (1984), 137--145.
31. Eugene d'Eon and Geoffrey Irving. 2011. A quantized-diffusion model for rendering translucent materials. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 30, 4 (2011), 56:1--56:14.
32. Julian Fong, Ralf Habel, Magnus Wrenninge, and Christopher Kulla. 2017. Production Volume Rendering. In SIGGRAPH Courses.
33. Iliyan Georgiev, Jaroslav Křivánek, Tomas Davidovic, and Philipp Slusallek. 2012. Light transport simulation with vertex connection and merging. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) 31, 6 (2012).
34. Ralf Habel, Per Christensen, and Wojciech Jarosz. 2013. Photon beam diffusion: a hybrid Monte Carlo method for subsurface scattering. Computer Graphics Forum (Proceedings of the Eurographics Symposium on Rendering) 32, 4 (2013), 27--37.
35. Toshiya Hachisuka, Shinji Ogaki, and Henrik Wann Jensen. 2008. Progressive photon mapping. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) 27, 5 (2008).
36. Toshiya Hachisuka, Jacopo Pantaleoni, and Henrik Wann Jensen. 2012. A path space extension for robust light transport simulation. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) 31, 6 (2012).
37. Christophe Hery and Ravi Ramamoorthi. 2012. Importance sampling of reflections from hair fibers. Technical Report 12-11. Pixar Animation Studios.
38. Homan Igehy. 1999. Tracing ray differentials. Proceedings of SIGGRAPH 33 (1999), 179--186.
39. Henrik Wann Jensen and Juan Buhler. 2002. A rapid hierarchical rendering technique for translucent materials. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 21, 3 (2002), 576--581.
40. Henrik Wann Jensen, Steve Marschner, Marc Levoy, and Pat Hanrahan. 2001. A practical model for subsurface light transport. Proceedings of SIGGRAPH 35 (2001), 511--518.
41. Jim Kajiya. 1986. The rendering equation. Computer Graphics (Proceedings of SIGGRAPH) 20, 4 (1986), 143--150.
42. Jaroslav Křivánek, Iliyan Georgiev, Toshiya Hachisuka, Petr Vévoda, Martin Šik, Derek Nowrouzezahrai, and Wojciech Jarosz. 2014. Unifying points, beams, and paths in volumetric light transport simulation. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 33, 4 (2014).
43. Eric Lafortune and Yves Willems. 1993. Bi-directional path tracing. In Proceedings of Compugraphics. 145--153.
44. Stephen Marschner, Henrik Wann Jensen, Mike Cammarano, Steve Worley, and Pat Hanrahan. 2003. Light scattering from human hair fibers. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 22, 3 (2003), 780--791.
45. Leonid Pekelis, Christophe Hery, Ryusuke Villemin, and Junyi Ling. 2015. A data-driven light scattering model for hair. Technical Report 15-02. Pixar Animation Studios.
46. Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2017. Physically Based Rendering: From Theory to Implementation (3nd ed.). Morgan Kaufmann.
47. Frank Suykens and Yves Willems. 2001. Path differentials and applications. Rendering Techniques (Proceedings of the Eurographics Workshop on Rendering) (2001), 257--268.
48. Steve Upstill. 1990. The RenderMan Companion. Addison Wesley.
49. Eric Veach and Leonidas Guibas. 1994. Bidirectional estimators for light transport. In Proceedings of the Eurographics Workshop on Rendering. 147--162.
50. Ryusuke Villemin and Christophe Hery. 2013. Practical illumination from flames. Journal of Computer Graphics Techniques 2, 2 (2013), 142--155.
51. Magnus Wrenninge. 2016. Efficient rendering of volumetric motion blur using temporally unstructured volumes. Journal of Computer Graphics Techniques 5, 1 (2016).
52. Henning Zimmer, Fabrice Rouselle, Wenzel Jakob, Oliver Wang, David Adler, Wojciech Jarosz, Olga Sorkine-Hornung, and Alexander Sorkine-Hornung. 2015. Path-space motion estimation and decomposition for robust animation filtering. Computer Graphics Forum (Proceedings of the Eurographics Symposium on Rendering) 34, 4 (2015), 131--142.
53. Matthias Zwicker, Wojciech Jarosz, Jaakko Lehtinen, Bochang Moon, Ravi Ramamoorthi, Fabrice Rouselle, Pradeep Sen, Cyril Soler, and Sung-Eui Yoon. 2015. Recent advances in adaptive sampling and reconstruction for Monte Carlo rendering. In Eurographics STAR Reports.
54. Steve Agland. 2014. CG Rendering and ACES. http://nbviewer.ipython.org/gist/sagland/3c791e79353673fd24fa. (2014).
55. CIE. 1996. The Basis of Physical Photometry. Commission Internationale de l'éclairage, CIE Central Bureau.
56. Dennis Couzin. 2007. Optimal fluorescent colors. Color Research & Application 32, 2 (2007), 85--91.
57. Hugh Fairman, Michael Brill, and Henry Hemmendinger. 1998. How the CIE 1931 color-matching functions were derived from Wright-Guild data. Color Research and Application 22, 1 (1998), 11--23.
58. David L. MacAdam. 1935. Maximum Visual Efficiency of Colored Materials. Journal of the Optical Society of America 25, 11 (1935), 361--367.
59. Johannes Meng, Florian Simon, Johannes Hanika, and Carsten Dachsbacher. 2015. Physically Meaningful Rendering using Tristimulus Colours. Computer Graphics Forum (Proceedings of Eurographics Symposium on Rendering) 34, 4 (June 2015), 31--40.
60. Matthias Raab, Daniel Seibert, and Alexander Keller. 2008. Unbiased Global Illumination with Participating Media. In Monte Carlo and Quasi-Monte Carlo Methods 2006. 591--606.
61. Erwin Schrödinger. 1919. Theorie der Pigmente größter Leuchtkraft. Annalen der Physik 367, 15 (1919), 603--622.
62. Brian Smits. 1999. An RGB-to-spectrum conversion for reflectances. Journal of Graphics Tools 4, 4 (1999), 11--22.
63. USAS and ASME. 1967. USA Standard Letter Symbols for Illuminating Engineering. United States of America Standards Institute.
64. Alexander Wilkie, Sehera Nawaz, Marc Droske, Andrea Weidlich, and Johannes Hanika. 2014. Hero Wavelength Spectral Sampling. Computer Graphics Forum (Proceedings of Eurographics Symposium on Rendering) 33, 4 (July 2014), 123--131.
65. G. Wyszecki and W. S. Stiles. 2000. Color Science: Concepts and Methods, Quantitative Data and Formulae. John Wiley & Sons.
66. Brent Burley. 2012. Physically Based Shading at Disney. Practical Physically-Based Shading in Film and Game Production, SIGGRAPH 2012 Course Notes (July 2012).
67. Brent Burley. 2015. Extending Disney's Physically Based BRDF with Integrated Subsurface Scattering. Physically Based Shading in Theory and Practice, SIGGRAPH 2015 Course Notes (July 2015).
68. Matt Jen-Yuan Chiang, Benedikt Bitterli, Chuck Tappan, and Brent Burley. 2016a. A Practical and Controllable Hair and Fur Model for Production Path Tracing. Computer Graphics Forum (Proc. of Eurographics) 35, 2 (May 2016), 275--283.
69. Matt Jen-Yuan Chiang, Peter Kutz, and Brent Burley. 2016b. Practical and Controllable Subsurface Scattering for Production Path Tracing. In SIGGRAPH 2016 Talks. 49:1--49:2.
70. Eugene d'Eon, Guillaume Francois, Martin Hill, Joe Letteri, and Jean-Marie Aubry. 2011. An Energy-Conserving Hair Reflectance Model. Computer Graphics Forum (Proc. of Eurographics Symposium on Rendering) 30, 4 (June 2011), 1181--1187.
71. Christian Eisenacher, Gregory Nichols, Andrew Selle, and Brent Burley. 2013. Sorted Deferred Shading for Production Path Tracing. Computer Graphics Forum (Proc. of Eurographics Symposium on Rendering) 32, 4 (July 2013), 125--132.
72. David Koerner, Jan Novák, Peter Kutz, Ralf Habel, and Wojciech Jarosz. 2016. Subdivision Next-Event Estimation for Path-Traced Subsurface Scattering. In Eurographics Symposium on Rendering 2016: Experimental Ideas and Implementations. 91--96.
73. Peter Kutz, Ralf Habel, Yining Karl Li, and Jan Novák. 2017. Spectral and Decomposition Tracking for Rendering Heterogeneous Volumes. ACM Transactions on Graphics (Proc. of SIGGRAPH) 36, 4 (July 2017), 111:1--111:16.
74. Jan Novák, Andrew Selle, and Wojciech Jarosz. 2014. Residual Ratio Tracking for Estimating Attenuation in Participating Media. ACM Transactions on Graphics (Proc. of SIGGRAPH) 33, 6 (Nov. 2014), 179:1--179:11.
75. Iman Sadeghi, Heather Pritchett, Henrik Wann Jensen, and Rasmus Tamstorf. 2010. An Artist Friendly Hair Shading System. ACM Transactions on Graphics 29, 4 (July 2010), 56:1--56:10.
76. Intel Corpoation. 2012. Intel SPMD Program Compiler. https://ispc.github.io/. (2012).
77. Larry Gritz. 2008. Open Image I/O. https://github.com/OpenImageIO/oiio/. (2008).
78. Larry Gritz. 2009. Open Shading Lanaguage. https://github.com/imageworks/OpenShadingLanguage/wiki/OSL-Light-Path-Expressions. (2009).
79. Chris Lattner. 2002. LLVM: An Infrastructure for Multi-Stage Optimization. Master's thesis. Computer Science Dept., University of Illinois at Urbana-Champaign, Urbana, IL. See http://llvm.cs.uiuc.edu.
80. Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2017. Physically Based Rendering: From Theory to Implementation (3rd ed.). Morgan Kaufmann Publishers Inc.
81. Dan Piponi. 2004. Automatic Differentiation, C++ Templates, and Photogrammetry. Journal of graphics, GPU, and game tools (2004), 41--55.
82. Eric Veach. 1998. Robust Monte Carlo Methods for Light Transport Simulation. Ph.D. Dissertation. Stanford, CA, USA. Advisor(s) Guibas, Leonidas J.
83. Ingo Wald, Sven Woop, Carsten Benthin, Gregory S. Johnson, and Manfred Ernst. 2014. Embree: A Kernel Framework for Efficient CPU Ray Tracing. ACM Trans. Graph. (2014), 143:1--143:8.