Volumetric clouds in the VR movie, Allumette

ABSTRACT

Allumette is an immersive, highly emotional, and visually complex virtual reality movie that takes place in a city floating amongst clouds. The story unfolds around you, and as the viewer, you are free to experience the action from a perspective of your choosing. This means you can move around and view the clouds from all angles, while the set and characters interact intimately with the landscape. This type of set is a formidable challenge for traditional animated films where you have huge resources and hours to render each frame, which makes achieving the look and feel of immersive clouds in VR uncharted territory full of difficult challenges. Existing lightweight techniques for real time clouds, such as using geometric shells with translucency shaders, and sprite-based methods, have a combination of poor quality and bad performance in VR, which led us to seek novel methods to tackle the problem. For Allumette, we first modeled clouds in virtual reality by painting cloud shells using a proprietary modeling tool, then used a third party procedural modeling package to create and light the cloud voxel grids. Finally, these grids were exported with a custom file format, and rendered using a ray marcher in our game engine. The resulting clouds take .6ms per eye to render, and immerse the viewer in our cloud city.

References

1. Barre-Brisebois, C., and Bouchard, M. 2011. Approximating translucency for a fast, cheap and convincing subsurface-scattering look. In Game developers conference, vol. 6.
2. Bowles, H. 2015. A novel sampling algorithm for fast and stable real-time volume rendering. In ACM SIGGRAPH 2015 Talks, ACM.
3. Clinton, A., and Elendt, M. 2009. Rendering volumes with microvoxels. In SIGGRAPH 2009: Talks, ACM, 47.
4. Everitt, C. 2001. Interactive order-independent transparency. White paper, nVIDIA 2, 6, 7.
5. Hart, J. C. 1996. Sphere tracing: A geometric method for the antialiased ray tracing of implicit surfaces. The Visual Computer 12, 10, 527--545.
6. Houston, B., Wiebe, M., and Batty, C. 2004. RLE sparse level sets. In ACM SIGGRAPH 2004 Sketches, ACM, 137.
7. Keefe, D. F., Feliz, D. A., Moscovich, T., Laidlaw, D. H., and LaViola Jr, J. J. 2001. Cavepainting: a fully immersive 3d artistic medium and interactive experience. In Proceedings of the 2001 symposium on Interactive 3D graphics, ACM, 85--93.
8. Kulla, C., and Fajardo, M. 2012. Importance sampling techniques for path tracing in participating media. In Computer Graphics Forum, vol. 31, Wiley Online Library, 1519--1528.
9. Miller, B., Museth, K., Penney, D., and Zafar, N. 2012. Cloud modeling and rendering for Puss in Boots. ACM SIGGRAPH Talks.
10. Museth, K. 2013. VDB: High-resolution sparse volumes with dynamic topology. ACM Transactions on Graphics (TOG) 32, 3, 27.
11. Museth, K. 2014. Hierarchical digital differential analyzer for efficient ray-marching in openvdb. In ACM SIGGRAPH 2014 Talks, ACM, 40.
12. Schneider, A. 2016. Real-time volumetric cloudscapes. GPU Pro 7: Advanced Rendering Techniques, 97.
13. Wrenninge, M., Bin Zafar, N., Clifford, J., Graham, G., Penney, D., Kontkanen, J., Tessendorf, J., and Clinton, A. 2010. Volumetric Methods in Visual Effects. In ACM SIGGRAPH 2010 Courses.

Index Terms

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Virtual reality

    • Rendering