Real-time reflection on moving vehicles in urban environments

ABSTRACT

In the context of virtual reality, the simulation of complex environments with many animated objects is becoming more and more common. Virtual reality applications have always promoted the development of new efficient algorithms and image-based rendering techniques for real-time interaction. In this paper, we propose a technique which allows the real-time simulation in a city of the reflections of static geometry (eg. building) on specular dynamic objects (vehicles). For this, we introduce the idea of multiple environment maps. We pre-compute a set of reference environment maps at strategic positions in the scene, that are used at run time and for each visible dynamic object, to compute local environment maps by resampling images. To efficiently manage a small number of reference environment maps, compared to the scene dimension, for each vertex of the reconstructed environment we perform a ray tracing in a heightfield representation of the scene. We control the frame rate by adaptative reconstruction of environment maps. We have implemented this approach, and the results show that it is efficient and scalable to many dynamic objects while maintaining interactive frame rates.

REFERENCES

• 1: Daniel G. Aliaga , Anselmo Lastra, Automatic image placement to provide a guaranteed frame rate, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.307-316, July 1999 [doi>10.1145/311535.311574]
• 2: J. Amanatides and A. Woo. A fast voxel traversal algorithm for ray tracing. In Eurographics '87, pages 3--10, August 1987.
• 3: ATI. Car paint. http://mirror.ati.com/technology/wp/carpaint.html, 2002.
• 4: James F. Blinn , Martin E. Newell, Texture and reflection in computer generated images, Communications of the ACM, v.19 n.10, p.542-547, Oct. 1976 [doi>10.1145/360349.360353]
• 5: Chris Buehler , Michael Bosse , Leonard McMillan , Steven Gortler , Michael Cohen, Unstructured lumigraph rendering, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.425-432, August 2001 [doi>10.1145/383259.383309]
• 6: Brian Cabral , Marc Olano , Philip Nemec, Reflection space image based rendering, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.165-170, July 1999 [doi>10.1145/311535.311553]
• 7: Shenchang Eric Chen , Lance Williams, View interpolation for image synthesis, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.279-288, September 1993 [doi>10.1145/166117.166153]
• 8: Shenchang Eric Chen, QuickTime VR: an image-based approach to virtual environment navigation, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.29-38, September 1995 [doi>10.1145/218380.218395]
• 9: Paul E. Debevec , Camillo J. Taylor , Jitendra Malik, Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.11-20, August 1996 [doi>10.1145/237170.237191]
• 10: Shachar Fleishman, Daniel Cohen-Or, and Dani Lischinski. Automatic camera placement for image-based modeling. Computer Graphics Forum, June 2000.
• 11: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• 12: Ned Greene, Environment mapping and other applications of world projections, IEEE Computer Graphics and Applications, v.6 n.11, p.21-29, November 1986 [doi>10.1109/MCG.1986.276658]
• 13: Ziyad S. Hakura , John M. Snyder , Jerome E. Lengyel, Parameterized environment maps, Proceedings of the 2001 symposium on Interactive 3D graphics, p.203-208, March 2001 [doi>10.1145/364338.364402]
• 14: Ziyad S. Hakura , John M. Snyder, Realistic Reflections and Refractions on Graphics Hardware with Hybrid Rendering and Layered Environment Maps, Proceedings of the 12th Eurographics Workshop on Rendering Techniques, p.289-300, June 25-27, 2001
• 15: Wolfgang Heidrich , Hans-Peter Seidel, Realistic, hardware-accelerated shading and lighting, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.171-178, July 1999 [doi>10.1145/311535.311554]
• 16: Jan Kautz and Michael D. McCool. Approximation of glossy reflection with prefiltered environment maps. In Proceedings of Graphics Interface 2000, pages 119--126, 2000.
• 17: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• 18: Dani Lischinski and Ari Rappoport. Image-based rendering for non-diffuse synthetic scenes. In Rendering Techniques '98, pages 301--314, 1998.
• 19: Leonard McMillan , Gary Bishop, Plenoptic modeling: an image-based rendering system, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.39-46, September 1995 [doi>10.1145/218380.218398]
• 20: G. S. Miller and C. R. Hoffman. Illumination and reflection maps: Simulated objects in simulated and real environments. In SIGGRAPH '84 Advanced Computer Graphics Animation seminar notes. July 1984.
• 21: F. Kenton Musgrave. Grid tracing: Fast ray tracing for height fields. Technical Report YALEU/DCS/RR-639, Yale University Dept. of Computer Science Research, 1988.
• 22: NVidia. Cube environment mapping. http://developer.nvidia.com/view.asp?IO=Cube_Mapping_Paper, 2000.
• 23: University of Saarbruecken. Open rt. http://www.openrt.de/Publications/index.html.
• 24: Paul Rademacher, Jed Lengyel, Edward Cutrell, and Turner Whitted. Measuring the Perception of Visual Realism in Images. Springer Wien, New York, NY, 2001.
• 25: RealViz. Imagemodeler. http://www.realviz.com.
• 26: William T. Reeves , David H. Salesin , Robert L. Cook, Rendering antialiased shadows with depth maps, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.283-291, August 1987
• 27: Steven M. Seitz , Charles R. Dyer, View morphing, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.21-30, August 1996 [doi>10.1145/237170.237196]
• 28: Jonathan Shade , Steven Gortler , Li-wei He , Richard Szeliski, Layered depth images, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.231-242, July 1998 [doi>10.1145/280814.280882]
• 29: Wolfgang Stuerzlinger, Imaging all visible surfaces, Proceedings of the 1999 conference on Graphics interface '99, p.115-122, September 1999, Kingston, Ontario, Canada
• 30: Franco Tecchia , Céline Loscos , Yiorgos Chrysanthou, Image-Based Crowd Rendering, IEEE Computer Graphics and Applications, v.22 n.2, p.36-43, March 2002 [doi>10.1109/38.988745 ]
• 31: Jay Torborg , James T. Kajiya, Talisman: commodity realtime 3D graphics for the PC, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.353-363, August 1996 [doi>10.1145/237170.237274]
• 32: Douglas Voorhies , Jim Foran, Reflection vector shading hardware, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.163-166, July 1994 [doi>10.1145/192161.192193]
• 33: Turner Whitted, An improved illumination model for shaded display, Communications of the ACM, v.23 n.6, p.343-349, June 1980 [doi>10.1145/358876.358882]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Keywords:
environment maps, image-based rendering, ray tracing, real-time rendering