Enhancing X3D for advanced MR appliances

ABSTRACT

In this paper, we explore and discuss X3D as an application description language for advanced mixed reality environments. X3D has been established as an important platform for today's web-based visualization and VR applications. Yet, there are very few examples for augmented reality systems utilizing X3D beyond a simple geometric description format. In order to fulfill the image compositing and synthesis requests of today's augmented reality applications, we propose extensions to X3D, especially with a focus on lighting and realistic rendering.

References

1. Behr, J., Dähne, P., and Roth, M. 2004. Utilizing x3d for immersive environments. In Web3D '04: Proc. of the ninth int. conf. on 3D Web technology, ACM Press, NY, USA, 71--78.
2. Bitmanagement, 2002. Drawgroup and drawop, dec. http://www.bitmanagement.de/developer/contact/examples/multitexture/drawgroup.html.
3. Bleser, G., Wuest, H., and Stricker, D. 2006. Online camera pose estimation in partially known and dynamic scenes. In ISMAR 2006: Proc. of the Fourth IEEE and ACM Int. Symposium on Mixed a. Augmented Reality, IEEE Computer Society, Los Alamitos, Calif., 56--65.
4. Chronos. 2006. OpenGL Man Pages. http://www.opengl.org/documentation/specs/man_pages/hardcopy/GL/html/gl/.
5. Debevec, P. E., and Malik, J. 1997. Recovering high dynamic range radiance maps from photographs. In Proceedings of SIGGRAPH 97, CG Proc., Annual Conference Series, 369--378.
6. Debevec, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proc. of SIGGRAPH 98, CG Proc., Annual Conf. Series, 189--198.
7. Drettakis, G., Robert, L., and Bougnoux, S. 1997. Interactive common illumination for computer augmented reality. In Proceedings of the Eurographics Workshop on Rendering Techniques '97, Springer-Verlag, London, UK, 45--56.
8. Fernando, R. 2005. Percentage-closer soft shadows. In SIGGRAPH '05: ACM SIGGRAPH 2005 Sketches, ACM Press, New York, NY, USA, 35.
9. Gibson, S., and Chalmers, A., 2003. Photorealistic augmented reality. Eurographics 2003 Tutorial, September.
10. Gibson, S., Cook, J., Howard, T., and Hubbold, R. 2004. Aris: Augmented reality image synthesis. Tech. Rep. IST-2000-28707, University Manchester, July.
11. Green, R. 2003. Spherical harmonic lighting: The gritty details. Archives of the Game Developers Conference (Mar.).
12. Hartley, R., and Zisserman, A. 2000. Multiple View Geometry in Computer Vision. Cambridge Univ. Press.
13. King, G. 2005. Real-time computation of dynamic irradiance environment maps. In GPU Gems 2, M. Pharr, Ed. Addison Wesley, Mar., ch. 10, 167--176.
14. Korn, M., Stange, M., von Arb, A., Blum, L., Kreil, M., Kunze, K.-J., Anhenn, J., Wallrath, T., and Grosch, T. 2006. Interactive augmentation of live images using a hdr stereo camera.
15. Loscos, C., Frasson, M.-C., Drettakis, G., Walter, B., Granier, X., and Poulin, P. 1999. Interactive virtual relighting and remodeling of real scenes. In Rendering techniques (Proc. of the 10th EG Workshop on Rend.), 235--246.
16. Ng, R., Ramamoorthi, R., and Hanrahan, P. 2004. Triple product wavelet integrals for all-frequency relighting. ACM Trans. Graph. 23, 3, 477--487.
17. Octaga, 2006. Octaga - bringing enterprise data to life. http://www.octaga.com/.
18. OpenSG, 2006. Opensg. http://www.opensg.org.
19. Pilet, J., Geiger, A., Lagger, P., Lepetit, V., and Fua, P. 2006. An all-in-one solution to geometric and photometric calibration. In Int. Symposium on Mixed and Augmented Reality.
20. Polys, N. F., and Ray, A. 2006. Supporting mixed reality interfaces through x3d specification. In Workshop at the IEEE Virtual Reality.
21. Pomi, A., and Slusallek, P. 2004. Interactive Mixed Reality Rendering in a Distributed Ray Tracing Framework. In IEEE and ACM Int. Symp. on Mixed a. Augmented Reality ISMAR 2004.
22. Ramamoorthi, R., and Hanrahan, P. 2001. An efficient representation for irradiance environment maps. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 497--500.
23. Reeves, W. T., Salesin, D. H., and Cook, R. L. 1987. Rendering antialiased shadows with depth maps. In SIGGRAPH '87: Proc. of the 14th annual conference on CG and interactive techniques, ACM Press, NY, USA, 283--291.
24. Sattler, M., Sarlette, R., Zachmann, G., and Klein, R. 2004. Hardware-accelerated ambient occlusion computation. In Vision, Modeling, and Visualization 2004, B. Girod, M. Magnor, and H.-P. Seidel, Eds., 331--338.
25. Shastry, A. S., 2005. Soft-edged shadows. http://www.gamedev.net/reference/articles/article2193.asp.
26. Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. ACM Transactions on Graphics 21, 3 (July), 527--536.
27. Sloan, P.-P., Luna, B., and Snyder, J. 2005. Local, deformable precomputed radiance transfer. In SIGGRAPH '05: ACM SIGGRAPH 2005 Papers, ACM Press, New York, NY, USA, 1216--1224.
28. Sudarsky, S. 2001. Generating dynamic shadows for virtual reality applications. In IV '01: Proceedings of the Fifth International Conference on Information Visualisation, IEEE Computer Society, Washington, DC, USA, 595.
29. Supan, P., and Stuppacher, I. 2006. Interactive image based lighting in augmented reality.
30. Web3DConsortium. 2006. Extensible 3D (X3D) ISO/IEC CD 19775-1r1:200x. http://www.web3d.org/x3d/specifications/ISO-IEC-19775-X3DAbstractSpecification_Revision1_to_Part1/.
31. Wimmer, M., Scherzer, D., and Purgathofer, W. 2004. Light space perspective shadow maps. In Rendering Techniques 2004 (Proceedings of the Eurographics Symposium on Rendering 2004), A. Keller and H. W. Jensen, Eds., 143--151.
32. Xj3D, 2004. Xj3d dynamic texture rendering ext. http://www.xj3d.org/extensions/render_texture.html.

Index Terms

• Computing methodologies

  • Computer graphics

    • Image manipulation

      • Texturing

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction techniques