Dynamic creation of interactive mixed reality presentations

ABSTRACT

In this paper, we describe a method of dynamic creation of interactive presentations for Mixed Reality environments. The presentations are created automatically for collections of multimedia objects arbitrarily arranged in virtual presentation spaces stored in a database. Users can navigate between the spaces using Web and 3D multimedia contents. The objects in each space are presented through a presentation template, which determines both the visualization and the interaction aspects of the presentation. The possible user interactions are described using a novel language called MR-ISL. The presentation templates are coded in X?VRML, a high-level modeling language. The method can be used in various application domains. Examples discussed in the paper relate to presentation of cultural heritage and educational resources.

REFERENCES

• 1: ARCO - Augmented Representation of Cultural Objects. http://www.arco-web.org/
• 2: ARToolKit. http://www.hitl.washington.edu/people/ poup/research/ar.htm#artoolkit
• 3: Billinghurst, M., Kato, and H., Poupyrev, I. The MagicBook: A Transitional AR Interface. Computers and Graphics, 2001, 25, 745--753.
• 4: De Carolis, B., Carofiglio, V., Bilvi, M., and Pelachaud, C. APML, A Mark-up Language for Believable Behavior Generation. Proc. of AAMAS Workshop Embodied ConversationalAgents: Let's Specify and Compare Them!, Bologna, Italy, 2002.
• 5: Kato, H., Billinghurst, M., Popyrev, I., Imamoto, K., and Tachibana, K. Virtual object manipulation on a table-top AR environments. Proc. of International Symposium on Augmented Reality (ISAR'00), Munich, Germay, 2000.
• 6: Andrew Marriott , Simon Beard , John Stallo , Quoc Huynh, VHML - Directing a Talking Head, Proceedings of the 6th International Computer Science Conference on Active Media Technology, p.90-100, December 18-20, 2001
• 7: Hiroshi Matsuda , Yoshiaki Shindo, Creative Lesson by Using Cyber Theater Scenario Language: CTSL, Proceedings of the IEEE International Conference on Advanced Learning Technologies (ICALT'04), p.856-857, August 30-September 01, 2004
• 8: Okazaki, N., Aya, S., Saeyor, S., and Ishizuka, M. A Multimodal Presentation Markup Language MPML-VR for a 3D Virtual Space. Workshop Proc. on Virtual Conver-sational Characters: Applications, Methods, and Research Challenges, (in conj. with HF2002 and OZCHI2002), Melbourne, Australia, 2002.
• 9: Patel, M., White, M., Walczak, K., and Sayd, P. Digitisation to Presentation - Building Virtual Museum Exhibitions. Proc. of International Conference on Vision, Video and Graphics, Bath, UK, 2003.
• 10: Sharov A. 3D Insects, Department of Entomology, Virginia Tech, Blacksburg, VA, http://www.ento.vt.edu/~sharov/3d/3dinsect.html
• 11: Krzysztof Walczak , Wojciech Cellary, Building database applications of virtual reality with X-VRML, Proceeding of the seventh international conference on 3D Web technology, p.111-120, February 24-28, 2002, Tempe, Arizona, USA [doi>10.1145/504502.504521]
• 12: Krzysztof Walczak , Wojciech Cellary, X-VRML for Advanced Virtual Reality Applications, Computer, v.36 n.3, p.89-92, March 2003 [doi>10.1109/MC.2003.1185226 ]
• 13: Wojciechowski, R., Walczak, K., and Cellary, W. Mixed Reality for Interactive Learning of Cultural Heritage. Proc. of the 7th International Conference on Virtual Reality, First International VR-Learning Seminar, VRIC - Laval Virtual 2005, Laval, France, April 2005, 95--99.
• 14: Rafal Wojciechowski , Krzysztof Walczak , Martin White , Wojciech Cellary, Building Virtual and Augmented Reality museum exhibitions, Proceedings of the ninth international conference on 3D Web technology, April 05-08, 2004, Monterey, California [doi>10.1145/985040.985060]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI); Input devices and strategies (e.g., mouse, touchscreen); Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Algorithms, Design, Languages, Management

Keywords:
VRML, X?VRML, interaction scenarios, mixed reality, virtual reality