Direct 3D interaction with smart objects

ABSTRACT

Performing 3D interactions with virtual objects easily becomes a complex task, limiting the implementation of larger applications. In order to overcome some of these limitations, this paper describes a framework where the virtual object aids the user to accomplish a pre-programmed possible interaction. Such objects are called Smart Objects, in the sense that they know how the user can interact with them, giving clues to aid the interaction. We show how such objects are constructed, and exemplify the framework with an application where the user, wearing a data glove, can easily open and close drawers of some furniture.

REFERENCES

• 1: George Baciu , Wingo Sai-Keung Wong , Hanqiu Sun, Hardware-assisted virtual collisions, Proceedings of the ACM symposium on Virtual reality software and technology, p.145-151, November 02-05, 1998, Taipei, Taiwan [doi>10.1145/293701.293720]
• 2: R. Boulic, S. Rezzonico, and D. Thalmann, "Multi Finger Manipulation of Virtual Objects", Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST, 67-74, 1996.
• 3: K. Bowyer, S. Cameron, G. Jared, R. Martin, A. Middleditch, M. Sabin, and J. Woodwark, "Introducing Djinn - A Geometric Interface for Solid Modelling", Information Geometers, ISBN 1-874728-08-9, 24pp, 1995.
• 4: N. Farenc, S. R. Musse, E. Schweiss, M. Kallmann, O. Aune, R. Boulic, and D. Thalmann, "A Paradigm for Controlling Virtual Humans in Urban Environment Simulations", Applied Artificial Intelligence Journal, 1999, to appear.
• 5: C. Hand, "A Survey of 3D interaction Techniques", Computer Graphics Forum 16(5), 269-281, 1997.
• 6: M. Kallmann and D. Thalmann, "Modeling Objects for Interaction Tasks", Proceedings of the 9th Eurographics Workshop on Computer Animation and Simulation, 73-86, Lisbon, Portugal, 1998.
• 7: Marcelo Kallmann , Daniel Thalmann, A Behavioral Interface to Simulate Agent-Object Interactions in Real Time, Proceedings of the Computer Animation, p.138, May 26-28, 1999
• 8: Y. Kitamura, A. Yee, and F. Kishino, "A Sophisticated Manipulation Aid in a Virtual Environment using Dynamic Constraints among Object Faces", Presence, 7(5), 460-477, October, 1998.
• 9: Mark R. Mine, Virtual Environment Interaction Techniques, University of North Carolina at Chapel Hill, Chapel Hill, NC, 1995
• 10: Mark R. Mine , Frederick P. Brooks, Jr. , Carlo H. Sequin, Moving objects in space: exploiting proprioception in virtual-environment interaction, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.19-26, August 1997 [doi>10.1145/258734.258747]
• 11: Hiroaki Nishino , Kouichi Utsumiya , Daisuke Kuraoka , Kenji Yoshioka , Kazuyoshi Korida, Interactive two-handed gesture interface in 3D virtual environments, Proceedings of the ACM symposium on Virtual reality software and technology, p.1-8, September 1997, Lausanne, Switzerland [doi>10.1145/261135.261137]
• 12: Alberto Paoluzzi , Valerio Pascucci , Michele Vicentino, Geometric programming: a programming approach to geometric design, ACM Transactions on Graphics (TOG), v.14 n.3, p.266-306, July 1995 [doi>10.1145/212332.212349]
• 13: S. Parry-Barwick, and A. Bowyer, "Is the Features Interface Ready?", In "Directions in Geometric Computing", Ed. Martin R., Information Geometers Ltd, UK, Cap. 4, 129- 160, 1993.
• 14: A. Pentland, "Machine Understanding of Human Action", 7th international Forum on Frontier of Telecom Technology, Tokyo, Japan, 1995.
• 15: V. Popescu , G. Burdea , M. Bouzit, Virtual Reality Simulation Modeling for a Haptic Glove, Proceedings of the Computer Animation, p.195, May 26-28, 1999
• 16: Ivan Poupyrev , Suzanne Weghorst , Mark Billinghurst , Tadao Ichikawa, A framework and testbed for studying manipulation techniques for immersive VR, Proceedings of the ACM symposium on Virtual reality software and technology, p.21-28, September 1997, Lausanne, Switzerland [doi>10.1145/261135.261141]
• 17: Jörg Sauer , Elmar Schömer, A constraint-based approach to rigid body dynamics for virtual reality applications, Proceedings of the ACM symposium on Virtual reality software and technology, p.153-162, November 02-05, 1998, Taipei, Taiwan [doi>10.1145/293701.293721]
• 18: K.M. Stanney, R. R. Mourant, and R. S. Kennedy, "Human Factors Issues in Virtual Environments: A Review of the Literature", Presence, 7(4), 327-351, August, 1998.
• 19: David J. Sturman , David Zeltzer, A Survey of Glove-based Input, IEEE Computer Graphics and Applications, v.14 n.1, p.30-39, January 1994 [doi>10.1109/38.250916 ]
• 20: The Virtual Reality Modelling Language, VRML, http://www.vrml.org.
• 21: Yoshihiro Okada , Kenro Shinpo , Yuzuru Tanaka , Daniel Thalmann, Virtual Input Devices Based on Motion Capture and Collision Detection, Proceedings of the Computer Animation, p.201, May 26-28, 1999
• 22: J.J. Gibson, "The theory of affordances", In R. Shaw & J. Brandsford (eds.), Perceiving, Acting and Knowing. Hillsdale, NJ:Erlbaum, 1977.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  B. Hardware
  B.4 INPUT/OUTPUT AND DATA COMMUNICATIONS
      B.4.2 Input/Output Devices
          Subjects: Channels and controllers

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.4 Graphics Utilities
          Subjects: Virtual device interfaces
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

General Terms:
Design, Human Factors, Management, Performance, Theory

Keywords:
data glove, interaction, manipulation, virtual environments, virtual objects, virtual reality