Bare-hand 3D gesture input to interactive systems

ABSTRACT

Although the 2D desktop metaphor has been the dominating paradigm of user interfaces for over two decades, 3D models of interaction are becoming more feasible due to advances in computer output hardware and software technology. However, conventional input devices such as a mouse or track-pad generally restrict direct manipulation interaction to a 2D paradigm. More sophisticated 3D input devices such data-gloves have been available for some time, but these tend to be expensive or restrictive in their use. In this paper we describe a simple and inexpensive single camera-based video input system which allows 3D interaction with existing computer application using bare hands.

REFERENCES

• 1: Thomas Baudel , Michel Beaudouin-Lafon, Charade: remote control of objects using free-hand gestures, Communications of the ACM, v.36 n.7, p.28-35, July 1993 [doi>10.1145/159544.159562]
• 2: Xiang Cao , Ravin Balakrishnan, VisionWand: interaction techniques for large displays using a passive wand tracked in 3D, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.173-182, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964716]
• 3: Tovi Grossman , Daniel Wigdor , Ravin Balakrishnan, Multi-finger gestural interaction with 3D volumetric displays, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 4: ChanSu Lee , SangWon Ghyme , ChanJong Park , KwangYun Wohn, The control of avatar motion using hand gesture, Proceedings of the ACM symposium on Virtual reality software and technology, p.59-65, November 02-05, 1998, Taipei, Taiwan [doi>10.1145/293701.293709]
• 5: Shahzad Malik , Joe Laszlo, Visual touchpad: a two-handed gestural input device, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA [doi>10.1145/1027933.1027980]
• 6: Hiroaki Nishino , Kouichi Utsumiya , Daisuke Kuraoka , Kenji Yoshioka , Kazuyoshi Korida, Interactive two-handed gesture interface in 3D virtual environments, Proceedings of the ACM symposium on Virtual reality software and technology, p.1-8, September 1997, Lausanne, Switzerland [doi>10.1145/261135.261137]
• 7: Jakub Segen , Senthil Kumar, Video-based gesture interface to interactive movies, Proceedings of the sixth ACM international conference on Multimedia: Technologies for interactive movies, p.39-42, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/306774.306786]
• 8: D. J. Sturman , D. Zeltzer , S. Pieper, Hands-on interaction with virtual environments, Proceedings of the 2nd annual ACM SIGGRAPH symposium on User interface software and technology, p.19-24, November 13-15, 1989, Williamsburg, Virginia, United States [doi>10.1145/73660.73663]
• 9: Vezhnevets, V., Sazonov, V., and A. Andreeva, 2003, A Survey on Pixel-Based Skin Color Detection Techniques, In Proceedings of the Graphicon (Moscow, Russia, September, 2003). 85--92.
• 10: Christian von Hardenberg , François Bérard, Bare-hand human-computer interaction, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida [doi>10.1145/971478.971513]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
bare hands input, computer vision, gesture input