skip to main content
10.1145/1315184.1315188acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
Article

Simultaneous 4 gestures 6 DOF real-time two-hand tracking without any markers

Published: 05 November 2007 Publication History

Abstract

In this paper we present a novel computer vision based handtracking method, which is capable of simultaneously tracking 6+4 degrees of freedom (DOFs) of each human hand in real-time (25 frames per second) with the help of 3 (or more) off-the-shelf consumer cameras. '6+4 DOF' means that the system can track the global pose (6 continuous parameters for translation and rotation) of 4 different gestures. Different studies discovered the need for two-handed interaction to enable an intuitive 3D Human-Computer-Interaction. Previously, using both hands as at least 6 DOF input devices involved the use of either datagloves or markers. Applying our two-hand-tracking we evaluated the use of both hands as input devices for two applications: fly-through exploration of a virtual world and a mesh editing application.

References

[1]
Cutler, L. D., Fröhlich, B., and Hanrahan, P. 1997. Twohanded direct manipulation on the responsive workbench. In SI3D '97: Proceedings of the 1997 symposium on Interactive 3D graphics, ACM Press, New York, NY, USA, 107--114.
[2]
Erol, A., Bebis, G., Nicolescu, M., Boyle, R. D., and Twombly, X. 2005. A review on vision-based full dof hand motion estimation. In CVPR '05: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) -- Workshops, IEEE Computer Society, Washington, DC, USA, 75.
[3]
Erol, A., Bebis, G., Nicolescu, M., Boyle, R. D., and Twombly, X. 2006. Vision-based hand pose estimation: A review.
[4]
Kotranza, A., Quarles, J., and Lok, B. 2006. Mixed reality: are two hands better than one? In VRST '06: Proceedings of the ACM symposium on Virtual reality software and technology, ACM Press, New York, NY, USA, 31--34.
[5]
Li, M., Magnor, M., and Seidel, H.-P. 2003. Hardwareaccelerated visual hull reconstruction and rendering. Proc. Graphics Interface (GI'03), Halifax, Canada (June).
[6]
Llamas, I., Kim, B., Gargus, J., Rossignac, J., and Shaw, C. D. 2003. Twister: a space-warp operator for the two-handed editing of 3d shapes. ACM Trans. Graph. 22, 3, 663--668.
[7]
Malik, S., and Laszlo, J. 2004. Visual touchpad: a twohanded gestural input device. In ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces, ACM Press, New York, NY, USA, 289--296.
[8]
Rehg, J. M., and Kanade, T. 1995. Model-based tracking of self-occluding articulated objects. In ICCV '95: Proceedings of the Fifth International Conference on Computer Vision, IEEE Computer Society, Washington, DC, USA, 612.
[9]
Schlattmann, M., Kahlesz, F., Sarlette, R., and Klein, R., 2007. Markerless 4 gestures 6 dof real-time visual tracking of the human hand with automatic initialization. To appear in Computer Graphics Forum, September.
[10]
Stenger, B. 2004. Model-Based Hand Tracking Using A Hierarchical Bayesian Filter. PhD thesis, University of Cambridge, Cambridge, UK.
[11]
Viola, P., and Jones, M. J. 2004. Robust real-time face detection. Int. J. Comput. Vision 57, 2, 137--154.

Cited By

View all
  • (2025)Usability Evaluation of Intuitive Interactions in Virtual EnvironmentsInnovations in Computational Intelligence and Computer Vision10.1007/978-981-97-6995-7_14(183-190)Online publication date: 1-Jan-2025
  • (2023)Optimizing HVDC Maintenance and Training through Virtual and Augmented Reality: A Methodology Proposal2023 18th Iberian Conference on Information Systems and Technologies (CISTI)10.23919/CISTI58278.2023.10212041(1-4)Online publication date: 20-Jun-2023
  • (2023)Hand Tracking and Gesture Recognition by Multiple Contactless Sensors: A SurveyIEEE Transactions on Human-Machine Systems10.1109/THMS.2022.318884053:1(35-43)Online publication date: Feb-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '07: Proceedings of the 2007 ACM symposium on Virtual reality software and technology
November 2007
259 pages
ISBN:9781595938633
DOI:10.1145/1315184
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. hand tracking
  2. interaction techniques
  3. virtual reality

Qualifiers

  • Article

Conference

VRST07

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)1
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Usability Evaluation of Intuitive Interactions in Virtual EnvironmentsInnovations in Computational Intelligence and Computer Vision10.1007/978-981-97-6995-7_14(183-190)Online publication date: 1-Jan-2025
  • (2023)Optimizing HVDC Maintenance and Training through Virtual and Augmented Reality: A Methodology Proposal2023 18th Iberian Conference on Information Systems and Technologies (CISTI)10.23919/CISTI58278.2023.10212041(1-4)Online publication date: 20-Jun-2023
  • (2023)Hand Tracking and Gesture Recognition by Multiple Contactless Sensors: A SurveyIEEE Transactions on Human-Machine Systems10.1109/THMS.2022.318884053:1(35-43)Online publication date: Feb-2023
  • (2022)A Natural and Intuitive Virtual Environment for Monitoring and Control of Electric Power Substations2022 17th Iberian Conference on Information Systems and Technologies (CISTI)10.23919/CISTI54924.2022.9820187(1-5)Online publication date: 22-Jun-2022
  • (2022)An Intuitive VR-based Environment for Monitoring and Control of Electrical Power SubstationsProcedia Computer Science10.1016/j.procs.2022.03.071201(551-558)Online publication date: 2022
  • (2018)Hand tracking with physiological constraintsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-016-1327-834:2(213-228)Online publication date: 1-Feb-2018
  • (2017)A Master-Slave Hand System for Virtual Reality Interaction2017 International Conference on Virtual Reality and Visualization (ICVRV)10.1109/ICVRV.2017.00064(276-281)Online publication date: Oct-2017
  • (2015)The Evolution of First Person Vision Methods: A SurveyIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2015.240973125:5(744-760)Online publication date: May-2015
  • (2015)Hand Pose Recognition — Overview and Current ResearchVirtual Realities10.1007/978-3-319-17043-5_7(108-129)Online publication date: 1-Apr-2015
  • (2014)A Sequential Classifier for Hand Detection in the Framework of Egocentric VisionProceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops10.1109/CVPRW.2014.92(600-605)Online publication date: 23-Jun-2014
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media