skip to main content
10.1145/1520340.1520564acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
extended-abstract

Fast finger tracking system for in-air typing interface

Published: 04 April 2009 Publication History

Abstract

We developed a system which performs 3D motion tracking of human's hand and fingers from images of a single high-frame-rate camera and that recognizes his/her typing motion in the air. Our template-matching-based method using hand textures reduces background effect and enables markerless tracking. In addition, use of a high-frame-rate camera enables recognition of rapid typing motion which is difficult to track using standard cameras. In order to realize real-time recognition, we developed hardware which parallelizes and accelerates image processing. As a result, we achieved real-time recognition of typing motion with the throughput of 138 fps (frames per second) and the latency of 29 ms.

Supplementary Material

MPEG File (p3739.mpeg)

References

[1]
Kölsch, M. and Turk, M. Keyboards without Keyboards: A Survey of Virtual Keyboards, Proc. Workshop/Symposium on Sensing and Input for Media-centric Systems (2002).
[2]
Ahmad, F. and Musilek, P. UbiHand: a wearable input device for 3D interaction, ACM SIGGRAPH Research posters (2006), 159.
[3]
Kim, S. and Kim, G. Using keyboards with head mounted displays, Proc. ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry (2004), 336--343.
[4]
Imura, M., Fujimoto, M., Yasumuro, Y., Manabe Y., and Chihara, K. AirGrabber: virtual keyboard using miniature infrared camera and tilt sensor, Proc. ACM international conference on Augmented tele-existence (2005), 277--277.
[5]
Roeber H., Bacus J., and Tomasi C. Typing in thin air: the canesta projection keyboard -- a new method of interaction with electronic devices, ACM CHI extended abstracts (2003), 712--713.
[6]
Ueda, E., Matsumoto, Y., Imai, M. and Ogasawara, T. Hand Pose Estimation for Vision-based Human Interface. IEEE Transactions on Industrial Electronics 50, 4 (2003), 676--684.
[7]
Stenger, B., Thayanathan, A., Torr, P. H. S. and Cipolla, R. Model Based Hand Tracking Using a Hierarchical Bayesian Filter, IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 9 (2006), 1372--1384.
[8]
Hoshino, H. and Tanimoto, T. Realtime estimation of human hand posture for robot hand control, Proc. IEEE International Symposium of Computational Intelligence in Robotics and Automation (2005), 1--6.

Cited By

View all
  • (2024)V-Pen: An Acoustic-Based Fine-Grained Virtual Pen Input System Using Hand TrackingIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2023.333552573(1-11)Online publication date: 2024
  • (2022)Democratizing access to collaborative music making over the network using air instrumentsAudioMostly 202210.1145/3561212.3561227(211-218)Online publication date: 10-Oct-2022
  • (2022)Pull Gestures with Coordinated Graphics on Dual-Screen DevicesProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556620(270-277)Online publication date: 7-Nov-2022
  • Show More Cited By

Index Terms

  1. Fast finger tracking system for in-air typing interface

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems
    April 2009
    2470 pages
    ISBN:9781605582474
    DOI:10.1145/1520340
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 April 2009

    Check for updates

    Author Tags

    1. embedded computer vision.
    2. portable device
    3. vision-based ui

    Qualifiers

    • Extended-abstract

    Conference

    CHI '09
    Sponsor:

    Acceptance Rates

    CHI EA '09 Paper Acceptance Rate 385 of 1,130 submissions, 34%;
    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)9
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)V-Pen: An Acoustic-Based Fine-Grained Virtual Pen Input System Using Hand TrackingIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2023.333552573(1-11)Online publication date: 2024
    • (2022)Democratizing access to collaborative music making over the network using air instrumentsAudioMostly 202210.1145/3561212.3561227(211-218)Online publication date: 10-Oct-2022
    • (2022)Pull Gestures with Coordinated Graphics on Dual-Screen DevicesProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556620(270-277)Online publication date: 7-Nov-2022
    • (2020)Research on Visual Programming System of Gesture Interaction Interface in VRProceedings of the 2020 4th International Conference on Big Data and Internet of Things10.1145/3421537.3421554(38-42)Online publication date: 22-Aug-2020
    • (2018)Comparing methods for numerical input in immersive virtual environmentsVirtual Reality10.1007/s10055-017-0312-522:1(63-77)Online publication date: 1-Mar-2018
    • (2017)A virtual keyboard implementation based on finger recognition2017 International Conference on Image and Vision Computing New Zealand (IVCNZ)10.1109/IVCNZ.2017.8402452(1-6)Online publication date: Dec-2017
    • (2014)A natural click interface for AR systems with a single cameraProceedings of Graphics Interface 201410.5555/2619648.2619660(67-75)Online publication date: 7-May-2014
    • (2014)Around-device devicesProceedings of the 16th international conference on Human-computer interaction with mobile devices & services10.1145/2628363.2628401(81-90)Online publication date: 23-Sep-2014
    • (2014)Virtual keyboard for head mounted display-based wearable devices2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS)10.1109/PADSW.2014.7097812(225-232)Online publication date: Dec-2014
    • (2013)Vision-based typing interface for chording input with keystroke detection using kalman filterProceedings of the 11th Asia Pacific Conference on Computer Human Interaction10.1145/2525194.2525298(310-317)Online publication date: 24-Sep-2013
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media