skip to main content
10.1145/3027063.3053137acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Bimanual Word Gesture Keyboards for Mid-air Gestures

Published:06 May 2017Publication History

ABSTRACT

Mid-air hand gestural interaction has generally been researched as a pointing device. However, recent research has shown potential for text input with the use of word gesture keyboards (WGK), where these forms of interactions require the input system to identify when the gesture has started and when it has stopped. Previous research has had success where the same hand moved the cursor, and performed the activation gesture. In this paper we introduce bimanual interaction for gestural interaction to perform text input with WGK, where one hand moves the cursor while the other hand performs the activation. In our user studies, the bimanual method demonstrated significantly higher results than the state-of-the-art single handed method. We achieved 16 words per minute; about 39% higher than the benchmark, and with significantly lower error rates.

References

  1. Xiaojun Bi, Ciprian Chelba, Tom Ouyang, Kurt Partridge, and Shumin Zhai. 2012. Bimanual Gesture Keyboard. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, 137--146. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Michelle A Brown, Wolfgang Stuerzlinger, and E. J. Mendonca Filho. 2014. The performance of uninstrumented in-air pointing. In Proceedings of Graphics Interface 2014. Canadian Information Processing Society, 59--66.Google ScholarGoogle Scholar
  3. Robert Coe. 2002. It's the effect size, stupid: What effect size is and why it is important. Paper presented at the British Educational Research Association annual conference, Exeter, UK (2002).Google ScholarGoogle Scholar
  4. Rita Francese, Ignazio Passero, and Genoveffa Tortora. 2012. Wiimote and Kinect: Gestural User Interfaces Add a Natural Third Dimension to HCI. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '12). ACM, New York, NY, USA, 116--123. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Dustin Freeman, Ramadevi Vennelakanti, and Sriganesh Madhvanath. 2012. Freehand posebased Gestural Interaction: Studies and implications for interface design. In Intelligent Human Computer Interaction (IHCI), 2012 4th International Conference on. IEEE, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  6. Vittorio Fuccella, Mattia De Rosa, and Gennaro Costagliola. 2014. Novice and Expert Performance of KeyScretch: A Gesture-Based Text Entry Method for Touch-Screens. IEEE Transactions on HumanMachine Systems 44, 4 (2014), 511--523. Google ScholarGoogle ScholarCross RefCross Ref
  7. Darren Guinness, Alvin Jude, G Michael Poor, and Ashley Dover. 2015. Models for Rested Touchless Gestural Interaction. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction. ACM, 34--43. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Sariel Har-Peled and Benjamin Raichel. 2014. The Fréchet Distance Revisited and Extended. ACM Trans. Algorithms 10, 1, Article 3 (Jan. 2014), 22 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Alvin Jude, G Michael Poor, and Darren Guinness. 2014. Personal space: user defined gesture space for GUI interaction. In Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems. ACM, 1615--1620. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Per-Ola Kristensson. 2007. Discrete and Continuous Shape Writing for Text Entry and Control. Doctoral dissertation. Linkuping University, Sweden.Google ScholarGoogle Scholar
  11. Chien-Ho Janice Lin, Katherine J Sullivan, Allan D Wu, Shailesh Kantak, and Carolee J Winstein. 2007. Effect of task practice order on motor skill learning in adults with Parkinson disease: a pilot study. Physical therapy 87, 9 (2007), 1120--1131. Google ScholarGoogle ScholarCross RefCross Ref
  12. I. Scott MacKenzie and R. William Soukoreff. 2002. A Character-level Error Analysis Technique for Evaluating Text Entry Methods. In Proceedings of the Second Nordic Conference on Humancomputer Interaction (NordiCHI '02). ACM, New York, NY, USA, 243--246. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. I. Scott MacKenzie and Kumiko Tanaka-Ishii. 2007. Text Entry Systems: Mobility, Accessibility, Universality. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Shahzad Malik and Joe Laszlo. 2004. Visual touchpad: a two-handed gestural input device. In Proceedings of the 6th international conference on Multimodal interfaces. ACM, 289--296. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Anders Markussen, Mikkel Rønne Jakobsen, and Kasper Hornbæk. 2014. Vulture: A Mid-Air WordGesture Keyboard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, 1073--1082. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Matthias Schwaller, Simon Brunner, and Denis Lalanne. 2013. Two handed mid-air gestural hci: Point+ command. In International Conference on Human-Computer Interaction. Springer, 388--397. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. R. William Soukoreff and I. Scott MacKenzie. 2003. Metrics for Text Entry Research: An Evaluation of MSD and KSPC, and a New Unified Error Metric. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 113--120.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Katherine J Sullivan, Barbara J Knowlton, and Bruce H Dobkin. 2002. Step training with body weight support: effect of treadmill speed and practice paradigms on poststroke locomotor recovery. Archives of physical medicine and rehabilitation 83, 5 (2002), 683--691.Google ScholarGoogle Scholar
  19. Andries Van Dam. 1997. Post-WIMP user interfaces. Commun. ACM 40, 2 (1997), 63--67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Radu-Daniel Vatavu and Ionut-Alexandru Zaiti. 2014. Leap Gestures for TV: Insights from an Elicitation Study. In Proceedings of the 2014 ACM International Conference on Interactive Experiences for TV and Online Video (TVX '14). ACM, New York, NY, USA, 131--138. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Juan Wachs, Helman Stern, Yael Edan, Michael Gillam, Craig Feied, Mark Smith, and Jon Handler. 2007. Gestix: a doctor-computer sterile gesture interface for dynamic environments. In Soft Computing in Industrial Applications. Springer, 30-- 39. Google ScholarGoogle ScholarCross RefCross Ref
  22. Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: revealing mid-air gestures on public displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 841--850. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Andrew D Wilson and Edward Cutrell. 2005. FlowMouse: a computer vision-based pointing and gesture input device. In IFIP Conference on Human-Computer Interaction. Springer, 565--578.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Shumin Zhai and Per-Ola Kristensson. 2003. Shorthand Writing on Stylus Keyboard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 97--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Shumin Zhai and Per-Ola Kristensson. 2004. SHARK2: A Large Vocabulary Shorthand Writing System for Pen-based Computers. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST '04). ACM, 43--52.Google ScholarGoogle Scholar
  26. Shumin Zhai and Per Ola Kristensson. 2012. The Word-gesture Keyboard: Reimagining Keyboard Interaction. Commun. ACM 55, 9 (2012), 91--101. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Shumin Zhai, Per-Ola Kristensson, Pengjun Gong, Michael Greiner, Shilei Allen Peng, Liang Mico Liu, and Anthony Dunnigan. 2009. Shapewriter on the Iphone: From the Laboratory to the Real World. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (CHI EA '09). ACM, 2667-- 2670. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Shumin Zhai, Alison Sue, and Johnny Accot. 2002. Movement Model, Hits Distribution and Learning in Virtual Keyboarding. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, New York, NY, USA, 17-- 24. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Bimanual Word Gesture Keyboards for Mid-air Gestures

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems
      May 2017
      3954 pages
      ISBN:9781450346566
      DOI:10.1145/3027063

      Copyright © 2017 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 6 May 2017

      Check for updates

      Qualifiers

      • abstract

      Acceptance Rates

      CHI EA '17 Paper Acceptance Rate1,000of5,000submissions,20%Overall Acceptance Rate6,164of23,696submissions,26%

      Upcoming Conference

      CHI '24
      CHI Conference on Human Factors in Computing Systems
      May 11 - 16, 2024
      Honolulu , HI , USA

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader