skip to main content
10.1145/2785830.2785886acmconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
research-article

PalmType: Using Palms as Keyboards for Smart Glasses

Published:24 August 2015Publication History

ABSTRACT

We present PalmType, which uses palms as interactive keyboards for smart wearable displays, such as Google Glass. PalmType leverages users' innate ability to pinpoint specific areas of their palms and fingers without visual attention (i.e. proprioception), and provides visual feedback via the wearable displays. With wrist-worn sensors and wearable displays, PalmType enables typing without requiring users to hold any devices and does not require visual attention to their hands. We conducted design sessions with 6 participants to see how users map QWERTY layout to their hands based on their proprioception. To evaluate typing performance and preference, we conducted a 12-person user study using Google Glass and Vicon motion tracking system, which showed that PalmType with optimized QWERTY layout is 39% faster than current touchpad-based keyboards. In addition, PalmType is preferred by 92% of the participants. We demonstrate the feasibility of wearable PalmType by building a prototype that uses a wrist-worn array of 15 infrared sensors to detect users' finger position and taps, and provides visual feedback via Google Glass.

Skip Supplemental Material Section

Supplemental Material

References

  1. Book review: Handbook of human-computer interaction ed. by martin helander (north-holland, amsterdam 1988). 81.Google ScholarGoogle Scholar
  2. Epson moverio bt-100. https://www.epson.com/cgi-bin/Store/jsp/Moverio/Home.do. Accessed: 2010-09-30.Google ScholarGoogle Scholar
  3. Google glass. http://www.google.com/glass/start/. Accessed: 2010-09-30.Google ScholarGoogle Scholar
  4. Bi, X., S. B., and Zhai, S. Multilingual touchscreen keyboard design and optimization, human computer interaction.Google ScholarGoogle Scholar
  5. Bi, X., Smith, B. A., and Zhai, S. Quasi-qwerty soft keyboard optimization. In Proc. ACM CHI'10 (2010), 283--286. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Butler, A., Izadi, S., and Hodges, S. Sidesight: Multi-"touch" interaction around small devices. In Proc. ACM UIST'08 (2008), 201--204. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Chang, C.-C., and Lin, C.-J. Libsvm: A library for support vector machines. 27:1--27:27. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Chen, K.-Y., Lyons, K., White, S., and Patel, S. utrack: 3d input using two magnetic sensors. In Proc. ACM UIST'13 (2013), 237--244. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Dezfuli, N., Khalilbeigi, M., Huber, J., Mller, F., and Mühlhäuser, M. Palmrc: Imaginary palm-based remote control for eyes-free television interaction. In Proc. ACM EuroiTV '12 (2012), 27--34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Goldstein, M., and Chincholle, D. Finger-joint gesture wearable keypad. In Proc. ACM MobileHCI'99 (1999), 9--18.Google ScholarGoogle Scholar
  11. Gollner, U., Bieling, T., and Joost, G. Mobile lorm glove: Introducing a communication device for deaf-blind people. In Proc. TEI'12 (2012), 127--130. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Gustafson, S., Holz, C., and Baudisch, P. Imaginary phone: Learning imaginary interfaces by transferring spatial memory from a familiar device. In Proc. ACM UIST'11 (2011), 283--292. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Gustafson, S. G., Rabe, B., and Baudisch, P. M. Understanding palm-based imaginary interfaces: The role of visual and tactile cues when browsing. In Proc. ACM CHI'13 (2013), 889--898. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Harrison, C., Benko, H., and Wilson, A. D. Omnitouch: Wearable multitouch interaction everywhere. In Proc. ACM UIST'11 (2011), 441--450. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Harrison, C., Tan, D., and Morris, D. Skinput: Appropriating the body as an input surface. In Proc. ACM CHI'10 (2010), 453--462. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Hwang, S., and Lee, G. Qwerty-like 3×4 keypad layouts for mobile phone. In Proc. ACM CHI EA'05 (2005), 1479--1482. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. I. Scott MacKenzie, K. T.-I. In Text Entry Systems: Mobility, Accessibility, Universality, Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Jones, E., Alexander, J., Andreou, A., Irani, P., and Subramanian, S. Gestext: Accelerometer-based gestural text-entry systems. In Proc. ACM CHI'10 (2010), 2173--2182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., and Olivier, P. Digits: Freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In Proc. ACM UIST'12 (2012), 167--176. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Kuester, F., Chen, M., Phair, M. E., and Mehring, C. Towards keyboard independent touch typing in vr. In Proc. ACM VRST '05 (2005), 86--95. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Li, F. C. Y., Guy, R. T., Yatani, K., and Truong, K. N. The 1line keyboard: A qwerty layout in a single line. In Proc. ACM UIST'11 (2011), 461--470. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Nakatsuma, K., Shinoda, H., Makino, Y., Sato, K., and Maeno, T. Touch interface on back of the hand. In ACM SIGGRAPH 2011 Emerging Technologies, 19:1--19:1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Ni, T., Bowman, D., and North, C. Airstroke: Bringing unistroke text entry to freehand gesture interfaces. In Proc. ACM CHI'11 (2011), 2473--2476. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Shoemaker, G., Findlater, L., Dawson, J. Q., and Booth, K. S. Mid-air text input techniques for very large wall displays. In Proc. CIPS GI'09 (2009), 231--238. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Soukoreff, R. W., and MacKenzie, I. S. Metrics for text entry research: An evaluation of msd and kspc, and a new unified error metric. In Proc. ACM CHI'03 (2003), 113--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Tamaki, E., Miyaki, T., and Rekimoto, J. Brainy hand: An ear-worn hand gesture interaction device. In Proc. ACM CHI EA'09 (2009), 4255--4260. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Thad Starner, Jake Auxier, D. A., and Gandy, M. The gesture pendant: a self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring. In Proc. IEEE ISWC '00 (2000), 87--94. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Vertanen, K., and Kristensson, P. O. A versatile dataset for text entry evaluations based on genuine mobile emails. In Proc. ACM MobileHCI'11 (2011), 295--298. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Xinying Han, Hiroaki Seki, Y. K., and Hikizu, M. Wearable handwriting input device using magnetic field. In SICE '07, 365--368.Google ScholarGoogle Scholar
  30. Xinying Han, Hiroaki Seki, Y. K., and Hikizu, M. Wearable handwriting input device using magnetic field: 2nd report: Influence of misalignment of magnet and writing plane. In PRECIS ENG '10, 37--43.Google ScholarGoogle Scholar

Index Terms

  1. PalmType: Using Palms as Keyboards for Smart Glasses

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services
      August 2015
      611 pages
      ISBN:9781450336529
      DOI:10.1145/2785830

      Copyright © 2015 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 24 August 2015

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate202of906submissions,22%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader