ABSTRACT
We present PalmType, which uses palms as interactive keyboards for smart wearable displays, such as Google Glass. PalmType leverages users' innate ability to pinpoint specific areas of their palms and fingers without visual attention (i.e. proprioception), and provides visual feedback via the wearable displays. With wrist-worn sensors and wearable displays, PalmType enables typing without requiring users to hold any devices and does not require visual attention to their hands. We conducted design sessions with 6 participants to see how users map QWERTY layout to their hands based on their proprioception. To evaluate typing performance and preference, we conducted a 12-person user study using Google Glass and Vicon motion tracking system, which showed that PalmType with optimized QWERTY layout is 39% faster than current touchpad-based keyboards. In addition, PalmType is preferred by 92% of the participants. We demonstrate the feasibility of wearable PalmType by building a prototype that uses a wrist-worn array of 15 infrared sensors to detect users' finger position and taps, and provides visual feedback via Google Glass.
Supplemental Material
Available for Download
Supplemental movie and image files for, PalmType: Using Palms as Keyboards for Smart Glasses
- Book review: Handbook of human-computer interaction ed. by martin helander (north-holland, amsterdam 1988). 81.Google Scholar
- Epson moverio bt-100. https://www.epson.com/cgi-bin/Store/jsp/Moverio/Home.do. Accessed: 2010-09-30.Google Scholar
- Google glass. http://www.google.com/glass/start/. Accessed: 2010-09-30.Google Scholar
- Bi, X., S. B., and Zhai, S. Multilingual touchscreen keyboard design and optimization, human computer interaction.Google Scholar
- Bi, X., Smith, B. A., and Zhai, S. Quasi-qwerty soft keyboard optimization. In Proc. ACM CHI'10 (2010), 283--286. Google ScholarDigital Library
- Butler, A., Izadi, S., and Hodges, S. Sidesight: Multi-"touch" interaction around small devices. In Proc. ACM UIST'08 (2008), 201--204. Google ScholarDigital Library
- Chang, C.-C., and Lin, C.-J. Libsvm: A library for support vector machines. 27:1--27:27. Google ScholarDigital Library
- Chen, K.-Y., Lyons, K., White, S., and Patel, S. utrack: 3d input using two magnetic sensors. In Proc. ACM UIST'13 (2013), 237--244. Google ScholarDigital Library
- Dezfuli, N., Khalilbeigi, M., Huber, J., Mller, F., and Mühlhäuser, M. Palmrc: Imaginary palm-based remote control for eyes-free television interaction. In Proc. ACM EuroiTV '12 (2012), 27--34. Google ScholarDigital Library
- Goldstein, M., and Chincholle, D. Finger-joint gesture wearable keypad. In Proc. ACM MobileHCI'99 (1999), 9--18.Google Scholar
- Gollner, U., Bieling, T., and Joost, G. Mobile lorm glove: Introducing a communication device for deaf-blind people. In Proc. TEI'12 (2012), 127--130. Google ScholarDigital Library
- Gustafson, S., Holz, C., and Baudisch, P. Imaginary phone: Learning imaginary interfaces by transferring spatial memory from a familiar device. In Proc. ACM UIST'11 (2011), 283--292. Google ScholarDigital Library
- Gustafson, S. G., Rabe, B., and Baudisch, P. M. Understanding palm-based imaginary interfaces: The role of visual and tactile cues when browsing. In Proc. ACM CHI'13 (2013), 889--898. Google ScholarDigital Library
- Harrison, C., Benko, H., and Wilson, A. D. Omnitouch: Wearable multitouch interaction everywhere. In Proc. ACM UIST'11 (2011), 441--450. Google ScholarDigital Library
- Harrison, C., Tan, D., and Morris, D. Skinput: Appropriating the body as an input surface. In Proc. ACM CHI'10 (2010), 453--462. Google ScholarDigital Library
- Hwang, S., and Lee, G. Qwerty-like 3×4 keypad layouts for mobile phone. In Proc. ACM CHI EA'05 (2005), 1479--1482. Google ScholarDigital Library
- I. Scott MacKenzie, K. T.-I. In Text Entry Systems: Mobility, Accessibility, Universality, Google ScholarDigital Library
- Jones, E., Alexander, J., Andreou, A., Irani, P., and Subramanian, S. Gestext: Accelerometer-based gestural text-entry systems. In Proc. ACM CHI'10 (2010), 2173--2182. Google ScholarDigital Library
- Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., and Olivier, P. Digits: Freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In Proc. ACM UIST'12 (2012), 167--176. Google ScholarDigital Library
- Kuester, F., Chen, M., Phair, M. E., and Mehring, C. Towards keyboard independent touch typing in vr. In Proc. ACM VRST '05 (2005), 86--95. Google ScholarDigital Library
- Li, F. C. Y., Guy, R. T., Yatani, K., and Truong, K. N. The 1line keyboard: A qwerty layout in a single line. In Proc. ACM UIST'11 (2011), 461--470. Google ScholarDigital Library
- Nakatsuma, K., Shinoda, H., Makino, Y., Sato, K., and Maeno, T. Touch interface on back of the hand. In ACM SIGGRAPH 2011 Emerging Technologies, 19:1--19:1. Google ScholarDigital Library
- Ni, T., Bowman, D., and North, C. Airstroke: Bringing unistroke text entry to freehand gesture interfaces. In Proc. ACM CHI'11 (2011), 2473--2476. Google ScholarDigital Library
- Shoemaker, G., Findlater, L., Dawson, J. Q., and Booth, K. S. Mid-air text input techniques for very large wall displays. In Proc. CIPS GI'09 (2009), 231--238. Google ScholarDigital Library
- Soukoreff, R. W., and MacKenzie, I. S. Metrics for text entry research: An evaluation of msd and kspc, and a new unified error metric. In Proc. ACM CHI'03 (2003), 113--120. Google ScholarDigital Library
- Tamaki, E., Miyaki, T., and Rekimoto, J. Brainy hand: An ear-worn hand gesture interaction device. In Proc. ACM CHI EA'09 (2009), 4255--4260. Google ScholarDigital Library
- Thad Starner, Jake Auxier, D. A., and Gandy, M. The gesture pendant: a self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring. In Proc. IEEE ISWC '00 (2000), 87--94. Google ScholarDigital Library
- Vertanen, K., and Kristensson, P. O. A versatile dataset for text entry evaluations based on genuine mobile emails. In Proc. ACM MobileHCI'11 (2011), 295--298. Google ScholarDigital Library
- Xinying Han, Hiroaki Seki, Y. K., and Hikizu, M. Wearable handwriting input device using magnetic field. In SICE '07, 365--368.Google Scholar
- Xinying Han, Hiroaki Seki, Y. K., and Hikizu, M. Wearable handwriting input device using magnetic field: 2nd report: Influence of misalignment of magnet and writing plane. In PRECIS ENG '10, 37--43.Google Scholar
Index Terms
PalmType: Using Palms as Keyboards for Smart Glasses
Recommendations
PalmGesture: Using Palms as Gesture Interfaces for Eyes-free Input
MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and ServicesIn this paper, we explored eyes-free gesture interactions on palms, which enables users to interact with devices by drawing stroke gestures on palms without looking at palms. We conducted a 24-person user study to understand how users draw gestures on ...
GazeButton: enhancing buttons with eye gaze interactions
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & ApplicationsThe button is an element of a user interface to trigger an action, traditionally using click or touch. We introduce GazeButton, a novel concept extending the default button mode with advanced gaze-based interactions. During normal interaction, users can ...
B2B-Swipe: Swipe Gesture for Rectangular Smartwatches from a Bezel to a Bezel
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsWe present B2B-Swipe, a single-finger swipe gesture for a rectangular smartwatch that starts at a bezel and ends at a bezel to enrich input vocabulary. There are 16 possible B2B-Swipes because a rectangular smartwatch has four bezels. Moreover, B2B-...
Comments