Brian Amento
Loren Terveen
ABSTRACT
Two hundred and fifty years ago the Japanese Zen master Hakuin asked the question, "What is the Sound of the Single Hand?" This koan has long served as an aid to meditation but it also describes our new interaction techinique. We discovered that gentle fingertip gestures such as tapping, rubbing, and flicking make quiet sounds that travel by bone conduction throughout the hand. A small wristband-mounted contact microphone can reliably and inexpensively sense these sounds. We harnessed this "sound in the hand" phenomenon to build a wristband-mounted bio-acoustic fingertip gesture interface. The bio-acoustic interface recognizes some common gestures that state-of-the-art glove and image-processing techniques capture but in a smaller, mobile package.
- Buxton, W., E. Fiume. (1983) Continuous hand-gesture driven input. Proc. of Graphics Interface '83: 191--195.Google Scholar
- Ju, P.M. (2000) Classification of Finger Gestures from Myoelectric Signals, Masters Thesis, MIT EE Dept.Google Scholar
- Rabiner, L.R. (1989). A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. Proc. IEEE, Vol. 77, 257--28.Google ScholarDigital Library
Recommendations
A comparative study of user-defined handheld vs. freehand gestures for home entertainment environments
Home entertainment systems have been continuously providing new functionalities to their users in a process in which they evolved from standalone electronic appliances to complex digital milieus superimposed on the home environment. Such complex ...
User Elicitation on Single-hand Microgestures
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsGestural interaction has become increasingly popular, as enabling technologies continue to transition from research to retail. The mobility of miniaturized (and invisible) technologies introduces new uses for gesture recognition. This paper investigates ...
HoverFlow: expanding the design space of around-device interaction
MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and ServicesIn this paper we explore the design space of around-device interaction (ADI). This approach seeks to expand the interaction possibilities of mobile and wearable devices beyond the confines of the physical device itself to include the space around it. ...
Comments