Xingcheng Ruan
ABSTRACT
Gesture interaction has become indispensable for many mobile computing devices, such as mobile phones, tablets, and wearable devices. Nevertheless, the gesture interaction techniques of these devices cannot effectively recognize the movement of a single finger. In this article, we propose a gesture interaction method based on finger identification by the sEMG and implement applications for verification and demonstration. We designed an Air-Ukulele proptype and an interactive process based on finger movement detection with sEMG signals. Then, experiments involving 12 volunteers were conducted to evaluate the performance and user sensations of our interaction method. By analyzing collected data, we demonstrated sEMG based finger movement detection a relaxing, natural, and efficient interaction method with an overall accuracy at 82.6% and a potential interaction method for future Nature User Interface (NUI).
- Zainal Arief, Indra Adji Sulistijono, and Roby Awal Ardiansyah. 2015. Comparison of Five Time Series EMG Features Extractions Using Myo Armband. 2015 International Electronics Symposium (IES). 11--14, 2015.Google Scholar
- Robert S. Armiger and R. Jacob Vogelstein. 2008. Air-Guitar Hero: a real-time video game interface for training and evaluation of dexterous upper-extremity neuroprosthetic control algorithms. 2008 IEEE Biomedical Circuits and Systems Conference. (BioCAS). 121--124, 2008.Google ScholarCross Ref
- Joseph J. LaViola Jr. 2014. An Introduction to 3D Gestural Interfaces. ACM SIGGRAPH 2014 Courses (SIGGRAPH '14), Article No.25. Google ScholarDigital Library
- 2018. Myo armband. Wikipedia. Retrieved April 8, 2018 from https://en.wikipedia.org/wiki/Myo_armbandGoogle Scholar
- 2018. Ukulele. Wikipedia. Retrieved February 10, 2018, from https://en.wikipedia.org/wiki/UkuleleGoogle Scholar
Index Terms
- Air-Ukulele: Finger Movement Detection Based on sEMG for Ukulele playing
Recommendations
Finger identification and hand gesture recognition techniques for natural user interface
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human InteractionThe natural user interface using hand gesture have been popular field in Human-Computer-Interaction(HCI). Many research papers have been proposed in this field. They proposed vision-based, glove-based and depth-based approach for hand gesture ...
Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
Finger controller: natural user interaction using finger gestures
HCI'13: Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IVWe present a new natural user interaction technique using finger gesture recognition and finger identification with Kinect depth data. We developed a gesture version drawing, multi-touch and mapping on 3d space interactions. We implemented three type ...
Comments