Lee Boon Giin
ABSTRACT
In this paper, we present a smart wearable hand-gesture recognition system based on the movement of the hand and fingers. The proposed smart wearable system is built using the fewest sensors necessary for gesture recognition. Thus, motion sensors are placed on the thumb and index finger to detect finger motions. Another sensor is placed on the back of the hand to measure hand movement. A total of six gestures are analyzed via hand and finger movement using a dynamic time-warping method. Gestures include "swipe right," "swipe left," "zoom in," "zoom out," "rotate left," and "rotate right." An Android-based mobile device application simulator measures gesture recognition effectiveness. Gestures are analyzed using a trained recognition model. Once a gesture is detected, it is transmitted to the mobile application via Bluetooth low energy communication. Received gestures then trigger corresponding commands, as specified in the mobile application. The proposed smart wearable system can detect gestures at mean accuracy of 93.19 %.
- Wu, Y., and Huang, T. S. 1999. Vision-based gesture recognition: a review. In Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction (March 17-19, 1999). Springer-Verlag London, UK, 103--115. Google Scholar
Digital Library
- Wamg, Q., Chen, X., Chen, R., Chen, Y., and Zhang, X. 2013. Electromyography-based locomotion pattern recognition and personal positioning toward improved context-awareness applications. IEEE Trans. Syst. Man. Cybern. (Jun. 2013), 1216--1227.Google ScholarCross Ref
- Englehart, K., and Hudgins, B. 2003. A robust real-time control scheme for multifunction myoelectric control. IEEE Trans. Biomed. Eng. (Jul. 2003), 848--854.Google ScholarCross Ref
- Momen, K., Krishnan, S., and Chau, T. 2007. Real-time classification of forearm electromyographic signals corresponding to user-selected intentional movements for multifunction prosthesis control. IEEE Trans. Neural Syst. And Rehabil. Eng. (Dec. 2007), 535--542.Google ScholarCross Ref
- Uchida, N., Hiraiwa, A., Sonehara, N., and Shimohara, K. 1992. Emg pattern recognition by neural networks for multi fingers control. In 14th Annual Int. Conf. Eng. Med. Biol. Soc. (Paris, France, October 29-November 1, 1992).Google ScholarCross Ref
- Matiwade, S. V., Dixit, M. R. 2016. Electronic support system for deaf and dumb to interpret sign language of communication. Int. J. Eng. R. Technol. (Apr. 2013), 382--387.Google Scholar
- Chowdary, P. R. V., Babu, M. N., Subbareddy, T. V., Reddy, B. M. and Elamaran, V. 2015. Image processing algorithms for gesture recognition using matlab. In Int. Conf. Adv. Comm. Control Comput. Technol. (India, January 2015).Google Scholar
- Khan, T., and Pathan, A. H. 2015. Hand gesture recognition based on digital image processing using matlab. Int. J. Sci. Eng. R. (Sep. 2015), 338--346.Google Scholar
- Lamberti, L., and Camastra, F. 2011. Real-time hand gesture recognition using a color glove. In Int. Conf. Image Analy. Process. (Ravenna, Italy, Sep. 2011). Google ScholarDigital Library
- Iwai, Y., Watanabe, K., Yagi, Y., and Yachida, M. 1996. Gesture recognition using colored gloves. In Proceedings of 13th International Conference Pattern Recognition. (Vienna, Austria, August 25-29). Google ScholarDigital Library
- Dawane, S. P., and Sayyed H. G. A. 2017. Hand gesture recognition for deaf and dumb people using gsm module. Int. J. Sci. R. (May 2017), 2226--2230.Google Scholar
- Patil, K., Pendharkar, G., and Gaikwad, G. N. 2014. American sign language detection. Int. J. Sci. R. Pub. (Nov. 2014), 1--6.Google Scholar
- Kim, J., Thang, N. D., and Kim, T. 2009. 3-D hand motion tracking and gesture recognition using a data glove. In IEEE Int. Symp. Industrial Elec. (Seoul, South Korea, July 5-8).Google Scholar
- Lu, D., Yu, Y. and Liu, H. 2016. Gesture recognition using data glove: an extreme learning machine method. In Proceedings of 2016 IEEE International Conference on Robotics and Biometics. (Qingdao, China, December, 3-7).Google Scholar
- Adafruit BNO055 absolute orientation sensor. https://learn.adafruit.com/adafruit-bno055-absolute-orientation-sensor/overview.Google Scholar
- Arduino Pro Mini 328 -- 5V/16 MHz. http://www.devicemart.co.kr/1287163Google Scholar
- Bluetooth 4.0 HM-10. http://mechasolution.com/shop/goods/goods_view.php?goodsno=330423&category=132024Google Scholar
- Lithium ion polymer battery -- 3.7v 500 mAh. https://www.adafruit.com/product/1578Google Scholar
- Keogh, E., and Ratanamahatana, C. A. 2002. Exact indexing of dynamic time warping. Knowledge and Information Systems (Hong Kong, China, Aug. 2002). Google ScholarDigital Library
Index Terms
- Smart Hand Device Gesture Recognition with Dynamic Time-Warping Method
Recommendations
Kinect Based Dynamic Hand Gesture Recognition Algorithm Research
IHMSC '12: Proceedings of the 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics - Volume 01In dynamic gesture track recognition, gesture recognition rate has always been a problem, Because the traditional hand gesture recognition in how to separate the hand type from the surrounding environment, and then determine the palm position has been ...
A hand gesture interface device
This paper reports on the development of a hand to machine interface device that provides real-time gesture, position and orientation information. The key element is a glove and the device as a whole incorporates a collection of technologies. Analog ...
A Method for Hand Gesture Recognition
CSNT '14: Proceedings of the 2014 Fourth International Conference on Communication Systems and Network TechnologiesIn this paper, we present a method for hand gesture recognition using Microsoft Kinect sensor. Kinect allows capturing dense, and three dimensional scans of an object in real time. We propose a combination of modelling and learning approach for hand ...
Comments