ABSTRACT
Cerebral Palsy, trauma, and strokes are common causes for the loss of hand movements and the decrease in muscle strength for both children and adults. Improving fine motor skills usually involves the synchronization of wrists and fingers by performing appropriate tasks and activities. This demo introduces a novel patient-centered framework for the gamification of hand therapies in order to facilitate and encourage the rehabilitation process. This framework consists of an adaptive therapy-driven 3D environment augmented with our motion-based natural user interface. An intelligent game generator is developed, which translates the patient's gestures into navigational movements with therapy-driven goals, while adapting the level of difficulty based on the patient profile and real-time performance. A comprehensive evaluation and clinical-based assessments were conducted in a local children disability center, and highlights of the results are presented.
Supplemental Material
- Imad Afyouni, Faizan Ur Rehman, Ahmad Qamar, Akhlaq Ahmad, Mohamed Abdur, and Saleh Basalamah. 2014. A GIS-based Serious Game Recommender for Online Physical Therapy. In In Proceedings of the Third International ACM SIGSPATIAL Workshop on HealthGIS (HealthGIS'14). Google ScholarDigital Library
- Cati Boulanger, Adam Boulanger, Lilian de Greef, Andy Kearney, Kiley Sobel, Russell Transue, Z Sweedyk, Paul H Dietz, and Steven Bathiche. 2013. Stroke rehabilitation with a sensing surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1243--1246. Google ScholarDigital Library
- Yasaman Hashemian and Ding Wang. 2014. TouchPoints: an exertion game with strategy. In Proceedings of the ?rst ACM SIGCHI annual symposium on Computer-human interaction in play. ACM, 419--420. Google ScholarDigital Library
- Maryam Khademi, Hossein Mousavi Hondori, Alison McKenzie, Lucy Dodakian, Cristina Videira Lopes, and Steven C Cramer. 2014. Free-hand interaction with leap motion controller for stroke rehabilitation. In Oriceedings of the CHI'14 Extended Abstracts on Human Factors in Computing Systems. ACM, 1663--1668. Google ScholarDigital Library
- Alexandros Lioulemes. 2016. Adaptive User and Haptic Interfaces for Smart Assessment and Training. In Companion Publication of the 21st International Conference on Intelligent User Interfaces. ACM, 130--133. Google ScholarDigital Library
Index Terms
- Motion-Based Serious Games for Hand Assistive Rehabilitation
Recommendations
Graphics for Serious Games: A head movement propensity model for animating gaze shifts and blinks of virtual characters
An automatic model is presented for animating gaze shifts of virtual characters towards target locations in a virtual environment. Two connected components are described: an eye-head controller and a blinking controller. The gaze control model is based ...
The Leap Motion controller: a view on sign language
OzCHI '13: Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, CollaborationThis paper presents an early exploration of the suitability of the Leap Motion controller for Australian Sign Language (Auslan) recognition. Testing showed that the controller is able to provide accurate tracking of hands and fingers, and to track ...
Multi-sensor data fusion for hand tracking using Kinect and Leap Motion
VRIC '14: Proceedings of the 2014 Virtual Reality International ConferenceOften presented as competing products on the market of low cost 3D sensors, the Kinect™ and the Leap Motion™ (LM) can actually be complementary in some scenario. We promote, in this paper, the fusion of data acquired by both LM and Kinect sensors to ...
Comments