Aleksandar Krastev
ABSTRACT
The paper presents a "design and simulation of gesture"-based model to support education of children with hearing problems. To engage the child's attention and control their own learning according to the individual skills, a framework is proposed for interaction with an artificial hand in the form of a game with rewards for correct answers. The anthropomorphic hand, designed for the purpose in 3D, is both realistic and able to produce all fingerspelling signs of the international sign language. The novelty of the present work is in the proposed integration of biologically feasible movements of the hand and the cognitive ability to display meaningful signs to support teaching novel concepts to children with hearing problems.
- Backer, S. The Importance of Fingerspelling for Reading. Visual Language and Visual Learning Science of Learning Center (Research Brief No. 1). Washington, DC, 2010, p. 8.Google Scholar
- Cook, S., M. Tanenhaus. Embodied Communication: Speakers' Gestures Affect Listeners' Actions. Cognition, vol. 113 (1), 2009, 98--104.Google ScholarCross Ref
- Fingerspelling, http://www.signingsavvy.com/browse-fingerspellingGoogle Scholar
- Gleeson, B., K. MacLean, A. Haddadi, E. Croft, J. Alcazar. Gestures for Industry: Intuitive Human-Robot Communication from Human Observation. ACM/IEEE HRI'13, Tokyo, Japan, 349--356. Google ScholarDigital Library
- Grebenstein, M., P. van der Smagt. Antagonism For a Highly Anthropomorphic Hand--Arm System. Advanced Robotics, vol. 22, 2008, 39--55.Google ScholarCross Ref
- http://arstechnica.com/information-technology/2013/02/robohand-how-cheap-3d-printers-built-a-replacement-hand-for-a-five-year-old-boy/Google Scholar
- http://www.asme.org/engineering-topics/articles/mechanisms-systems-devices/3d-printing-helps-kids-grasp-lifeGoogle Scholar
- Huang, C.-M., B. Mutlu. Modeling and Evaluating Narrative Gestures for Humanlike Robots. Proceedings of Robotics: Science and Systems (RSS) Conference, Berlin, Germany, 2013, 26--32.Google ScholarCross Ref
- Jaffe, D. Evolution of Mechanical Fingerspelling Hands for People Who are Deaf-Blind. Journal of Rehabilitation Research and Development, Vol. 31 (3), 1994, 236--244.Google Scholar
- Makaton, http://www.makaton.org/Google Scholar
- MSC.visualNastran 4D, http://www.mscsoftware.comGoogle Scholar
- Oramas, J., K. Chiluiza, A. Moreno. Potential Benefits in the Learning Process of Ecuadorian Sign Language Using a Sign Recognition System. E-Minds, Vol. 2 (7), 39--57.Google Scholar
- Osborne, C. Gesture-based Tech: A Future in Education. March, 2012, http://www.zdnet.com/blog/igeneration/gesture-based-tech-a-future-in-education/15514Google Scholar
- Rossini, N., D. Gibbon. Why Gesture without Speech but Not Talk without Gesture? Proceedings of Gesture and Speech in Interaction - GESPIN, Bielefeld, Germany, http://coral2.spectrum.uni-bielefeld.de/gespin2011/final/Rossini_Gibbon.pdfGoogle Scholar
- Schultz, S., C. Pylatiuk, G. Bretthauer. A New Ultra-Light Anthropomorphic Hand. Proceedings of IEEE International Conference on Robotics and Automation, Seoul, Korea (2001), 2437--2441.Google Scholar
- Stiefelhagen, R. H. K. Ekenel, C. Fügen, P. Gieselmann, H. Holzapfel, F. Kraft, K. Nickel, M. Voit, A. Waibel. Enabling Multimodal Human-Robot Interaction for the Karlsruhe Humanoid Robot. IEEE Transactions on Robotics, Special Issue on Human-Robot Interaction, Vol. 23, No. 5, 2007, 840--851. Google ScholarDigital Library
- Zamfirov, M., S. Saeva. Sign Language on Human and Nature, Physics and Astronomy. Altera Publisher, Sofia, 2004 (in Bulgarian).Google Scholar
Index Terms
- An interactive technology to support education of children with hearing problems
Recommendations
Improving Learning Outcomes for Higher Education Through Smart Technology
The ever-decreasing time between the doubling of knowledge creates a problem for education concerning how to handle information overload. To address this issue, educators must learn to make learning more effective and more efficient. Currently, there is ...
Autistic Children's Use of Technology and Media: A Fieldwork Study
IDC '17: Proceedings of the 2017 Conference on Interaction Design and ChildrenThis qualitative field study conducted at a school for autistic children aimed to explain how low and medium functioning autistic children use technology at school. Additionally, it explored education professionals and parents' attitudes and concerns ...
Effectiveness of a Student Response System Supported Curriculum and a Middle School Leadership Program
A student response system SRS with an engaging and interactive curriculum to support 21st -century skills could increase student performance in U.S. schools. This article will include student and teacher feedback to provide educators with possible ...
Comments