Learning onomatopoeic expressions by animation

ABSTRACT

This paper focuses on a design solution to Japanese onomatopoeic accessibility problems for the hard-of-hearing. Our research suggests that the onomatopoeic expressions accompanied by animation would be able to transmit emotional images of words. The animations were more effective than text or video clips. We believe that an animation dictionary would be an effective educational material that is understandable by hard-of-hearing students.

REFERENCES

• 1: Conrad, R., Short-term memory processes in the deaf., British Journal of Psychology, 61, 179--195, 1970.
• 2: Conrad, R., Short-term memory in the deaf: A test for speech coding., British Journal of Psychology, 63, 173--180, 1972.
• 3: Hanson, V. L., Short-tem recall by deaf signers of American Sign language: Implications of encoding strategy for order recall., Journal of Experimental Psychology: Learning, Memory and Cognition, 8, 572--583, 1982.
• 4: Hanson, V. L., Recall of order information by deaf signers: Phonetic coding in temporal order recall., Memory and Cognition, 18, 604--610, 1990.
• 5: Wilson, M. & Emmorey, K., A visiospatial "phonological loop" in working memory: Evidence from American Sign Language., Memory and Cognition, 25, 313--320, 1997.
• 6: Wilson, M. & Emmorey, K., Working memory of sign language: A window into the architecture of the working memory system., Journal of Deaf Studies and Deaf Educaiton, 2, 121--130, 1997.
• 7: Wilson, M. & Emmorey, K., A "word length effect" for sign language: Further evidence for the role of language in structuring working memory., Memory and Cognition, 26, 584--590, 1998.
• 8: Gentry, M. M. Chinn, K. M. & Moulton, R. D., Effectiveness of multimedia reading materials when used with children who are deaf., American Annals of the Deaf, 149, 394--402, 2004.
• 9: Gentry, M. M., Chinn, K. M. and Moulton, R. D. Effectiveness of multimedia reading materials when used with children who are deaf, American Annals of the Deaf, Vol. 149, 394--402, 2004.
• 10: Kimberly Tee , Karyn Moffatt , Leah Findlater , Eve MacGregor , Joanna McGrenere , Barbara Purves , Sidney S. Fels, A visual recipe book for persons with language impairments, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055042]

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education
          Subjects: Computer-assisted instruction (CAI)

General Terms:
Design, Human Factors

Keywords:
animation, hard-of-hearing, onomatopoeic, visualization