ABSTRACT
Translating from English to American Sign Language (ASL) requires an avatar to display synthesized ASL. Essential to the language are nonmanual signals that appear on the face. Previous avatars were hampered by an inability to portray emotion and facial nonmanual signals that occur at the same time. A new animation system addresses this challenge. Animations produced by the new system were tested with 40 members of the Deaf community in the United States. For each animation, participants were able to identify both nonmanual signals and emotional states. Co-occurring question nonmanuals and affect information were distinguishable, which is particularly striking because the two processes can move an avatar's brows in opposing directions.
- VCom3D. n.d. Sign Smith 3.0 user manual. http://www.vcom3d.com/docs/Sign_Smith_Studio3.0_UsersGuide.pdf.Google Scholar
- Huenerfauth, M., Lu, P. and Rosenberg, A. 2011. Evaluating importance of facial expression in American Sign Language and pidgin signed English animations. In Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (Dundee, UK, October 22 - 24, 2011). ASSETS'11. ACM, New York, NY, 99--106. DOI= http://doi.acm.org/10.1145/2049536.2049556. Google ScholarDigital Library
- S. Gibet, N. Courty, K. Duarte, and Le Naour, T. 2011.The signcom system for data- driven animation of interactive virtual signers: Methodology and evaluation. ACM Transactions on interactive intelligent systems. 1, 1 (Oct. 2011), 1--26. DOI= http://doi.acm.org/10.1145/2030365.2030371. Google ScholarDigital Library
- Elliott, R., Glauert, J. and Kennaway, J. 2004. A framework for non-manual gestures in a synthetic signing system. In Proceedings of the Second Cambridge Workshop on Universal Access and Assistive Technology (Cambridge, UK, March 22 - 24, 2004). CWUAAT 04. 127--136. http://www-edc.eng.cam.ac.uk/cwuaat/04/39-pat-elliott_cwuaat-2004.pdf.Google Scholar
- Valli, C., Lucas, C. and Mulrooney, K. 2005. Linguistics of American Sign Language: An Introduction. 4th ed. Washington, DC: Gallaudet University Press.Google Scholar
- Neidle, C., Kegl, J., Maclaughlin, D., Bahan, B., and Lee, R. 2000. The Syntax of American Sign Language: Functional Categories And Hierarchical Structure. Cambridge, Massachusetts: MIT Press.Google Scholar
- Weast, T. 2008. Questions in American Sign Language: A quantitative analysis of raised and lowered eyebrows. Doctoral dissertation. The University of Texas, Arlington.Google Scholar
- Schnepp, J. 2012. A representation of selected nonmanual signals in American Sign Language. Doctoral dissertation. DePaul University, Chicago, Illinois.Google Scholar
- Schnepp, J., Wolfe, R., Shiver, B., McDonald, J., and Toro, J. 2011. SignQUOTE: A remote testing facility for eliciting signed qualitative feedback. In Proceedings of the Second International Workshop on Sign Language Translation and Avatar Technology (Dundee, UK, October 23, 2011) http://vhg.cmp.uea.ac.uk/demo/SLTAT2011Dundee/4.pdf.Google Scholar
Index Terms
Combining emotion and facial nonmanual signals in synthesized american sign language
Recommendations
Collecting and evaluating the CUNY ASL corpus for research on American Sign Language animation
Automated synthesis of American Sign Language (ASL) animations will benefit people who are deaf with low English literacy.Annotated ASL motion-capture corpora enable researchers to produce animations with complex spatial and linguistic phenomena.We ...
Emotional facial expressions in synthesised sign language avatars: a manual evaluation
This research explores and evaluates the contribution that facial expressions might have regarding improved comprehension and acceptability in sign language avatars. Focusing specifically on Irish sign language (ISL), the Deaf (the uppercase "D" in the ...
Manual evaluation of synthesised sign language avatars
ASSETS '13: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and AccessibilityThe evaluation discussed in this paper explores the role that underlying facial expressions might have regarding understandability in sign language avatars. Focusing specifically on Irish Sign Language (ISL), we examine the Deaf community's appetite for ...
Comments