skip to main content
10.1145/1414471.1414496acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
research-article

Evaluation of a psycholinguistically motivated timing model for animations of american sign language

Published: 13 October 2008 Publication History

Abstract

Using results in the psycholinguistics literature on the speed and timing of American Sign Language (ASL), we built algorithms to calculate the time-duration of signs and the location/length of pauses during an ASL animation. We conducted a study in which native ASL signers evaluated the ASL animations processed by our algorithms, and we found that: (1) adding linguistically motivated pauses and variations in sign-durations improved signers' performance on a comprehension task and (2) these animations were rated as more understandable by ASL signers.

References

[1]
Bellugi, U., Fischer, S. 1972. A comparison of sign language and spoken language. Cognition, 1:2--3.
[2]
Chiu, Y.-H., Wu, C.-H., Su, H.-Y., Cheng, C.-J. 2007. Joint optimization of word alignment and epenthesis generation for Chinese to Taiwanese sign synthesis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29:1.
[3]
Elliott, R., Glauert, J., Kennaway, J., Marshall, I., Safar, E. 2008. Linguistic modeling and language--processing technologies for avatar-based sign language presentation. Univ Access Inf Soc, 6:4.
[4]
Fischer, S., Delhourne, L., Reed, C. 1999. Effects of rate of presentation on the reception of American Sign Language. J Speech Lang Hear Res, 42.
[5]
Fotinea, S.-E., Efthimiou, E., Caridakis, G., Karpouzis, K. 2008. A knowledge-based sign synthesis architecture. Univ Access Inf Soc, 6:4.
[6]
Grosjean, F. 1979. A study of timing in a manual and a spoken language: American sign language and English. J Psycholinguist Res. 8:4.
[7]
Grosjean, F., Grosjean, L., Lane, H. 1979. The patterns of silence: Performance structures in sentence production. Cognitive Psychology, 11.
[8]
Grosjean, F., Lane, H., Teuber, H. and Battison, R. 1981. The invariance of sentence performance structures across language modality. J Exp Psychol Hum Percept Perform, 7.
[9]
Heiman, G., Tweney, R. 1981. Intelligibility and comprehension of time compressed sign language narratives. J Psycholinguist Res, 10:1.
[10]
Holt, J.A. 1993. Stanford Achievement Test -- 8th Edition: Reading comprehension subgroup results. American Annals of the Deaf, 138.
[11]
Huenerfauth, M., Zhou, L, Gu, E., and Allbeck, J. 2007. Evaluating American Sign Language generation through the participation of native ASL signers. In Proc. of ACM SIGACCESS Conf. on Comp. and Accessibility (Assets '07).
[12]
Huenerfauth, M. 2006. Generating American Sign Language classifier predicates for English-to-ASL machine translation. Dissertation, Comp. & Info. Science, U. Penn.
[13]
Kennaway, J., Glauert, J., Zwitserlood, I. 2007. Providing signed content on the Internet by synthesized animation. ACM Trans. on Computer-Human Interaction, 14:3.
[14]
Marshall, I., Sáfár, E. 2005. Grammar development for sign language avatar--based synthesis, In 3rd International Conference on Universal Access in HCI, Las Vegas, NV.
[15]
Mitchell, R., Young, T., Bachleda, B., & Karchmer, M. 2006. How Many People Use ASL in the United States? Why Estimates Need Updating. Sign Language Studies, 6:3.
[16]
Sheard, M., van der Schoot, S., Zwiterslood, I., Verlinden, M., Weber, I. 2004. Eval. reports 1 & 2, EU project Essential sign language information on government networks.
[17]
Stein, D., Bungeroth, J., Ney, H. 2006. Morpho-syntax based statistical methods for sign language translation. In Proc. of the European Assoc. for Machine Translation.
[18]
Tartter, V., Fischer, S. 1983. Perceptual confusion in ASL under normal and reduced (point-light display) conditions. In J. Kyle & B. Woll (eds.), Language in sign: An international perspective on sign language, London: Croom Helm.
[19]
Vcom3D. 2008. Company website. http://www.vcom3d.com
[20]
Vink, M., Schermer, T. 2005. Report of research on use of an avatar compared with drawings or films of gestures. Technical Report, Dutch Sign Language Center.
[21]
Wingfield, A., Tun, P., Koh, C., Rosen, M. 1999. Regaining lost time: Adult aging and the effect of time restoration on recall of time-compressed speed. Psychol Aging, 14:3.

Cited By

View all
  • (2024)An exploratory user study towards developing a unified, comprehensive assessment apparatus for deaf signers, specifically tailored for signing avatars evaluation: challenges, findings, and recommendationsMultimedia Tools and Applications10.1007/s11042-024-20365-xOnline publication date: 29-Oct-2024
  • (2023)Recent advancements in multimodal human–robot interactionFrontiers in Neurorobotics10.3389/fnbot.2023.108400017Online publication date: 11-May-2023
  • (2023)"I Want To Be Able To Change The Speed And Size Of The Avatar": Assessing User Requirements For Animated Sign Language Translation InterfacesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585675(1-7)Online publication date: 19-Apr-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
Assets '08: Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
October 2008
332 pages
ISBN:9781595939760
DOI:10.1145/1414471
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. accessibility technology for the deaf
  2. american sign language
  3. animation
  4. evaluation
  5. natural language generation

Qualifiers

  • Research-article

Conference

ASSETS08
Sponsor:

Acceptance Rates

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Upcoming Conference

ASSETS '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)An exploratory user study towards developing a unified, comprehensive assessment apparatus for deaf signers, specifically tailored for signing avatars evaluation: challenges, findings, and recommendationsMultimedia Tools and Applications10.1007/s11042-024-20365-xOnline publication date: 29-Oct-2024
  • (2023)Recent advancements in multimodal human–robot interactionFrontiers in Neurorobotics10.3389/fnbot.2023.108400017Online publication date: 11-May-2023
  • (2023)"I Want To Be Able To Change The Speed And Size Of The Avatar": Assessing User Requirements For Animated Sign Language Translation InterfacesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585675(1-7)Online publication date: 19-Apr-2023
  • (2023)Asymmetry in Transition Times in American Sign Language2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)10.1109/ICASSPW59220.2023.10193506(1-5)Online publication date: 4-Jun-2023
  • (2021)At a Different Pace: Evaluating Whether Users Prefer Timing Parameters in American Sign Language Animations to Differ from Human Signers’ TimingProceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3441852.3471214(1-12)Online publication date: 17-Oct-2021
  • (2021)Comparison of Methods for Evaluating Complexity of Simplified Texts among Deaf and Hard-of-Hearing Adults at Different Literacy LevelsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445038(1-12)Online publication date: 6-May-2021
  • (2020)Algorithm 1010ACM Transactions on Mathematical Software10.1145/338624146:2(1-28)Online publication date: 19-May-2020
  • (2020)Effective Detection of Sleep-in-atomic-context Bugs in the Linux KernelACM Transactions on Computer Systems10.1145/338199036:4(1-30)Online publication date: 17-Apr-2020
  • (2020)Algorithm 1009ACM Transactions on Mathematical Software10.1145/338153746:2(1-28)Online publication date: 19-May-2020
  • (2020)JGraphT—A Java Library for Graph Data Structures and AlgorithmsACM Transactions on Mathematical Software10.1145/338144946:2(1-29)Online publication date: 19-May-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media