short-paper

Sign language animation using TVML

Authors:

Hiroyuki Kaneko,

Narichika Hamaguchi,

Mamoru Doke,

Seiki InoueAuthors Info & Claims

VRCAI '10: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry

Pages 289 - 292

https://doi.org/10.1145/1900179.1900240

Published: 12 December 2010 Publication History

Get Access

Abstract

The deaf communities in Japan use a visual language called Japanese Sign Language (JSL) as their first language. Learning to read Japanese can be difficult for some deaf people, because JSL has a totally different grammar from Japanese. NHK broadcasts news and other programs in sign language (sign language broadcasts), but there is a strong demand from deaf communities for more sign language broadcasts. This motivated us to pursue technology for generating sign language animation.

Our recent work has focused on adapting TVML (TV program Making Language) [Hayashi 1996; TVML Website] for use in producing sign language animation. TVML is a text-based computer language that produces computer graphics (CG) animated TV programs by simply writing a script in TVML.

At first, we recorded body movements representing sign language words using an optical motion capture technology. In addition, we improved TVML to express manual movements of sign language and developed a Japanese-to-JSL dictionary with a collection of about 4,900 sign language words. Now in this latest work, we have developed a scheme for combining multiple captured motion data to generate sign language sentences using CG animation.

References

[1]

Hayashi, M., Ueda, H., and Kurihara, T. 1999. TVML (TV program Making Language) -Automatic TV Program Generation from Text-based Script-. In Proceedings of Imagina '99, 122--133.

Google Scholar

[2]

TVML Website: http://www.nhk.or.jp/strl/tvml/

Google Scholar

[3]

Sakiyama, T., Oohira E., Sagawa, H., Ooki, M., and Ikeda, H. 1996. A Generation Method for Real-Time Sign Language Animation. In IEICE transactions on information and systems, J79-D-2(2), 182--190 (in Japanese)

Google Scholar

[4]

Debuchi, R., Yagi, R., Himeno, Y., and Nagashima, Y. 2007. Development of the Animation Library of Sign Language Words and the Editor to Synthesize Sign Language Words. In IEICE technical report. Welfare Information technology, 106(612), 7--12 (in Japanese)

Google Scholar

[5]

Glauert, J. R. W., Kennaway, R., Elliott, R., and Theobald, B. 2004. Virtual Human Signing as Expressive Animation. In Proceedings of the AISB 2004 Convention on Motion, Emotion and Cognition, 98--106.

Google Scholar

[6]

Falletto, A., Prinetto, P., and Tiotto, G. 2009. An Avatar-Based Italian Sign Language Visualization System. In eHealth 2008, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, 154--160.

Google Scholar

Cited By

View all

Ali IKolivand H(2024)Expressive sign language system for deaf kids with MPEG-4 approach of virtual human characterJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-024-04842-7Online publication date: 14-Sep-2024
https://doi.org/10.1007/s12652-024-04842-7
Yulia Yang CLai Y(2022)Video-Based Text to American Sign Language via Transitional Motion Synthesis2022 12th International Conference on Advanced Computer Information Technologies (ACIT)10.1109/ACIT54803.2022.9913078(520-524)Online publication date: 26-Sep-2022
https://doi.org/10.1109/ACIT54803.2022.9913078
Yang FMousas CAdamo N(2022)Holographic sign language avatar interpreter: A user interaction study in a mixed reality classroomComputer Animation and Virtual Worlds10.1002/cav.208233:3-4Online publication date: 9-Jun-2022
https://doi.org/10.1002/cav.2082
Show More Cited By

Recommendations

Modeling animations of American Sign Language verbs through motion-capture of native ASL signers

Software to generate American Sign Language (ASL) automatically can provide benefits for deaf people with low English literacy. However, modern computational linguistic software cannot produce important aspects of ASL signs and verbs. Better models of ...
Sign Language Support System for Viewing Sports Programs
ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

To expand the services that are based on Japanese Sign Language (JSL) for deaf and hard of hearing people, we developed a support system for viewing sports program. The system provides sign language computer graphics (CG) animations and other auxiliary ...
Evaluation of a Sign Language Support System for Viewing Sports Programs
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

As information support to deaf and hard of hearing people who are viewing sports programs, we have developed a sign language support system. The system automatically generates Japanese Sign Language (JSL) computer graphics (CG) animation and subtitles ...

Comments

Information & Contributors

Information

Published In

VRCAI '10: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry

December 2010

399 pages

ISBN:9781450304597

DOI:10.1145/1900179

General Chairs:
Hyun Seung Yang
KAIST, Korea
,
Kazumasa Enami
National Institute of Information and Communications Technology, Japan
,
Nadia Magnenat-Thalmann
MIRALab, University of Geneva, Switzerland
,
Jim Chen
George Mason University
,
Program Chairs:
Seiki Inoue
NHK Science and Technical Research Labs, Japan
,
Zhigeng Pan
State Key Lab of CAD&CG, Zhejiang University, China
,
Jong -IL Park
Hanyang University, Korea

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

VRCAI '10

Sponsor:

SIGGRAPH

VRCAI '10: Virtual Reality Continuum and its Applications in Industry

December 12 - 13, 2010

Seoul, South Korea

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
267
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ali IKolivand H(2024)Expressive sign language system for deaf kids with MPEG-4 approach of virtual human characterJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-024-04842-7Online publication date: 14-Sep-2024
https://doi.org/10.1007/s12652-024-04842-7
Yulia Yang CLai Y(2022)Video-Based Text to American Sign Language via Transitional Motion Synthesis2022 12th International Conference on Advanced Computer Information Technologies (ACIT)10.1109/ACIT54803.2022.9913078(520-524)Online publication date: 26-Sep-2022
https://doi.org/10.1109/ACIT54803.2022.9913078
Yang FMousas CAdamo N(2022)Holographic sign language avatar interpreter: A user interaction study in a mixed reality classroomComputer Animation and Virtual Worlds10.1002/cav.208233:3-4Online publication date: 9-Jun-2022
https://doi.org/10.1002/cav.2082
Rani AGoyal VGoyal L(2021)Development of Data Set for Automatic News Telecast System for Deaf Using ISL VideosProceedings of Data Analytics and Management10.1007/978-981-16-6285-0_13(153-163)Online publication date: 22-Nov-2021
https://doi.org/10.1007/978-981-16-6285-0_13
Azuma MHiruma NSumiyoshi HUchida TMiyazaki TUmeda SKato NYamanouchi Y(2018)Development and Evaluation of System for Automatically Generating Sign-Language CG Animation Using Meteorological InformationComputers Helping People with Special Needs10.1007/978-3-319-94277-3_38(233-238)Online publication date: 26-Jun-2018
https://doi.org/10.1007/978-3-319-94277-3_38
Oh JJeon SKim BKim MKang SKwon HKim ISong Y(2017)Avatar-Based Sign Language Interpretations for Weather Forecast and other TV ProgramsSMPTE Motion Imaging Journal10.5594/JMI.2016.2632278126:1(57-62)Online publication date: Jan-2017
https://doi.org/10.5594/JMI.2016.2632278
Uchida TUmeda SAzuma MMiyazaki TKato NHiruma NInoue SNagashima Y(2016)Provision of emergency information in sign language CG animation over integrated broadcast-broadband system2016 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)10.1109/BMSB.2016.7521930(1-4)Online publication date: Jun-2016
https://doi.org/10.1109/BMSB.2016.7521930
Punchimudiyanse MMeegama R(2015)3D signing avatar for Sinhala Sign language2015 IEEE 10th International Conference on Industrial and Information Systems (ICIIS)10.1109/ICIINFS.2015.7399026(290-295)Online publication date: Dec-2015
https://doi.org/10.1109/ICIINFS.2015.7399026
Kim MChoi SYoon AKwon H(2015)Practical Target Word Selection Method in Korean to Korean Sign Language Machine Translation2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing10.1109/CIT/IUCC/DASC/PICOM.2015.140(931-934)Online publication date: Oct-2015
https://doi.org/10.1109/CIT/IUCC/DASC/PICOM.2015.140
Ito T(2015)R&D for Accessible Broadcasting in JapanA Multimodal End-2-End Approach to Accessible Computing10.1007/978-1-4471-6708-2_12(227-241)Online publication date: 2015
https://doi.org/10.1007/978-1-4471-6708-2_12
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Recommendations

Modeling animations of American Sign Language verbs through motion-capture of native ASL signers

Sign Language Support System for Viewing Sports Programs

Evaluation of a Sign Language Support System for Viewing Sports Programs

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations