research-article

Application Requirements for Deaf Students to use in Inclusive Classrooms

Authors:

Soraia Silva Prietch,

Napoliana Silva de Souza,

Lucia Villela Leite FilgueirasAuthors Info & Claims

CLIHC '15: Proceedings of the Latin American Conference on Human Computer Interaction

Article No.: 5, Pages 1 - 8

https://doi.org/10.1145/2824893.2824898

Published: 18 November 2015 Publication History

Abstract

The goal was to search for an alternative to mediate communication between people who are Deaf or Hard of Hearing (D/HH) and hearing individuals, in which the major motivation was to provide empowerment for D/HH students, using technology to provide them with more autonomy in inclusive classrooms. With that in mind, a systematic literature review was conducted to elucidate requirements for a mobile application that includes a Speech-To-Text (STT) system, as well as an opinion research accomplished with D/HH participants to know potential users' priorities among the elucidated requirements. As a result, the preference to communicate in Libras (Brazilian Sing Language) prevails, although users consider important to use a mobile application as the one proposed.

References

[1]

Bain, K.; Basson, S.; Faisman, A.; Kanevsky, D. 2005. Accessibility, transcription, and access everywhere. IBM Systems Journal, Vol. 44, No. 3.

Digital Library

[2]

Cavender, Anna; Ladner, Richard E. 2008. Hearing Impairments. S. Harper, Y. Yesilada (eds.), Web Accessibility. Springer-Verlag London Limited.

[3]

Forman, Ira R.; Brunet, Thomas; Luther, Paul; Wilson, Allen. 2009. Using ASR for Transcription of Teleconferences in IM Systems. C. Stephanidis (Ed.): Universal Access in HCI, Part III, HCII 2009, pp. 521--529.

Digital Library

[4]

Hisaki, Ippei; Nanjo, Hiroaki; Yoshimi, Takehiko. 2010. Evaluation of Speech Balloon Captions for Auditory Information Support in Small Meetings. Proceedings of 20th International Congress on Acoustics, ICA 2010, 23-27 August, Sydney, Australia.

[5]

Iglesias, Ana; Ruiz-Mezcua, Belén; López, Juan Francisco; Figueroa, Diego Carrero. 2012. New Communication Technologies for Inclusive Education In & Outside the Classroom. In: Barres, D. et al. (Eds.) Technologies for Inclusive Education: Beyond Traditional Integration Approaches, IGI Global, 271--284 pp.

[6]

Jiménez, Javier; Iglesias, Ana M.; López, Juan F.; Hernández, Julián; Ruiz, Belén. 2011. Tablet PC and Head Mounted Display for Live Closed Captioning in Education. IEEE International Conference on Consumer Electronics.

[7]

Jun, Ma; Cheng, Xu Jia. 2010. The Exploration of the Strategies and Skills of Effective Use of Voice Recognition Software in the Classroom for Deaf Students. Second International Conference on Future Networks.

Digital Library

[8]

Kheir, Richard; Way, Thomas. 2007. Inclusion of Deaf Students in Computer Science Classes using Real-time Speech Transcription. ITiCSE'07, June 23-27, Dundee, Scotland, United Kingdom.

Digital Library

[9]

Kushalnagar, Raja; Lasecki, Walter S.; Bigham, Jeffrey P. A 2012. Readability Evaluation of Real-Time Crowd Captions in the Classroom. ASSETS'12, October 22-24, Boulder.

Digital Library

[10]

Lasecki, Walter S.; Bigham, Jeffrey P. 2012. Online Quality Control for Real-Time Crowd Captioning. ASSETS'12, October 22-24, Boulder, Colorado, USA.

Digital Library

[11]

Lasecki, Walter S.; Miller, Christopher D.; Borrello, Donato; Bigham, Jeffrey P. 2012a. Online Sequence Alignment for Real-Time Audio Transcription by Non-Experts. In: Jörg Hoffmann, Bart Selman (Eds.), Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, July 22-26, Toronto, Ontario, Canada.

[12]

Lasecki, Walter S.; Miller, Christopher D.; Sadilek, Adam; Abumoussa, Andrew; Borrello, Donato; Kushalnagar, Raja; Bigham, Jeffrey P. 2012b. Real-Time Captioning by Groups of Non-Experts. UIST'12, October 7-10, Cambridge, Massachusetts, USA.

Digital Library

[13]

Lasecki, Walter S.; Miller, Christopher D.; Kushalnagar, Raja; Bigham, Jeffrey P. 2013. Legion Scribe: Real-Time Captioning by the Non-Experts. W4A2013 - The Paciello Group Challenge, May 13-15, Rio de Janeiro, Brazil.

Digital Library

[14]

Lasecki, Walter S.; Miller, Christopher D.; Bigham, Jeffrey P. 2013. Warping Time for More Effective Real-Time Crowdsourcing. CHI 2013, April 27--May 2, Paris, France.

Digital Library

[15]

Lee, Seongjae; Kang, Sunmee; Ko, Hanseok; Yoon, Jongseong; Keum, Minseok. 2013. Dialogue Enabling Speech--to-- Text User Assistive Agent with Auditory Perceptual Beamforming for Hearing-Impaired. IEEE International Conference on Consumer Electronics (ICCE).

[16]

Marschark, Marc; Leigh, Greg; Sapere, Patricia; Burnham, Denis; Convertino, Carol; Stinson, Michael; Knoors, Harry; Vervloed, Mathijs P. J.; Noble, William. 2006. Benefits of Sign Language Interpreting and Text Alternatives for Deaf Students' Classroom Learning. Journal of Deaf Studies and Deaf Education 11:4 Fall.

[17]

Martins, José Antônio. 1997. Avaliação de Diferentes Técnicas para Reconhecimento de Fala. Tese de Doutorado em Engenharia Elétrica, Universidade Estadual de Campinas (UNICAMP).

[18]

Matthews, Tara Lynn; Carter, Scott Alan; Pai, Carol; Fong, Janette; Mankoff, Jennifer. 2006. Scribe4Me: Evaluating a Mobile Sound Transcription Tool for the Deaf. Technical Report No. UCB/EECS-2006-49, May 10.

[19]

Mirzaei, Mohammad R.; Ghorshi, Seyed; Mortazavi, Mohammad. 2012. Combining Augmented Reality and Speech Technologies to Help Deaf and Hard of Hearing People. 14th Symposium on Virtual and Augmented Reality.

Digital Library

[20]

Mirzaei, Mohammad R.; Ghorshi, Seyed; Mortazavi, Mohammad. 2013. Audio-visual speech recognition techniques in augmented reality environments. The Visual Computer, Springer, DOI 10.1007/s00371-013-0841-1.

Digital Library

[21]

Murphy, Matthew J.; Miller, Christopher D.; Lasecki, Walter S.; Bigham, Jeffrey P. 2013. Adaptive Time Windows for Real-Time Crowd Captioning. CHI 2013 Extended Abstracts, April 27 -- May 2, Paris, France.

Digital Library

[22]

National Court Reporters Association. Available in: http://www.ncra.org/, acess date 04/28/2014.

[23]

Neerincx, Mark A.; Cremers, Anita H. M.; Kessens, Judith M.; Van Leeuwen, David A.; Truong, Khiet P. 2009. Attuning speech-enabled interfaces to user and context for inclusive design: technology, methodology and practice. DOI 10.1007/s10209-008-0136-x, Universal Access in the Information Society, Vol. 8, Issue 2, pp. 109--122.

Digital Library

[24]

Papadopoulos, Miltiades; Pearson, Elaine. 2012. Improving the Accessibility of the Traditional Lecture: An Automated Tool for Supporting Transcription. Proceedings of the BCS HCI, People & Computers XXVI, Birmingham, UK.

Digital Library

[25]

Powell, Denise; Hyde, Merv; Punch, Renée. 2013. Inclusion in Postsecondary Institutions with Small Numbers of Deaf and Hard-of-Hearing Students in New Zealand. Journal Deaf Studies and Deaf Education.

[26]

Primiani, R.; Tibaldi, D.; Garlaschelli, L. 2008. Net4voice -- New Technologies for voice-converting in barrier-free learning environment. International Conference on Frontiers in Education: Computer Science and Computer Engineering, Las Vegas, NV, USA.

[27]

Ranchal, R.; Taber-Doughty, T.; Guo, Y.; Bain, K.; Martin, H.; Robinson, J. P.; Duerstock, B. S. 2013. Using Speech Recognition for Real-Time Captioning and Lecture Transcription in the Classroom. IEEE Transactions on Learning Technologies.

Digital Library

[28]

Skliar, Carlos; Quadros, Ronice M. 2004. Bilingual Deaf Education in the South of Brazil. International Journal of Bilingual Education and Bilinguism, Vol. 7, Issue 5.

[29]

Sommerville, Ian; Sawyer, Pete. Requirements Engineering A Good Practice Guide. John Wiley and Sons, West Sussex, England: 1997.

Digital Library

[30]

Stewart, I.; Mckee, W. 2003. The Application of Voice Recognition Technology to the Development and Presentation of Complex Engineering Terminology to Hearing Impaired Students. The Institution of Electrical Engineers. lEE, Savoy Place, London WC2R OSL, UK.

[31]

Stinson, Michael S.; Elliot, Lisa B.; Kelly, Ronald R.; Liu, Yufang. 2008. Deaf and Hard-of-Hearing Students' Memory of Lectures with Speech-to-Text and Interpreting/Note Taking Services. J Spec Educ 2009 43: 52.

[32]

Tambascia, Claudia de A.; Rocha, Ronaldo; Runstein, Fernando O.; Costa, Henrique M. 2011. Solução para comunicação e interação com deficientes auditivos em sala de aula. II Encontro Nacional de Informática e Educação (ENINED), ISSN: 2175-5876.

[33]

Van Gelder, Joris; Van Peer, Irene; Aliakseyeu, Dzmitry. 2005. Transcription Table: Text Support During Meetings. M. F. Costabile and F. Paternò (Eds.): INTERACT 2005, LNCS 3585, pp. 1002--1005.

Digital Library

[34]

Wald, M. 2004. Using Automatic Speech Recognition to Enhance Education for All Students: Turning a Vision into Reality. 34th ASEE/IEEE Frontiers in Education Conference, S3G, October 20-23, 2004, Savannah, GA.

[35]

Wald, M. 2006. Captioning for Deaf and Hard of Hearing People by Editing Automatic Speech Recognition in Real Time. K. Miesenberger et al. (Eds.): ICCHP, LNCS 4061.

Digital Library

[36]

Wald, M. 2008. Captioning Multiple Speakers Using Speech Recognition to Assist Disabled People. K. Miesenberger et al. (Eds.): ICCHP 2008, LNCS 5105, pp. 617--623.

Digital Library

[37]

Wald, M. 2009. Developing Assistive Technology to Enhance Learning for all Students. Assistive Tech. from Adapted Equipment to Inclusive Environments, IOS press.

[38]

Wald, M. 2012. Important New Enhancements to Inclusive Learning Using Recorded Lectures. K. Miesenberger et al. (Eds.): ICCHP 2012, Part I, LNCS 7382, pp. 108--115.

Digital Library

[39]

Wald, M; Bain, K. 2007. Enhancing the Usability of Real-Time Speech Recognition Captioning Through Personalised Displays and Real-Time Multiple Speaker Editing and Annotation. C. Stephanidis (Ed.): Universal Access in HCI, Part III, HCII 2007, LNCS 4556.

Digital Library

[40]

Wald, M.; Bain, K. 2008. Universal access to communication and learning: the role of automatic speech recognition. Univ Access Inf Soc, 6:435--447.

Digital Library

[41]

Wald, M.; Yunjia Li. 2012. Synote: Important Enhancements to Learning with Recorded Lectures. 12th IEEE International Conference on Advanced Learning Technologies.

Digital Library

[42]

Way, T., Kheir, R., And Bevilacqua, L. 2008. Achieving Acceptable Accuracy in a Low-Cost, Assistive Note-Taking, Speech Transcription System. In: Proceedings of Telehealth and Assistive Technologies. Baltimore: Acta Press.

Digital Library

[43]

Wu Xiao Fen; Xu Jia Cheng. 2010. Using Speech Recognition Technology to Support Education for Deaf Students. The 2nd IEEE International Conference on Information Management and Engineering (ICIME).

[44]

Wulan; Cheng, Xu Jia; Qu, Xueli. 2009. The New Exploration of Hearing Impaired Written Language Instructional with Speech Recognition Technology. International Conference on Information and Multimedia Technology.

Digital Library

[45]

Ye, Li; Cheng, Xu Jia. 2009. Using Speech Recognition Technology to Come True Liberated Learning for Deaf Students. 4th Intern. Conf. on Computer Science & Education.

[46]

Zhili, L.; Wanjie, T.; Cheng, Xu Jia. 2010. A Study and Application of Speech Recognition Technology in Primary and Secondary School for Deaf/Hard of Hearing Students. 4th International Convention on Rehabilitation Engineering & Assistive Technology.

Digital Library

Cited By

Imashev AOralbayeva NSandygulova A(2024)An exploratory user study towards developing a unified, comprehensive assessment apparatus for deaf signers, specifically tailored for signing avatars evaluation: challenges, findings, and recommendationsMultimedia Tools and Applications10.1007/s11042-024-20365-xOnline publication date: 29-Oct-2024
https://doi.org/10.1007/s11042-024-20365-x
Sánchez JFlores-Rivera JPrietch S(2023)Designing a sign language training platform for hearing healthcare personnelProceedings of the XI Latin American Conference on Human Computer Interaction10.1145/3630970.3631057(1-9)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3630970.3631057
Berke LSeita MHuenerfauth MDuarte CDrake THwang FLewis C(2020)Deaf and hard-of-hearing users' prioritization of genres of online video content requiring accurate captionsProceedings of the 17th International Web for All Conference10.1145/3371300.3383337(1-12)Online publication date: 20-Apr-2020
https://dl.acm.org/doi/10.1145/3371300.3383337
Show More Cited By

Index Terms

Application Requirements for Deaf Students to use in Inclusive Classrooms

Recommendations

Exploration of Automatic Speech Recognition for Deaf and Hard of Hearing Students in Higher Education Classes
ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

Automatic speech recognition (ASR) programs that generate real-time speech-to-text captions can be provided as supplemental access technologies for deaf and hard of hearing (DHH) students in higher education classes. As part of a pilot program, we ...
User Experiences When Testing a Messaging App for Communication Between Individuals who are Hearing and Deaf or Hard of Hearing
ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

This study investigated user experiences of participants testing a prototype messaging app with automatic speech recognition (ASR). Twelve pairs of participants, where one individual was deaf or hard-of-hearing (DHH), and the other one was hearing used ...
A mean for communication between deaf and hearing pairs in inclusive educational settings: the Sessai app
W4A '15: Proceedings of the 12th International Web for All Conference

In this paper, we describe an Android application, called Sessai, which was designed to serve as an alternative for communication between deaf and hearing pairs, specially, in inclusive educational settings. A brief description of potential users of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CLIHC '15: Proceedings of the Latin American Conference on Human Computer Interaction

November 2015

135 pages

ISBN:9781450339605

DOI:10.1145/2824893

General Chair:
J. Alfredo Sánchez
Universidad de las Américas Puebla (México)
,
Program Chairs:
Luis-Felipe Rodríguez
ITSON (México)
,
Renata Fortes
University of Sao Paulo (Brazil)

Copyright © 2015 ACM.

© 2015 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CLIHC '15

CLIHC '15: Latin American Conference on Human Computer Interaction

November 18 - 21, 2015

Córdoba, Argentina

Acceptance Rates

CLIHC '15 Paper Acceptance Rate 14 of 42 submissions, 33%;

Overall Acceptance Rate 14 of 42 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
280
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Imashev AOralbayeva NSandygulova A(2024)An exploratory user study towards developing a unified, comprehensive assessment apparatus for deaf signers, specifically tailored for signing avatars evaluation: challenges, findings, and recommendationsMultimedia Tools and Applications10.1007/s11042-024-20365-xOnline publication date: 29-Oct-2024
https://doi.org/10.1007/s11042-024-20365-x
Sánchez JFlores-Rivera JPrietch S(2023)Designing a sign language training platform for hearing healthcare personnelProceedings of the XI Latin American Conference on Human Computer Interaction10.1145/3630970.3631057(1-9)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3630970.3631057
Berke LSeita MHuenerfauth MDuarte CDrake THwang FLewis C(2020)Deaf and hard-of-hearing users' prioritization of genres of online video content requiring accurate captionsProceedings of the 17th International Web for All Conference10.1145/3371300.3383337(1-12)Online publication date: 20-Apr-2020
https://dl.acm.org/doi/10.1145/3371300.3383337
Al-khazraji SBerke LKafle SYeung PHuenerfauth MHwang FMcGrenere JFlatla D(2018)Modeling the Speed and Timing of American Sign Language to Generate Realistic AnimationsProceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3234695.3236356(259-270)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.1145/3234695.3236356
Berke LKafle SHuenerfauth MMandryk RHancock MPerry MCox A(2018)Methods for Evaluation of Imperfect Captioning Tools by Deaf or Hard-of-Hearing Users at Different Reading Literacy LevelsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173665(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173665

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten