research-article

Spindex (Speech Index) Improves Auditory Menu Acceptance and Navigation Performance

Authors:

Myounghoon Jeon,

Bruce N. WalkerAuthors Info & Claims

ACM Transactions on Accessible Computing (TACCESS), Volume 3, Issue 3

Article No.: 10, Pages 1 - 26

https://doi.org/10.1145/1952383.1952385

Published: 01 April 2011 Publication History

Abstract

Users interact with mobile devices through menus, which can include many items. Auditory menus have the potential to make those devices more accessible to a wide range of users. However, auditory menus are a relatively new concept, and there are few guidelines that describe how to design them. In this paper, we detail how visual menu concepts may be applied to auditory menus in order to help develop design guidelines. Specifically, we examine how to optimize the designs of a new contextual cue, called “spindex” (i.e., speech index). We developed and evaluated various design alternatives for spindex and iteratively refined the design with sighted users and visually impaired users. As a result, the “attenuated” spindex was the best in terms of preference as well as performance, across user groups. Nevertheless, sighted and visually impaired participants showed slightly different responses and feedback. Results are discussed in terms of acoustical theory, practical display design, and assistive technology design.

References

[1]

Absar, R. and Guastavino, C. 2008. Usability of non-speech sounds in user interfaces. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;08).

[2]

Andre, A. D. and Wickens, C. D. 1995. When users want what&#8217;s not best for them. Ergonom. Design 3, 4, 10--14.

[3]

Asakawa, C. and Itoh, T. 1998. User interface of a home page reader. In Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS&#8217;98). 149--156.

Digital Library

[4]

Asakawa, C., Takagi, H., Ino, S., and Ifukube, T. 2003. Maximum listening speeds for the blind. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;03).

[5]

Beck, D. And Elkerton, J. 1989. Development and evaluation of direct manipulation list. SIGCHI Bull. 20, 3, 72--78.

Digital Library

[6]

Blattner, M. M., Sumikawa, D. A., and Greenberg, R. M. 1989. Earcons and icons: Their structure and common design principles. Hum.-Comput. Interact., 4, 11--44.

Digital Library

[7]

Brewster, S. A. 1997. Using non-speech sound to overcome information overload. Displays, 17, 179--189.

[8]

Brewster, S. A. 1998. The design of sonically-enhanced widgets. Interact. Comput. 11, 2, 211--235.

[9]

Brewster, S. A. 2008. Nonspeech auditory output. In The Human Computer Interaction Handbook, A. Sears and J. Jacko, Eds., Lawrence Erlbaum Associates, New York, 247--264.

[10]

Brewster, S. A. and Cryer, P. G. 1999. Maximising screen-space on mobile computing devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI&#8217;99). 224--225.

Digital Library

[11]

Brewster, S. A., Wright, P. C., and Edwards, A. D. N. 1992. A detailed investigation into the effectiveness of earcons. In Proceedings of the 1st International Conference on Auditory Display (ICAD&#8217;94). 471--478.

[12]

Brewster, S. A., Raty, V. P., and Kortekangas, A. 1996. Earcons as a method of providing navigational cues in a menu hierarchy. In Proceedings of the HCI&#8217;96. Springer, 167--183.

Digital Library

[13]

Brewster, S. A., Lepl&#226;tre, G., and Crease, M. G. 1998. Using non-speech sounds in mobile computing devices. In Proceedings of the 1st Workshop on Human Computer Interaction with Mobile Devices.

[14]

Brewster, S. A., Lumsden, J., Bell, M., Hall, M., and Tasker, S. 2003. Multimodal &#8216;eyes-free&#8217; interaction techniques for wearable devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI&#8217;03). 473--480.

Digital Library

[15]

Burns, C. M. 2005. Choosing the best from the good: Display engineering principles. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (HFES&#8217;05). 1556--1560.

[16]

Cook, A. M. and Hussey, S. M. 2002. Assistive Technologies: Principles and Practice. Mosby, Inc.

[17]

Davison, B. D. and Walker, B. N. 2008. AudioPlusWidgets: Bringing sound to software widgets and interface components. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;08).

[18]

Dingler, T., Lindsay, J., and Walker, B. N. 2008. Learnability of sound cues for environmental features: Auditory icons, earcons, spearcons, and speech. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;08).

[19]

Edworthy, J. 1998. Does sound help us to work better with machines? A commentary on Rauterberg&#8217;s paper &#8216;About the importance of auditory alarms during the operation of a plant simulator&#8217;. Interact. Comput. 10, 401--409.

[20]

Edworthy, J., Loxley, S., and Dennis, I. 1991. Improving auditory warning design: Relationship between warning sound parameters and perceived urgency. Hum. Factors 32, 2, 205--231.

[21]

Ellis, S. R. 2005. On redundancy in the design of spatial instruments. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (HFES&#8217;05). 1561--1563.

[22]

Gaver, W. W. 1986. Auditory icons: Using sound in computer interfaces. Hum.-Comput. Interact. 2, 167--177.

Digital Library

[23]

Gaver, W. W. 1989. The SonicFinder, a prototype interface that uses auditory icons. Hum.-Comput. Interact. 4, 67--94.

Digital Library

[24]

Glinert, E. P. and York, B. W. 2008. Computers and people with disabilities. ACM Trans. Access. Comput. 1, 2, 1--7.

Digital Library

[25]

Goose, S. and Moller, C. 1999. A 3D audio only interactive web browser: Using spatialization to convey hypermedia document structure. In Proceedings of the 7th ACM International Conference on Multimedia (Part 1) (MULTIMEDIA&#8217;99). 363--371.

Digital Library

[26]

Helle, S., Lepl&#226;tre, G., Marila, J., and Laine, P. 2001. Menu sonification in a mobile phone: A prototype study. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;01).

[27]

Hutchins, E. L., Hollan, J. D., and Norman, D. A. 1986. Direct Manipulation Interfaces. Lawrence Erlbaum Associates Inc.

[28]

James, F. 1998. Lessons from developing audio HTML interfaces. In Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS&#8217;98). 27--34.

Digital Library

[29]

Jeon, M. and Walker, B. N. 2009. &#8220;Spindex&#8221;: Accelerated initial speech sounds improve navigation performance in auditory menus. In Proceedings of the Annual Meeting of the Human Factors and Ergonomics Society (HFES09). 1081--1085.

[30]

Jeon, M., Davison, B., Wilson, J., Raman, P., and Walker, B. N. 2010. Advanced auditory menus for universal access to electronic devices. In Proceedings of the 25th Annual International Technology and Persons with Disabilities Conference (CSUN&#8217;10).

[31]

Kehoe, A. and Pitt, I. 2006. Designing help topics for use with Text-To-Speech. In Proceedings of the 24th Annual ACM International Conference on Design of Communication (SIGDOC&#8217;06). 157--163.

Digital Library

[32]

Klante, P. 2004. Auditory interaction objects for mobile applications. In Proceedings of the 7th International Conference on Work with Computing Systems (WWCS&#8217;04).

[33]

Kramer, G. 1994. An introduction to auditory display. In Auditory Display: Sonification, Audification, and Auditory Interfaces, G. Kramer Ed., Addison-Wesley, 1--77.

[34]

Lepl&#226;tre, G. and Brewster, S. A. 2000. Designing non-speech sounds to support navigation in mobile phone menus. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;00). 190--199.

[35]

Lepl&#226;tre, G. and McGregor, I. 2004. How to tackle auditory interface aesthetics? Discussion and case study. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;04).

[36]

Marila, J. 2002. Experimental comparison of complex and simple sounds in menu and hierarchy sonification. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;00).

[37]

Moos, A. and Trouvain, J. 2007. Comprehension of ultra-fast speech - blind vs. &#8216;normally hearing&#8217; persons. In Procceedings of the 16th International Congress of Phonetic Sciences. 677--680.

[38]

Morley, S., Petrie, H., and Mcnally, P. 1998. Auditory navigation in hyperspace: Design and evaluation of a non-visual hypermedia system for blind users. In Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS&#8217;98).

Digital Library

[39]

Mynatt, E. 1997. Transforming graphical interfaces into auditory interfaces for blind users. Hum.-Comput. Interact. 12, 7--45.

Digital Library

[40]

Nees, M. A. and Walker, B. N. 2009. Auditory interfaces and sonification. In The Universal Access Handbook, C. Stephanidis Ed., CRC Press Taylor &amp; Francis, New York, 507--521.

[41]

Newell, A. F. 2008. Accessible computing: Past trends and future suggestions. ACM Trans. Access. Comput. 1, 2, 9:1--7.

Digital Library

[42]

Norman, D. A. 2004. Emotional Design. Basic Books, New York.

Digital Library

[43]

Norman, D. A. 2007. The Design of Future Things. Basic Books, New York.

[44]

Palladino, D. K. and Walker, B. N. 2007. Learning rates for auditory menus enhanced with spearcons versus earcons. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;07). 274--279.

[45]

Palladino, D. K. and Walker, B. N. 2008a. Efficiency of spearcon-enhanced navigation of one dimensional electronic menus. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;08).

[46]

Palladino, D. K. and Walker, B. N. 2008b. Navigation efficiency of two dimensional auditory menus using spearcon enhancements. In Proceedings of the Annual Meeting of the Human Factors and Ergonomics Society (HFES08). 1262--1266.

[47]

Patterson, R. D. 1985. Auditory warning system for high-workload environments. Ergon. Interact. 85, 163--165.

[48]

Patterson, R. D. 1990. Auditory warning sounds in the work environments. Phil. Trans. Roy. Soc. Lond. B, 327, 484--492.

[49]

Pitt, I. J. and Edwards, A. D. N. 1996. Improving the usability of speech-based interfaces for blind users. In Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS&#8217;96). 124--130.

Digital Library

[50]

Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S., and Carey, T. 1996. Human-Computer Interaction. Addison-Wesley, London.

Digital Library

[51]

Sanders, M. S. and McCormick, E. J. 1993. Chapter11: Controls and data entry devices. In Human Factors in Engineering and Design, M. S. Sanders and E. J. McCormick Eds., McGraw-Hill, Inc, New York, 334--382.

[52]

Sheridan, T. B. 2005. Allocating bits to displays for dynamic control: When more is more and when more is less. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (HFES&#8217;05). 1569--1572.

[53]

Smallman, H. S. 2005. Overarching principles of display design. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (HFES&#8217;05). 1554--1557.

[54]

Smallman, H. S. and St. John, M. 2005. Naive realism: Limits of realisms as a display principle. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (HFES&#8217;05). 1564--1568.

[55]

Thatcher, J. 1994. Screen reader/2 access to OS/2 and the graphical user interface. In Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS&#8217;94). 39--46.

Digital Library

[56]

Vargas, M. L. M. and Anderson, S. 2003. Combining speech and earcons to assist menu navigation. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;03).

[57]

Walker, B. N. 2002. Magnitude estimation of conceptual data dimensions for use in sonification. J. Experi. Psych.: Appl. 8, 4, 211--221.

[58]

Walker, B. N. and Kogan, A. 2009. Spearcons enhance performance and preference for auditory menus on a mobile phone. In Universal Access in HCI, Part II: Lecture Notes in Computer Science vol. 5615, C. Stephanidis Ed., Springer-Verlag, Berlin, 445--454.

Digital Library

[59]

Walker, B. N. and Kramer, G. 2004. Ecological psychoacoustics and auditory displays: Hearing, grouping, and meaning making. In Ecological Psychoacoustics, J.G. Neuhoff, Ed., Academic Press, New York, 150--175.

[60]

Walker, B. N., Nance, A., and Lindsay, J. 2006. Spearcons: Speech-based earcons improve navigation performance in auditory menus. In Proceedings of the International Conference on Auditory Display (ICAD&#8217;06). 95--98.

[61]

Wilson, J., Walker, B. N., Lindsay, J., Cambias, C., and Dellaert, F. 2007. SWAN: System for wearable audio navigation. In Proceedings of the 11th International Symposium on Wearable Computers (ISWC&#8217;07).

Digital Library

[62]

Yalla, P. and Walker, B. N. 2008. Advanced auditory menus: Design and evaluation of auditory scrollbars. In Proceedings of the Annual ACM Conference on Assistive Technologies (ASSETS&#8217;08). 105--112.

Digital Library

Cited By

Tabbarah MCao YFang ZLi LJeon M(2024)Sonically-enhanced in-vehicle air gesture interactions: evaluation of different spearcon compression ratesJournal on Multimodal User Interfaces10.1007/s12193-024-00430-3Online publication date: 19-May-2024
https://doi.org/10.1007/s12193-024-00430-3
Das MGergle DPiper A(2023)Simphony: Enhancing Accessible Pattern Design Practices among Blind WeaversProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581047(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581047
Hirsch LLi JMayer SButz A(2022)A Survey of Natural Design for InteractionProceedings of Mensch und Computer 202210.1145/3543758.3543773(240-254)Online publication date: 4-Sep-2022
https://dl.acm.org/doi/10.1145/3543758.3543773
Show More Cited By

Index Terms

Spindex (Speech Index) Improves Auditory Menu Acceptance and Navigation Performance

Recommendations

Advanced auditory menus: design and evaluation of auditory scroll bars
Assets '08: Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility

Auditory menus have the potential to make devices that use visual menus accessible to a wide range of users. Visually impaired users could especially benefit from the auditory feedback received during menu navigation. However, auditory menus are a ...
“Spindex” (Speech Index) Enhances Menus on Touch Screen Devices with Tapping, Wheeling, and Flicking

Users interact with many electronic devices via menus such as auditory or visual menus. Auditory menus can either complement or replace visual menus. We investigated how advanced auditory cues enhance auditory menus on a smartphone, with tapping, ...
Enhanced auditory menu cues improve dual task performance and are preferred with in-vehicle technologies
AutomotiveUI '09: Proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Auditory display research for driving has mainly focused on collision warning signals, and recent studies on auditory in-vehicle information presentation have examined only a limited range of tasks (e.g., cell phone operation tasks or verbal tasks such ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Accessible Computing

ACM Transactions on Accessible Computing Volume 3, Issue 3

April 2011

88 pages

ISSN:1936-7228

EISSN:1936-7236

DOI:10.1145/1952383

Issue’s Table of Contents

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 April 2011

Accepted: 01 December 2010

Revised: 01 December 2010

Received: 01 June 2010

Published in TACCESS Volume 3, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
613
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tabbarah MCao YFang ZLi LJeon M(2024)Sonically-enhanced in-vehicle air gesture interactions: evaluation of different spearcon compression ratesJournal on Multimodal User Interfaces10.1007/s12193-024-00430-3Online publication date: 19-May-2024
https://doi.org/10.1007/s12193-024-00430-3
Das MGergle DPiper A(2023)Simphony: Enhancing Accessible Pattern Design Practices among Blind WeaversProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581047(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581047
Hirsch LLi JMayer SButz A(2022)A Survey of Natural Design for InteractionProceedings of Mensch und Computer 202210.1145/3543758.3543773(240-254)Online publication date: 4-Sep-2022
https://dl.acm.org/doi/10.1145/3543758.3543773
González-Cañete FLópez-Rodríguez JGaldón PDiaz-Estrella A(2021)Improving the Screen Exploration of Smartphones Using Haptic Icons for Visually Impaired UsersSensors10.3390/s2115502421:15(5024)Online publication date: 24-Jul-2021
https://doi.org/10.3390/s21155024
Li JGeorge CNgao AHolländer KMayer SButz A(2021)Rear-Seat Productivity in Virtual Reality: Investigating VR Interaction in the Confined Space of a CarMultimodal Technologies and Interaction10.3390/mti50400155:4(15)Online publication date: 26-Mar-2021
https://doi.org/10.3390/mti5040015
Das MGergle DPiper A(2019)"It doesn't win you friends"Proceedings of the ACM on Human-Computer Interaction10.1145/33592933:CSCW(1-26)Online publication date: 7-Nov-2019
https://dl.acm.org/doi/10.1145/3359293
Gross MDara JMeyer CBolchini D(2018)Exploring Aural Navigation by Screenless AccessProceedings of the 15th International Web for All Conference10.1145/3192714.3192815(1-10)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3192714.3192815
Grussenmeyer WFolmer E(2017)Accessible Touchscreen Technology for People with Visual ImpairmentsACM Transactions on Accessible Computing10.1145/30227019:2(1-31)Online publication date: 17-Jan-2017
https://dl.acm.org/doi/10.1145/3022701
Machado RConforto DSantarosa L(2017)Sound chat: Implementation of sound awareness elements for visually impaired users in web-based cooperative systems2017 International Symposium on Computers in Education (SIIE)10.1109/SIIE.2017.8259677(1-6)Online publication date: Nov-2017
https://doi.org/10.1109/SIIE.2017.8259677
Jeon MHosseini SLandry SSterkenburg JPfleging BKun ALiang YMeschtscherjakov AFröhlich PGreen PPfleging BMeschtscherjakov AFröhlich PLiang YKun ALöcken APradhan ABorojeni S(2016)Tutorial on In-vehicle Auditory InteractionsAdjunct Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3004323.3005685(225-228)Online publication date: 24-Oct-2016
https://dl.acm.org/doi/10.1145/3004323.3005685
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents