Non-speech sound and paralinguistic parameters in mobile speech applications

ABSTRACT

This paper describes the background, research questions and methodology of user studies on the integration of non-speech sound and paralinguistic parameters in speech-enabled applications. Preliminary results are summarized and future directions are discussed.

REFERENCES

• 1: Chieko Asakawa , Hironobu Takagi , Shuichi Ino , Tohru Ifukube, Auditory and tactile interfaces for representing the visual effects on the web, Proceedings of the fifth international ACM conference on Assistive technologies, July 08-10, 2002, Edinburgh, Scotland [doi>10.1145/638249.638263]
• 2: Stephen Brewster, Nonspeech auditory output, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002
• 3: Fröhlich P. and Hammer F., Expressive Text-to-Speech: A user-centred approach to sound design in voice-enabled mobile applications. Proc. Second Symposium on Sound Design (2004).
• 4: Härmä, A., Jakka J., Tikander M., Karjalainen M., Lokki T., Nironen H., and Vesa S. Techniques and applications of wearable augmented reality audio. Proc. AES 114 th convention (2003).
• 5: Frankie James, AHA: audio HTML access, Selected papers from the sixth international conference on World Wide Web, p.1395-1404, September 1997, Santa Clara, California, United States
• 6: Larson, J. The voice XML Guide, Lesson 12: Resource Management. http://www.larson-tech.com/U12/12.html
• 7: Elizabeth Diane Mynatt, Transforming graphical interfaces into auditory interfaces, Georgia Institute of Technology, Atlanta, GA, 1996
• 8: Clifford Nass , Kwan Min Lee, Does computer-generated speech manifest personality? an experimental test of similarity-attraction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.329-336, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332452]
• 9: Jakob Nielsen , Marie Tahir, Homepage Usability: 50 Websites Deconstructed, New Riders Publishing, Thousand Oaks, CA, 2001
• 10: VoiceAward 2004, http://www.voiceaward.de/
• 11: Von Niman, B. Mobile Communication: Simplifying the Complexity, Business Briefings: Wireless Technology (2004). www.bbriefings.com
• 12: W3C Multimodal Interaction Group (MMI). http://www.w3c.org/2002/mmi/
• 13: Wegscheider F., Simon R., Tolar K. Position Paper for the W3C Workshop on Metadata for Content Adaptation. W3C Workshop on Metadata for Content Adaptation, October 12/13, 2004, Dublin, Ireland

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications

Keywords:
auditory I/O and sound in the UI, multimodal mobile communication, speech I/O, user studies