Article

Tutor design for speech-based interfaces

Authors:

Jaakko Hakulinen,

Markku Turunen,

Esa-Pekka Salonen,

Kari-Jouko RäihäAuthors Info & Claims

DIS '04: Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques

Pages 155 - 164

https://doi.org/10.1145/1013115.1013137

Published: 01 August 2004 Publication History

Get Access

Abstract

Speech-based applications commonly come with web-based or printed manuals. Alternatively, the dialogue can be designed so that users should be able to start using the application on their own. We studied an alternative approach, an integrated tutor. The tutor participates in the interaction when new users learn to use a speech-based system. It teaches the users how to operate the system and monitors user actions to be certain that the users do indeed learn. In this paper we describe our experiences with the design and the iterative development of an integrated tutor. Expert evaluation and two user tests were conducted with different versions of the tutor. The results show that the tutor can effectively guide new users. We identify the six most important lessons learned, the most important being that it is essential to spot problems by monitoring user actions, especially when novice users are tutored.

References

[1]

Ames, A. L. Just what they need, just when they need it: an introduction to embedded assistance. In Proceedings of the 19th Annual International Conference on Computer Documentation. ACM Press, New York, NY, 2001, 111--115.

Digital Library

Google Scholar

[2]

Carroll, J. M. and Rosson, M. B. Paradox of the Active User. In Carroll John, M. (Ed.), Interfacing Thought: Cognitive Aspects of Human-Computer Interaction. Cambridge, MIT Press, MA, 1987.

Digital Library

Google Scholar

[3]

Contreras, J., Saiz, F. A Framework for the Automatic Generation of Software tutoring. In Proceedings of Computer-Aided Design of User Interfaces, 1996.

Google Scholar

[4]

Esteban J. AppleGuide. Interactions, 3, 3 (May 1996), 36--37.

Digital Library

Google Scholar

[5]

Garcia, F. CACTUS: Automated Tutorial Course Generation for Software Applications. In Intelligent User Interfaces 2000 (IUI'2000). ACM Press, New York, 2000, 113--120.

Digital Library

Google Scholar

[6]

Hakulinen, J., Turunen, M. and Salonen, E-P. Agents for Integrated Tutoring in Spoken Dialogue Systems. In Proceedings of Eurospeech 2003. 757--760.

Google Scholar

[7]

Kamm, C., Litman, D. and Walker, M.A. From Novice to Expert: The Effect of Tutorials on User Expertise with Spoken Dialogue Systems. In Proceedings of the International Conference on Spoken Language Processing,(ICSLP98). ASSTA, 1998, 1211--1214.

Google Scholar

[8]

Mackay, W. E. Does Tutoring Really Have to be Intelligent? In CHI2001 Extended Abstracts, 2001.

Digital Library

Google Scholar

[9]

Nakatami, L.H., Egan, D.E., Ruedisueli, L.W., Hawley, P.M. and Lewart, D.K. TNT: A Talking Tutor 'N' Trainer for Teaching the Use of Interactive Computer Systems, In Proceedings of CHI'86, 1986, 29--34.

Digital Library

Google Scholar

[10]

Suhm, B. Towards Best Practices for Speech User Interface Design. In Proceedings of EuroSpeech 2003. 2217--2220.

Google Scholar

[11]

Turunen, M. and Hakulinen, J. Jaspis - A Framework for Multilingual Adaptive Speech Applications. In Proceedings of the 6th International Conference of Spoken Language Processing (ICSLP'2000), 2000.

Google Scholar

[12]

Turunen, M. and Hakulinen, J. Mailman - a Multilingual Speech-only E-mail Client based on an Adaptive Speech Application Framework. In Proceedings of Workshop on Multi-Lingual Speech Communication (MSC 2000). 7--12.

Google Scholar

[13]

VanLehn, K., Siler, S., Murray, C. and Baggett, W. What makes a tutorial event effective? In Proceedings of the Twenty-first Annual Conference of the Cognitive Science Society. Hillsdale, NJ: Erlbaum. 1998, 1084--1089.

Google Scholar

[14]

Yankelovich, N. How Do Users Know What to Say?" Interactions, 3, 6 (December 1996), 32--43.

Digital Library

Google Scholar

Cited By

View all

Ringfort-Felner RLaschke MNeuhaus RTheofanou-Fülbier DHassenzahl M(2022)It Can Be More Than Just a Subservient Assistant. Distinct Roles for the Design of Intelligent Personal AssistantsNordic Human-Computer Interaction Conference10.1145/3546155.3546699(1-17)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3546155.3546699
Clark LDoyle PGaraialde DGilmartin ESchlögl SEdlund JAylett MCabral JMunteanu CEdwards JR Cowan B(2019)The State of Speech in HCI: Trends, Themes and ChallengesInteracting with Computers10.1093/iwc/iwz01631:4(349-371)Online publication date: 11-Sep-2019
https://doi.org/10.1093/iwc/iwz016
Jumail JRambli DSulaiman S(2011)Investigating the roles of assistance in a digital storytelling authoring systemProceedings of the Second international conference on Visual informatics: sustaining research and innovations - Volume Part II10.5555/2074670.2074692(205-216)Online publication date: 9-Nov-2011
https://dl.acm.org/doi/10.5555/2074670.2074692
Show More Cited By

Recommendations

Multimodal error correction for speech user interfaces

Although commercial dictation systems and speech-enabled telephone voice user interfaces have become readily available, speech recognition errors remain a serious problem in the design and implementation of speech user interfaces. Previous work ...
Towards Modelling Elaborateness in Argumentative Dialogue Systems
Artificial Intelligence in HCI
Abstract
To provide an engaging and natural interaction with an argumentative dialogue system, we introduce a model to adapt the system utterances to the user’s communication style in an ongoing discussion. Therefore, we propose an “Elaborateness Score” (...
A Semi-automatic Wizard of Oz Technique for Let'sFly Spoken Dialogue System
TSD '08: Proceedings of the 11th international conference on Text, Speech and Dialogue

The paper presents Let'sFly spoken dialogue system intended for natural human-computer interaction via telephone lines in travel planning domain. The system uses ASR, keyword spotting and TTS methods for continuous Russian speech and a dialogue manager ...

Comments

Information & Contributors

Information

Published In

DIS '04: Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques

August 2004

390 pages

ISBN:1581137877

DOI:10.1145/1013115

Conference Chairs:
David Benyon
Napier University
,
Paul Moody
IBM
,
Program Chairs:
Daniel Gruen
IBM
,
Irene McAra-McWilliam
Royal College of Art

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

DIS04

Sponsor:

SIGCHI

DIS04: Designing Interactive Systems 2004

August 1 - 4, 2004

MA, Cambridge, USA

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Upcoming Conference

DIS '25

Sponsor:
sigchi

Designing Interactive Systems Conference

July 5 - 9, 2025

Funchal , Portugal

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
623
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ringfort-Felner RLaschke MNeuhaus RTheofanou-Fülbier DHassenzahl M(2022)It Can Be More Than Just a Subservient Assistant. Distinct Roles for the Design of Intelligent Personal AssistantsNordic Human-Computer Interaction Conference10.1145/3546155.3546699(1-17)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3546155.3546699
Clark LDoyle PGaraialde DGilmartin ESchlögl SEdlund JAylett MCabral JMunteanu CEdwards JR Cowan B(2019)The State of Speech in HCI: Trends, Themes and ChallengesInteracting with Computers10.1093/iwc/iwz01631:4(349-371)Online publication date: 11-Sep-2019
https://doi.org/10.1093/iwc/iwz016
Jumail JRambli DSulaiman S(2011)Investigating the roles of assistance in a digital storytelling authoring systemProceedings of the Second international conference on Visual informatics: sustaining research and innovations - Volume Part II10.5555/2074670.2074692(205-216)Online publication date: 9-Nov-2011
https://dl.acm.org/doi/10.5555/2074670.2074692
Jumail Rambli DSulaiman S(2011)Investigating the Roles of Assistance in a Digital Storytelling Authoring SystemVisual Informatics: Sustaining Research and Innovations10.1007/978-3-642-25200-6_20(205-216)Online publication date: 2011
https://doi.org/10.1007/978-3-642-25200-6_20
Samoylov AFranklin CRegli STremoulet PStibler KGerken P(2009)Tactical Access to Complex Technology through Interactive Communication (TACTIC)Proceedings of the Symposium on Human Interface 2009 on ConferenceUniversal Access in Human-Computer Interaction. Part I: Held as Part of HCI International 200910.1007/978-3-642-02556-3_18(154-162)Online publication date: 14-Jul-2009
https://dl.acm.org/doi/10.1007/978-3-642-02556-3_18
Lee KGrice R(2006)The Design and Development of User Interfaces for Voice Application in Mobile Devices2006 IEEE International Professional Communication Conference10.1109/IPCC.2006.320364(308-320)Online publication date: Oct-2006
https://doi.org/10.1109/IPCC.2006.320364
Hakulinen JTurunen MRäihä K(2006)Evaluation of Software Tutoring for a Speech InterfaceInternational Journal of Speech Technology10.1007/s10772-006-7216-18:3(283-293)Online publication date: 2-Jun-2006
https://doi.org/10.1007/s10772-006-7216-1
Espinosa EMolina MPacheco ECervantes MRubio E(2005)Training Entrepeneurs During Corporate AssessmenProceedings of the Sixth Mexican International Conference on Computer Science10.1109/ENC.2005.51(222-229)Online publication date: 26-Sep-2005
https://dl.acm.org/doi/10.1109/ENC.2005.51
Hakulinen JTurunen MSalonen E(2005)Software tutors for dialogue systemsProceedings of the 8th international conference on Text, Speech and Dialogue10.1007/11551874_53(412-419)Online publication date: 12-Sep-2005
https://dl.acm.org/doi/10.1007/11551874_53

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Recommendations

Multimodal error correction for speech user interfaces

Towards Modelling Elaborateness in Argumentative Dialogue Systems

A Semi-automatic Wizard of Oz Technique for Let'sFly Spoken Dialogue System

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations