poster

Embodied conversational agents for voice-biometric interfaces

Authors:

Álvaro Hernández-Trapote,

Beatriz López-Mencía,

Rubén Fernández-Pozo,

Javier CamineroAuthors Info & Claims

ICMI '08: Proceedings of the 10th international conference on Multimodal interfaces

Pages 305 - 312

https://doi.org/10.1145/1452392.1452454

Published: 20 October 2008 Publication History

Abstract

In this article we present a research scheme which aims to analyze the use of Embodied Conversational Agent (ECA) technology to improve the robustness and acceptability of speaker enrolment and verification dialogues designed to provide secure access through natural and intuitive speaker recognition. In order to find out the possible effects of the visual information channel provided by the ECA, tests were carried out in which users were divided into two groups, each interacting with a different interface (metaphor): an ECA Metaphor group -with an ECA-, and a VOICE Metaphor group -without an ECA-. Our evaluation methodology is based on the ITU-T P.851 recommendation for spoken dialogue system evaluation, which we have complemented to cover particular aspects with regard to the two major extra elements we have incorporated: secure access and an ECA. Our results suggest that likeability-type factors and system capabilities are perceived more positively by the ECA metaphor users than by the VOICE metaphor users. However, the ECA's presence seems to intensify users' privacy concerns.

References

[1]

Sasse, M.A. 2004. Usability and trust in information systems. Cyber Trust & Crime Prevention Project. University College London.

[2]

Zimmermann, P.R. 1995. The official PGP User's Guide, Cambridge MA: MIT press.

Digital Library

[3]

Biovision,. Roadmap for Biometric in Europe to 2010. Available at: http://ftp.cwi.nl/CWIreports/PNA/PNA-E0303.pdf (Accessed: 2008, August 13)

[4]

Dialogues Spotlight Research Team, 2000. Dialogues for Speaker Verification/Operator Hand-Over: Apology Strategies, Security Dat, Insult Rate and Completion Procedures. University of Edinbutgh. Available at: http://spotlight.ccir.ed.ac.uk/public_documents/technology_reports/No.5%20Verification.pdf (Accesed: 2008, August 13)

[5]

Poggi, I., Pelachaud, C. and Caldognetto, E.M. 2003. Gestural Mind Markers in ECAs, Gesture Workshop 2003, pp 338--349.

[6]

Leßmann, N., Kranstedt, A. and Wachsmuth, I. 2004. Towards a cognitively motivated processing of turn-taking signals for the embodied conversational agent Max, Proceedings Workshop W12, AAMAS 2004, New York, 57 -- 65.

[7]

Hernández A., López B., Díaz D., Fernández R., Hernández L., and Caminero J. 2007. A person in the interface: effects on user perceptions of multibiometrics, Workshop on Embodied Language Processing, in the 45th Annual Meeting of the Association for Computational Linguistics, ACL, pp. 33--40, Prague.

Digital Library

[8]

López B., Hernández A., Díaz D., Fernández R. Hernández L. and Torre D. 2007. Design and validation of ECA gestures to improve dialogue system robustness. Workshop on Embodied Language Processing, in the 45th Annual Meeting of the Association for Computational Linguistics, ACL, pp. 33--40, Prague.

Digital Library

[9]

Whitten A. and Tygar D. 1999. Why Johnny can't encrypt: a usability evaluation of PGP 5.0. Proceedings of the 8th USENIX Security Symposium, Washington DC.

Digital Library

[10]

Bickmore, T., Cassell, J., Van Kuppevelt, J., Dybkjaer, L. and Bernsen, N. 2004. Chapter Social Dialogue with Embodied Conversational Agents, (eds.), Natural, Intelligent and Effective Interaction with Multimodal Dialogue Systems. Kluwer Academic.

[11]

White, M., Foster, M.E., Oberlander, J. and Brown, A. 2005. Using facial feedback to enhance turn-taking in a multimodal dialogue system, Proceedings of HCI International 2005, Las Vegas.

[12]

Bulyko, I., Kirchhoff, K., Ostendorf, M. and Goldberg, J. 2005. Error correction detection and response generation in a spoken dialogue system, Speech Communication 45, pp 271--288.

[13]

Pelachaud C. 2003. Overview of representation languages for ECAs. Tech. rep., Paris VIII, IUT Montreuil.

[14]

Cassell J., Nakano Y.I., Bickmore T.W., Sidner C.L., and Rich C. 2001. Non-verbal cues for discourse structure, in Proceedings of the 39th Annual Meeting on Association For Computational Linguistics.

Digital Library

[15]

Möller S., Smeele P., Boland H., and Krebber J. 2007. Evaluating spoken dialogue systems according to de-facto standards: A case study, Computer Speech & Language 21 26--53.

[16]

Walker, M. A., Litman, D. J., Kamm, C. A. and Abella, A., 1997. PARADISE: A Framework for Evaluating Spoken Dialogue Agents. In: Proc. of the 35th Annual Meeting of the Assoc. for Computational Linguistics (ACL/EACL 97), Morgan Kaufmann, USA--San Francisco, 271--280.

Digital Library

[17]

ITU-T P.851. 1999. Subjective Quality Evaluation of Telephone Services Based on Spoken Dialogue Systems, International Telecommunication Union (ITU), Geneva.

[18]

Möller, S. 2005.Parameters for quantifying the interaction with spoken dialogue telephone services", In SIGdial6-2005, 166--177.

[19]

Jokinen K. and Hurtig T. 2006. User Expectations and Real Experience on a Multimodal Interactive System, In INTERSPEECH-2006, paper 1815-Tue2A3O.2.

[20]

Haptek, http://www.haptek.com (Accesed: 2008, August 13)

[21]

Nuance Communications, Speech Recognition Technology, http://www.nuance.com (Accesed: 2008, August 13)

Cited By

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
Zargham NAlexandrovsky DMildner TPorzel RMalaka R(2023)"Let's Face It": Investigating User Preferences for Virtual Humanoid Home AssistantsProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623821(246-256)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623821
Zargham NAvanesi VReicherts LScott ARogers YMalaka R(2023)“Funny How?” A Serious Look at Humor in Conversational AgentsProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3603761(1-7)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3603761
Show More Cited By

Index Terms

Embodied conversational agents for voice-biometric interfaces
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Integrating embodied conversational agent components with a generic framework
Innovations in intelligent agent technology

Embodied Conversational Agents (ECAs) are computer generated life-like characters that interact with human users in face-to-face conversations. To achieve natural multi-modal conversations, ECA systems are sophisticated and require numbers of building ...
Embodied conversational agents: computing and rendering realistic gaze patterns
PCM'06: Proceedings of the 7th Pacific Rim conference on Advances in Multimedia Information Processing

We describe here our efforts for modeling multimodal signals exchanged by interlocutors when interacting face-to-face. This data is then used to control embodied conversational agents able to engage into a realistic face-to-face interaction with human ...
Evaluation of multimodal behaviour of embodied agents
From brows to trust

Individuality of Embodied Conversational Agents (ECAs) may depend on both the look of the agent and the way it combines different modalities such as speech and gesture. In this chapter, we describe a study in which male and female users had to listen to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '08: Proceedings of the 10th international conference on Multimodal interfaces

October 2008

322 pages

ISBN:9781605581989

DOI:10.1145/1452392

General Chairs:
Vassilis Digalakis
TU Crete, Greece
,
Alex Potamianos
TU Crete, Greece
,
Matthew Turk
UC Santa Barbara, USA
,
Program Chairs:
Roberto Pieraccini
SpeechCycle, USA
,
Yuri Ivanov
MERL Research, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

ICMI '08

Sponsor:

ICMI '08: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES

October 20 - 22, 2008

Crete, Chania, Greece

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
294
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
Zargham NAlexandrovsky DMildner TPorzel RMalaka R(2023)"Let's Face It": Investigating User Preferences for Virtual Humanoid Home AssistantsProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623821(246-256)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623821
Zargham NAvanesi VReicherts LScott ARogers YMalaka R(2023)“Funny How?” A Serious Look at Humor in Conversational AgentsProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3603761(1-7)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3603761
Bonfert MZargham NSaade FPorzel RMalaka R(2021)An Evaluation of Visual Embodiment for Voice Assistants on Smart DisplaysProceedings of the 3rd Conference on Conversational User Interfaces10.1145/3469595.3469611(1-11)Online publication date: 27-Jul-2021
https://dl.acm.org/doi/10.1145/3469595.3469611

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten