demonstration

A browser-based multimodal interaction system

Authors:

Tsuneo NittaAuthors Info & Claims

ICMI '08: Proceedings of the 10th international conference on Multimodal interfaces

Pages 195 - 196

https://doi.org/10.1145/1452392.1452431

Published: 20 October 2008 Publication History

Get Access

Abstract

In this paper, we propose a system that enables users to have multimodal interactions (MMI) with an anthropomorphic agent via a web browser. By using the system, a user can interact simply by accessing a web site from his/her web browser. A notable characteristic of the system is that the anthropomorphic agent is synthesized from a photograph of a real human face. This makes it possible to construct a web site whose owner's facial agent speaks with visitors to the site. This paper describes the structure of the system and provides a screen shot.

References

[1]

N. Reithinger, et al., "SmartKom - Adaptive and Flexible Multimodal Access to Multiple Applications", Proc. of ICMI'03, pp.101--108 (2003).

Digital Library

Google Scholar

[2]

M. Johnston, et al., "MATCH: An architecture for multimodal dialogue systems", Proc. of the Annual Meeting of the Association for Computational Linguistics, pp.376--383 (2002).

Digital Library

Google Scholar

[3]

D. Gibbon, et al. (ed.), "Handbook of Multimodal and Spoken Dialogue Systems", Kluwer Academic Publishers, (2000).

Google Scholar

[4]

T. Kawahara, et al., "Sharable software repository for Japanese large vocabulary continuous speech recognition", Proc. ICSLP'98, pp.3257--3260 (1998).

Google Scholar

[5]

T. Yoshimura, et al., "Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis", Proc. EUROSPEECH'99, pp.2347--2350 (1999).

Google Scholar

[6]

T. Yotsukura, et al., "An open source development tool for anthropomorphic dialog agent - face image synthesis and lip synchronization-", Proc. IEEE Fifth Workshop on Multimedia Signal Processing, 03_01_05.pdf (2002).

Crossref

Google Scholar

[7]

S. Kawamoto, et al., "Galatea: Open-source software for developing anthropomorphic spoken dialog agents", in Life-Like Characters, ed. H. Prendinger and M. Ishizuka, pp.187--212, Springer-Verlag (2004).

Google Scholar

[8]

http://www.astem.or.jp/istc/index_e.html

Google Scholar

[9]

T. Nitta, et al., "Activities of interactive speech technology consortium (ISTC) targeting open software development for MMI systems", Proc. RO-MAN'04, 2B4 (2004).

Google Scholar

[10]

K. Katsurada, et al., "XISL: A language for describing multimodal interaction scenarios", Proc. ICMI'03, pp.281--284, (2003).

Digital Library

Google Scholar

Cited By

View all

Katsurada KNitta TAraki MAshimura K(2016)Six-Layered Model for Multimodal Interaction SystemsMultimodal Interaction with W3C Standards10.1007/978-3-319-42816-1_7(137-153)Online publication date: 18-Nov-2016
https://doi.org/10.1007/978-3-319-42816-1_7
Sharma SAgrawal A(2010)IMTS- an Interactive Multimodal Tourist-Guide System2010 International Conference on Signal and Image Processing10.1109/ICSIP.2010.5697475(233-238)Online publication date: Dec-2010
https://doi.org/10.1109/ICSIP.2010.5697475

Index Terms

A browser-based multimodal interaction system
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Sound-based input / output
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Sound-based input / output

Recommendations

Browser wars: Metaphor, Web browser, Microsoft, Internet Explorer, Netscape, Netscape Navigator, Mozilla Firefox, Google Chrome, Safari (web browser), Opera (web browser), Usage share of web browsers
A Chromium-Based Memento-Aware Web Browser
Linking Theory and Practice of Digital Libraries
Abstract
Current web browsers do not differentiate between the live Web and the past Web. If a user loads an archived webpage, or memento, they have to rely on elements in the page itself to be aware that they are not viewing a live webpage. Another ...
Chromium based Framework to Include Gaze Interaction in Web Browser
WWW '17 Companion: Proceedings of the 26th International Conference on World Wide Web Companion

Enabling Web interaction by non-conventional input sources like eyes has great potential to enhance Web accessibility. In this paper, we present a Chromium based inclusive framework to adapt eye gaze events in Web interfaces. The framework provides more ...

Comments

Information & Contributors

Information

Published In

ICMI '08: Proceedings of the 10th international conference on Multimodal interfaces

October 2008

322 pages

ISBN:9781605581989

DOI:10.1145/1452392

General Chairs:
Vassilis Digalakis
TU Crete, Greece
,
Alex Potamianos
TU Crete, Greece
,
Matthew Turk
UC Santa Barbara, USA
,
Program Chairs:
Roberto Pieraccini
SpeechCycle, USA
,
Yuri Ivanov
MERL Research, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

ICMI '08

Sponsor:

ICMI '08: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES

October 20 - 22, 2008

Crete, Chania, Greece

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
148
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Katsurada KNitta TAraki MAshimura K(2016)Six-Layered Model for Multimodal Interaction SystemsMultimodal Interaction with W3C Standards10.1007/978-3-319-42816-1_7(137-153)Online publication date: 18-Nov-2016
https://doi.org/10.1007/978-3-319-42816-1_7
Sharma SAgrawal A(2010)IMTS- an Interactive Multimodal Tourist-Guide System2010 International Conference on Signal and Image Processing10.1109/ICSIP.2010.5697475(233-238)Online publication date: Dec-2010
https://doi.org/10.1109/ICSIP.2010.5697475

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Browser wars: Metaphor, Web browser, Microsoft, Internet Explorer, Netscape, Netscape Navigator, Mozilla Firefox, Google Chrome, Safari (web browser), Opera (web browser), Usage share of web browsers

A Chromium-Based Memento-Aware Web Browser

Chromium based Framework to Include Gaze Interaction in Web Browser

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations