poster

Speech-driven embodied entrainment character system with hand motion input in mobile environment

Authors:

Kouzi Osaki,

Tomio Watanabe,

Michiya YamamotoAuthors Info & Claims

ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces

Pages 285 - 290

https://doi.org/10.1145/1322192.1322242

Published: 12 November 2007 Publication History

Get Access

Abstract

InterActor is a speech-input-driven CG-embodied interaction character that can generate communicative movements and actions for entrained interactions. InterPuppet, on the other hand, is an embodied interaction character that is driven by both speech input-similar to InterActor-and hand motion input, like a puppet. Therefore, humans can use InterPuppet to effectively communicate by using deliberate body movements and natural communicative movements and actions. In this paper, an advanced InterPuppet system that uses a cellular-phone-type device is developed, which can be used in a mobile environment. The effectiveness of the system is demonstrated by performing a sensory evaluation experiment in an actual remote communication scenario.

References

[1]

Hirotsu, C.: Analysis of Experimental Data, Beyond Analysis of Variance; Kyoritsu Shuppan, Tokyo, pp.203--217 (1992) (in Japanese).

Google Scholar

[2]

Johnson, M., Wilson, A., Kline, C., Blumberg, B. and Bobick, A. Sympathetic Interfaces: Using Plush Toys to Direct Synthetic Characters. Proceedings of CHI99, 152--158, 1999.

Digital Library

Google Scholar

[3]

Koizumi, N., Shimizu, N., Sugimoto, M., Nii, H. and Inami, M. Development of Hand Puppet type Robotic User Interface. Transactions of the Virtual Reality Society of Japan, 11(2):265--274, 2006.

Google Scholar

[4]

Ministry of Public Management, Home Affairs, Posts and Telecommunications. 2006 WHITE PAPER Information and Communications in Japan. Ministry of internal Affairs and Communications, Chapter 1, Section 2, 2006.

Google Scholar

[5]

Osaki, K., Watanabe, T. and Yamamoto, M. Development of a Video Contents Production Support System with the Speech-Driven Embodied Entrainment Character by Speech and Hand Motion Input. Correspondences on Human Interface, 8(2):91--96, 2006.

Google Scholar

[6]

Sato, K. and Lim, Y. Physical Interaction and Multi-Aspect Representation for Information Intensive Environments. Proceedings of 9th IEEE International Workshop on Robot and Human Interactive Communication (RO-MAN2000), 436--443, 2000.

Crossref

Google Scholar

[7]

Watanabe, T. Embodied Communication Technologies and Their Applications. Systems, Control and Information, 49(11): 431--436, 2005.

Google Scholar

[8]

Watanabe, T., Okubo, M., Nakashige, M. and Danbara, R. InterActor: Speech-Driven Embodied Interactive Actor. International Journal of Human-Computer Interaction, 17(1):43--60, 2004.

Crossref

Google Scholar

[9]

Yamamoto, M., Watanabe, T., and Osaki, K. Development of an Embodied Interaction System with InterActor by Speech and Hand Motion Input. Proceedings of 14th IEEE International Workshop on Robot and Human Interactive Communication (RO-MAN2005), 323--328, 2005.

Crossref

Google Scholar

[10]

Yonezawa, T., Suzuki, N., Mase, K., Mogure, K. Handysinger: Expressive Singing Voice Morphing using Personified Hand-Puppet Interface. Proceedings of the 2005 conference on New interfaces for musical expression (NIME 2005), 121--126, 2005.

Digital Library

Google Scholar

Cited By

View all

Yamamoto MShigeno YKawabe RWatanabe TShaer OShen CMorris MHorn M(2012)Development of a context-enhancing surface based on the entrainment of embodied rhythms and actions sharing via interactionProceedings of the 2012 ACM international conference on Interactive tabletops and surfaces10.1145/2396636.2396701(363-366)Online publication date: 11-Nov-2012
https://dl.acm.org/doi/10.1145/2396636.2396701
Yamamoto MOsaki KMatsune SWatanabe T(2010)An embodied entrainment character cell phone by speech and head motion inputs19th International Symposium in Robot and Human Interactive Communication10.1109/ROMAN.2010.5598702(298-303)Online publication date: Sep-2010
https://doi.org/10.1109/ROMAN.2010.5598702

Index Terms

Speech-driven embodied entrainment character system with hand motion input in mobile environment

Recommendations

Video Content Production Support System with Speech-Driven Embodied Entrainment Character by Speech and Hand Motion Inputs
Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction

InterActor is a speech-input-driven CG-embodied interaction character that can generate communicative movements and actions for entrained interaction. InterPuppet, on the other hand, is an embodied interaction character that is driven by both speech ...
Development of an embodied image telecasting method via a robot with speech-driven nodding response
Proceedings of the 2007 conference on Human interface: Part I

InterRobot is an embodied interaction robot driven by InterRobot technology (iRT) in order to make communicative motions and actions based only on speech input. In this paper, the concept of an embodied image telecasting method is proposed for ...
Eyeball Movement Model for Lecturer Character in Speech-Driven Embodied Group Entrainment System
ISM '13: Proceedings of the 2013 IEEE International Symposium on Multimedia

In our previous research, we proposed an eyeball movement model that consists of a saccade model and a group gaze model for enhancing group interaction and communication. In this study, in order to evaluate the effects of the proposed model, we develop ...

Comments

Information & Contributors

Information

Published In

ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces

November 2007

402 pages

ISBN:9781595938176

DOI:10.1145/1322192

General Chairs:
Kenji Mase
Nagoya University, Japan
,
Dominic Massaro
UC Santa Cruz, USA
,
Program Chairs:
Kazuya Takeda
Nagoya University, Japan
,
Deb Roy
MIT, USA
,
Alexandros Potamianos
Technical University of Crete, Greece

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 November 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

ICMI07

Sponsor:

ICMI07: International Conference on Multimodal Interface

November 12 - 15, 2007

Aichi, Nagoya, Japan

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
189
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yamamoto MShigeno YKawabe RWatanabe TShaer OShen CMorris MHorn M(2012)Development of a context-enhancing surface based on the entrainment of embodied rhythms and actions sharing via interactionProceedings of the 2012 ACM international conference on Interactive tabletops and surfaces10.1145/2396636.2396701(363-366)Online publication date: 11-Nov-2012
https://dl.acm.org/doi/10.1145/2396636.2396701
Yamamoto MOsaki KMatsune SWatanabe T(2010)An embodied entrainment character cell phone by speech and head motion inputs19th International Symposium in Robot and Human Interactive Communication10.1109/ROMAN.2010.5598702(298-303)Online publication date: Sep-2010
https://doi.org/10.1109/ROMAN.2010.5598702

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Video Content Production Support System with Speech-Driven Embodied Entrainment Character by Speech and Hand Motion Inputs

Development of an embodied image telecasting method via a robot with speech-driven nodding response

Eyeball Movement Model for Lecturer Character in Speech-Driven Embodied Group Entrainment System

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations