Article

Imitation as a first step to social learning in synthetic characters: a graph-based approach

Authors:

B. BlumbergAuthors Info & Claims

SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation

Pages 9 - 18

https://doi.org/10.1145/1073368.1073370

Published: 29 July 2005 Publication History

Abstract

The processes and representations used to generate the behavior of expressive virtual characters are a valuable and largely untapped resource for helping those characters make sense of the world around them. In this paper, we present Max T. Mouse, an anthropomorphic animated mouse character who uses his own motor and behavior representations to interpret the behaviors he sees his friend Morris Mouse performing. Specifically, by using his own motor and action systems as models for the behavioral capabilities of others (a process known as Simulation Theory in the cognitive literature), Max can begin to identify simple goals and motivations for Morris's behavior, an important step towards developing socially intelligent animated characters. Additionally, Max uses a novel motion graph-based movement recognition process in order to accurately parse and imitate Morris's movements and behaviors in real-time and without prior examples, even when provided with limited synthetic visual input. Key contributions of this paper include demonstrating that using the same mechanisms for movement and behavior perception and production allows for an elegant conservation of representation, and that the innate structure of motion graphs can be used to facilitate both movement parsing and movement recognition.

References

[1]

{AF02} Arikan O., Forsyth D. A.: Interactive motion generation from examples. In Proceedings of the 29th annual ACM conference on Computer Graphics and Interactive Techniques (2002), SIGGRAPH.]]

Digital Library

[2]

{BAZB02} Badler N., Allbeck J., Zhao L., Byun M.: Representing and parameterizing agent behavior. In Proceedings of the IEEE Conference on Computer Animation (Geneva, Switzerland, 2002), IEEE Computer Society, pp. 133--143.]]

Digital Library

[3]

{BB98} Bindiganavale R., Badler N.: Motion abstraction and mapping with spatial constraints. In Modelling and Motion Capture Techniques for Virtual Environments, International Workshop Proceedings (Geneva, November 1998), CAPTECH'98.]]

Digital Library

[4]

{BBG*05} Breazeal C., Buchsbaum D., Gray J., Gatenby D., Blumberg B.: Learning from and about others: Towards using imitation to bootstrap the social understanding of others by robots. Artificial Life 11, 1--2 (January 2005).]]

Digital Library

[5]

{BDI*02} Blumberg B., Downie M., Ivanov Y., Berlin M., Johnson M., Tomlinson B.: Integrated learning for synthetic characters. In Proceedings of the 29th annual ACM conference on Computer Graphics and Interactive Techniques (2002), vol. 21, SIGGRAPH, pp. 417--426.]]

Digital Library

[6]

{BG95} Blumberg B., Galyean T.: Multi-level direction of autonomous creatures for real-time virtual environments. In Proceedings of SIGGRAPH 1995 (1995), Computer Graphics Proceedings, Annual Conference Series, ACM, ACM Press.]]

Digital Library

[7]

{BID*01} Burke R., Isla D., Downie M., Ivanov Y., Blumberg B.: Creature smarts: The art and architecture of a virtual brain. In Proceedings of the 2001 Computer Game Developers Conference (2001).]]

[8]

{Bin00} Bindiganavale R.: Building Parameterized Action Representations from Observations. Ph.D thesis, University of Pennsylvania, Computer and Information Science, 2000.]]

Digital Library

[9]

{Blu96} Blumberg B.: Old Tricks, New Dogs: Ethology and Interactive Creatures. PhD thesis, Massachusetts Institute of Technology, Media Lab, 1996.]]

Digital Library

[10]

{Blu97} Blumberg B.: Go with the flow: Synthetic vision for autonomous animated creatures. In Proceedings of the First International Conference on Autonomous Agents (New York, 1997). Johnson W., Hayes-Roth B., (Eds.), ACM Press, pp. 538--539.]]

Digital Library

[11]

{BPB99} Badler N., Palmer M., Bindiganavale R.: Animation control for real-time virtual humans. Communications of the ACM 42, 8 (August 1999), 64--73.]]

Digital Library

[12]

{BS02} Breazeal C., Scassellati B.: Robots that imitation humans. Trends in Cognitive Sciences 6 (2002), 481--487.]]

[13]

{BSP*04} Barbic J., Safonova A., Pan J.-Y., Faloutsos C., Hodgins J. K., Pollard N. S.: Segmenting motion capture data into distinct behaviors. In Proceedings of Graphics Interface (GI 2004) (2004).]]

Digital Library

[14]

{Buc04} Buchsbaum D.: Imitation and Social Learning for Synthetic Characters. Master's thesis, Massachusetts Institute of Technology, Media Lab, September 2004.]]

[15]

{Cas99} Cassell J.: Nudge nudge wink wink: Elements face-to-face conversation in embodied conversational agents. In Embodied Conversational Agents. Cassell J., Sullivan J., Prevost S., Churchull E., (Eds.). MIT Press, Cambridge, MA, 1999.]]

Digital Library

[16]

{CMT01} Caideco A., Monzani J., Thalmann D.: Toward life-like agents: Integrating tasks, verbal communication and behavioural engines, VR Journal (2001).]]

[17]

{Dow01} Downie M.: behavior, animation and music: the music and movement of synthetic characters. Master's thesis, Massachusetts Institute of Technology, Media Lab, 2001.]]

[18]

{FMJ02} Fod A., Mataric M., Jenkins O.: Automated derivation primitives for movement classification. Autonomous Robots 12, 1 (January 2002), 39--54.]]

Digital Library

[19]

{Gav99} Gavrila D.: The visual analysis of human movement: A survey. Computer Vision and Image Understanding 73, 1 (1999), 82--98.]]

Digital Library

[20]

{Gle98} Gleicher M.: retargetting motion to new characters. In Proceedings of SIGGRAPH 1998 (1998). Computer Graphics Proceedings, Annual Conference Series. ACM, ACM Press, pp. 33--42.]]

Digital Library

[21]

{Gor86} Gordon R.: Folk psychology as simulation. Mind and Language 1 (1986), 158--171.]]

[22]

{GSKJ03} Gleicher M., Shin H., Kovar L., Jepsen A.: Snap together motion: Assembling run-time animation. In Symposium on Interactive 3D Graphics (April 2003).]]

Digital Library

[23]

{IB02} Isla D., Blumberg B.: Object persistence for synthetic characters. In Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems (2002), AAMAS.]]

Digital Library

[24]

{KGP02} Kovar L., Gleicher M., Pighin F.: motion graphs. In Proceedings of SIGGRAPH 2002 (2002), Computer Graphics Proceedings, Annual Conference Series, ACM. ACM Press.]]

Digital Library

[25]

{LCR*02} Lee J., Chai J., Reitsma P., Hodgins J., Pollard N.: Interactive control avatars animated with human motion data. In Proceedings of the 29th annual ACM conference on Computer Graphics and Interactive Techniques (2002), SIGGRAPH.]]

Digital Library

[26]

{Lie04} Lieberman J.: Teaching a Robot Manipulation Skills Through Demonstration. Master's thesis, Massachusetts Institute of Technology, Department of Mechanical Engineering, June 2004.]]

[27]

{MM97} Meltzoff A., Moore M.: Explaining facial imitation: A theoretical model. Early Development and Parenting 6 (1997), 179--192.]]

[28]

{Pel03} Pelachaud C.: Computational model of believable conversational agents. In Communication in MAS: background, current trends and future, Huget M.-P., (Ed.), Springer-Verlag, 2003.]]

[29]

{PG96} Perlin K., Goldberg A.: Improv: A system for scripting interactive actors in virtual worlds. In Proceedings of SIGGRAPH 1996 (1996), Computer Graphics Proceedings, Annual Conference Series, ACM, ACM Press.]]

Digital Library

[30]

{Sch99} Schaal S.: Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences 3 (1999), 233--242.]]

[31]

{TDB*02} Tomlinson B., Downie M., Berlin M., Gray J., Lyons D., Cochran J., Blumberg B.: Leashing the alphawolves: Mixing user direction with autonomous emotion in a pack of semi-autonomous virtual characters. In Proceedings of the Symposium on Computer Animation (2002).]]

Digital Library

[32]

{TT94} Tu X., Terzopoulos D.: Artificial fishes: Physics, locomotion, perception, behavior. In Proceedings of SIGGRAPH 1994 (Orlando, July 1994). Computer Graphics Proceedings, Annual Conference Series, ACM, ACM Press.]]

Digital Library

[33]

{WB00} Wilson A., Bobick A.: Realtime online adaptive gesture recognition. In Proceedings of the International Conference on Pattern Recognition (Barcelona, Spain, September 2000).]]

Digital Library

[34]

{WH99} Wu Y., Huang S.: Vision-based gesture recognition: A review. In Lecture Notes in Artificial Intelligence 1739, Gesture-Based Communcation in Human-Computer Interaction (Gif-sur-Yvette, France, 1999), Braffort A., (Ed.), International Gesture Workshop, GW '99.]]

Digital Library

[35]

{YP03} Yin K., Pai D.: Footsee: an interactive animation system. In Symposium on Computer Animation (2003), Breen D., Lin M., (Eds.), Eurographics/SIGGRAPH.]]

Digital Library

Cited By

Sadeghipour AKopp S(2009)A Probabilistic Model of Motor Resonance for Embodied Gesture PerceptionProceedings of the 9th International Conference on Intelligent Virtual Agents10.1007/978-3-642-04380-2_13(90-103)Online publication date: 4-Sep-2009
https://dl.acm.org/doi/10.1007/978-3-642-04380-2_13
Jung BAmor HHeumer GWeber MSlater MKitamura YTal AAmditis AChrysanthou Y(2006)From motion capture to action captureProceedings of the ACM symposium on Virtual reality software and technology10.1145/1180495.1180526(145-154)Online publication date: 1-Nov-2006
https://dl.acm.org/doi/10.1145/1180495.1180526
Kopp SGraeser O(2006)Imitation learning and response facilitation in embodied agentsProceedings of the 6th international conference on Intelligent Virtual Agents10.1007/11821830_3(28-41)Online publication date: 21-Aug-2006
https://dl.acm.org/doi/10.1007/11821830_3
Show More Cited By

Index Terms

Imitation as a first step to social learning in synthetic characters: a graph-based approach
1. Computing methodologies

Recommendations

Stroke effect on legibility of Japanese characters

This study applied a computer program to analyze the descriptors of Japanese characters, including 56 Hiragana, 56 Katakana, and 98 Kanji characters. An experiment was designed to test the legibility of these characters by 40 Japanese students studying ...
Eye typing of Chinese characters
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

Eye typing is one of the most intensively investigated topics in eye tracking technology. Currently, almost all eye typing systems are developed for English typing. Some preliminary studies have been made on developing eye typing systems for inputting ...
Offline recognition of handwritten Bangla characters: an efficient two-stage approach

The present work deals with recognition of handwritten characters of Bangla, a major script of the Indian sub-continent. The main contributions presented here are (a) generation of a database of handwritten basic characters of Bangla and (b) development ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation

July 2005

366 pages

ISBN:1595931988

DOI:10.1145/1073368

Conference Chairs:
Demetri Terzopoulos
New York University, USA
,
Victor Brian Zordan
University of California at Riverside, USA
,
Program Chairs:
Ken Anjyo
OLM Digital, Inc., Japan
,
Petros Faloutsos
University of California at Los Angeles, USA

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SCA05

Sponsor:

SIGGRAPH
EUROGRAPHICS

SCA05: Symposium on Computer Animation

July 29 - 31, 2005

California, Los Angeles

Acceptance Rates

Overall Acceptance Rate 183 of 487 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
777
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sadeghipour AKopp S(2009)A Probabilistic Model of Motor Resonance for Embodied Gesture PerceptionProceedings of the 9th International Conference on Intelligent Virtual Agents10.1007/978-3-642-04380-2_13(90-103)Online publication date: 4-Sep-2009
https://dl.acm.org/doi/10.1007/978-3-642-04380-2_13
Jung BAmor HHeumer GWeber MSlater MKitamura YTal AAmditis AChrysanthou Y(2006)From motion capture to action captureProceedings of the ACM symposium on Virtual reality software and technology10.1145/1180495.1180526(145-154)Online publication date: 1-Nov-2006
https://dl.acm.org/doi/10.1145/1180495.1180526
Kopp SGraeser O(2006)Imitation learning and response facilitation in embodied agentsProceedings of the 6th international conference on Intelligent Virtual Agents10.1007/11821830_3(28-41)Online publication date: 21-Aug-2006
https://dl.acm.org/doi/10.1007/11821830_3
Jeong SHashimoto NSato M(2006)Haptic interaction system for co-evolution with reactive virtual humanProceedings of the First international conference on Technologies for E-Learning and Digital Entertainment10.1007/11736639_155(1252-1261)Online publication date: 16-Apr-2006
https://dl.acm.org/doi/10.1007/11736639_155
Jeong SChoi WHashimoto NSato M(2005)Reactive Virtual Human System with haptic sensation and adaptive functionProceedings of the 2005 International Conference on Cyberworlds10.1109/CW.2005.74(461-466)Online publication date: 23-Nov-2005
https://dl.acm.org/doi/10.1109/CW.2005.74

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten