Article

Walk to here: a voice driven animation system

Authors:

M. van de PanneAuthors Info & Claims

SCA '06: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation

Pages 243 - 251

Published: 02 September 2006 Publication History

Abstract

We present a novel interface for directing the actions of computer animated characters and camera movements. Our system takes spoken input in combination with mouse pointing to generate desired character animation based on motion capture data. The aim is to achieve a more natural animation interface by supporting the types of dialogue and pointing that might be used when one person is explaining a desired motion to another person. We compare our voice-driven system with a button-driven animation interface that has equivalent capabilities. An informal user study indicates that for the test scenarios, the voice-user interface (VUI) is faster than an equivalent graphical user interface (GUI). Potential applications include storyboarding for film or theatre, directing characters in video games, and scene reconstruction.

References

[1]

{AF02} Arikan O., Forsyth D. A.: Interactive motion generation from examples. ACM Trans. Graph. 21, 3 (2002), 483--490.

Digital Library

[2]

{Apa02} Apaydin O.: Networked humanoid animation driven by human voice using extensible 3d (x3d), h-anim and java speech open standards. Master's Thesis at Naval Postgraduate School (2002).

[3]

{Bel05} Beletsky A.: Wave player and recorder library. http://www.codeguru.com/Cpp/G-M/multimedia/audio/article.php/c9305/ (2005).

[4]

{Bol80} Bolt R. A.: "put-that-there": Voice and gesture at the graphics interface. In SIGGRAPH '80: Proceedings of the 7th annual conference on Computer graphics and interactive techniques (New York, NY, USA, 1980), ACM Press, pp. 262--270.

Digital Library

[5]

{CCP80} Calvert T. W., Chapman J., Patla A.: The integration of subjective and objective data in the animation of human movement. In SIGGRAPH '80 (1980), pp. 198--203.

Digital Library

[6]

{CH05} Chai J., Hodgins J. K.: Performance animation from low-dimensional control signals. ACM Trans. Graph. 24, 3 (2005), 686--696.

Digital Library

[7]

{dOSG00} De Oliveira J. C., Shirmohammadi S., Georganas N. D.: A collaborative virtual environment for industrial training. In VR '00: Proceedings of the IEEE Virtual Reality 2000 Conference (Washington, DC, USA, 2000), IEEE Computer Society, p. 288.

Digital Library

[8]

{HCS96} He L., Cohen M. F., Salesin D. H.: The virtual cinematographer: a paradigm for automatic realtime camera control and directing. In SIGGRAPH '96 (1996), pp. 217--224.

Digital Library

[9]

{JKBC91} Jung M. R., Kalita J. K., Badler N. I., Ching W.: Simulating human tasks using simple natural language instructions. In WSC '91: Proceedings of the 23rd conference on Winter simulation (Washington, DC, USA, 1991), IEEE Computer Society, pp. 1049--1057.

Digital Library

[10]

{LCR*02} Lee J., Chai J., Reitsma P., Hodgins J., Pollard N.: Interactive control of avatars animated with human motion data. ACM Trans. Graph. 21, 3 (2002), 491.

Digital Library

[11]

{LRBW05} Loyall A. B., Reilly W. S. N., Bates J., Weyhrauch P.: System for authoring highly interactive, personality-rich interactive characters. In Proceedings of Symposium on Computer Animation (2005).

Digital Library

[12]

{NF05} Neff M., Fiume E.: Aer: Aesthetic exploration and refinement for expressive character animation. In Proceedings of Symposium on Computer Animation (2005).

Digital Library

[13]

{OCL04} Oviatt S., Coulston R., Lunsford R.: When do we interact multimodally? cognitive load and multimodal communication patterns. In Proceedings of the Sixth International Conference on Multimodal Interfaces (ICMI 2004) (2004).

Digital Library

[14]

{Ovi99} Oviatt S.: Ten myths of multimodal interaction. Communications of the ACM 42, 11 (Nov 1999).

Digital Library

[15]

{Rud89} Rudnicky A. I.: The design of voice-driven interfaces. In HLT '89: Proceedings of the workshop on Speech and Natural Language (1989), pp. 120--124.

Digital Library

[16]

{TBvdP04} Thorne M., Burke D., Van De Panne M.: Motion doodles: an interface for sketching character motion. ACM Trans. Graph. 23, 3 (2004), 424--431.

Digital Library

Cited By

Subramonyam HLi WAdar EDontcheva MBaudisch PSchmidt AWilson A(2018)TakeToonsProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242618(663-674)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242618
Plessiet CChaabane SKhemiri G(2015)Autonomous and interactive virtual actor, cooperative virtual environment for immersive Previsualisation tool oriented to moviesProceedings of the 2015 Virtual Reality International Conference10.1145/2806173.2806177(1-4)Online publication date: 8-Apr-2015
https://dl.acm.org/doi/10.1145/2806173.2806177
Richardson J(2010)Verbal control of mathematical tools for simulation and virtual environmentsProceedings of the 2010 Summer Computer Simulation Conference10.5555/1999416.1999430(124-132)Online publication date: 11-Jul-2010
https://dl.acm.org/doi/10.5555/1999416.1999430

Index Terms

Walk to here: a voice driven animation system
1. Computing methodologies

Recommendations

Walk the talk: coordinating gesture with locomotion for conversational characters

Communicative behaviors are a very important aspect of human behavior and deserve special attention when simulating groups and crowds of virtual pedestrians. Previous approaches have tended to focus on generating believable gestures for individual ...
Artistically Directable Walk Generation
SIGGRAPH '22: ACM SIGGRAPH 2022 Talks

We present a framework for artistically directable walk generation. A generative network is trained using a motion capture dataset and a manually animated collection of walks. To accommodate an animator’s workflow, each walk is presented as a sequence ...
A reusable model for emotional biped walk-cycle animation with implicit retargeting
AMDO'10: Proceedings of the 6th international conference on Articulated motion and deformable objects

This paper presents a reusable model for rapid animation of the walkcycle of virtual biped characters, with implicit retargeting of motion capture to any character, regardless of dimensions. Despite modern software continuously improving the quality of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SCA '06: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation

September 2006

370 pages

ISBN:3905673347

General Chairs:
Carol O'Sullivan
Trinity College Dublin, Ireland
,
Fred Pighin
Industrial Light and Magic, USA

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Eurographics Association

Goslar, Germany

Publication History

Published: 02 September 2006

Check for updates

Qualifiers

Article

Conference

SCA06

Sponsor:

SIGGRAPH
EUROGRAPHICS

SCA06: The ACM SIGGRAPH / Eurographics Symposium on Computer Animation

September 2 - 4, 2006

Vienna, Austria

Acceptance Rates

Overall Acceptance Rate 183 of 487 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
540
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Subramonyam HLi WAdar EDontcheva MBaudisch PSchmidt AWilson A(2018)TakeToonsProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242618(663-674)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242618
Plessiet CChaabane SKhemiri G(2015)Autonomous and interactive virtual actor, cooperative virtual environment for immersive Previsualisation tool oriented to moviesProceedings of the 2015 Virtual Reality International Conference10.1145/2806173.2806177(1-4)Online publication date: 8-Apr-2015
https://dl.acm.org/doi/10.1145/2806173.2806177
Richardson J(2010)Verbal control of mathematical tools for simulation and virtual environmentsProceedings of the 2010 Summer Computer Simulation Conference10.5555/1999416.1999430(124-132)Online publication date: 11-Jul-2010
https://dl.acm.org/doi/10.5555/1999416.1999430

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten