Article

Capture and synthesis of insect motion

Authors:

N. W. CampbellAuthors Info & Claims

SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation

Pages 39 - 48

https://doi.org/10.1145/1073368.1073374

Published: 29 July 2005 Publication History

Abstract

We present an integrated system that enables the capture and synthesis of 3D motions of small scale dynamic creatures, typically insects and arachnids, in order to drive computer generated models. The system consists of a number of stages, initially, the acquisition of a multi-view calibration scene and synchronised video footage of a subject performing some action is carried out. A user guided labelling process, that can be semi-automated using tracking techniques and a 3D point generating algorithm, then enables a full metric calibration and captures the motions of specific points on the subject. The 3D motions extracted, which often come from a limited number of frames of the original footage, are then extended to generate potentially infinitely long, characteristic motion sequences for multiple similar subjects. Finally a novel path following algorithm is used to find optimal path along with coherent motion for synthetic subjects. The result is a system that, from a potentially small number of original multi-view frames, can generate a whole 'swarm' of novel synthetic subjects all moving in a coherent and natural manner. The proposed system has two major advantages over existing systems, 1) that traditional motion capture techniques cannot in general be used for very small subjects and 2) minimal expense and user input is required to generate, complex, high quality, CG animation.

References

[1]

{AFO03} Arikan O., Forsyth D., O'Brien J.: Motion synthesis from annotations. In ACM Transactions on Graphics (ACM SIGGRAPH 2003) (2003), vol. 22, pp. 402--408.

Digital Library

[2]

{AT04} Agarwal A., Triggs B.: Tracking articulated motion using a mixture of autoregressive models. 8th European Conference on Computer Vision, Prague, Czech Republic 3024, 3 (May 2004), 54--65.

[3]

{Bel62} Bellman R.: Applied Dynamic Programming. Princeton University Press, 1962.

[4]

{HZ01} Hartley R., Zisserman A.: Multiple View Geometry in Computer Vision. Cambridge University Press. 2001.

Digital Library

[5]

{Ker04} Kerlow I.: The Art of 3D Computer Animation and Effects. John Wiley and Sons, 2004.

Digital Library

[6]

{KGP02} Kovar L., Gleicher M., Pighin F.: Motion graphs. In ACM Transactions on Graphics (ACM SIGGRAPH 2002) (2002), vol. 21, pp. 473--482.

Digital Library

[7]

{LCR*02} Lee J., Chai J., Reitsma P., Hodgins J., Pollard N.: Interactive control of avatars animated with human motion data. In ACM Transactions on Graphics (ACM SIGGRAPH 2002) (2002), vol. 21, pp. 491--500.

Digital Library

[8]

{LESC04} Loy G., Eriksson M., Sullivan J., Carlsson S.: Monocular 3d reconstruction of human motion in long action sequences. 8th European Conference on Computer Vision, Prague, Czech Republic 3024, 4 (May 2004), 442--455.

[9]

{Lju99} Ljung L.: System Identification, Theory for the user, 2nd ed. Prentice Hall. 1999.

Digital Library

[10]

{LWS02} Li Y., Wang T., Shum H.-Y.: Motion texture: a two-level statistical model for character motion synthesis. In ACM Transactions on Graphics (ACM SIGGRAPH 2002) (2002), vol, 21, pp. 465--472.

Digital Library

[11]

{Mar00} Martin R. J.: A metric for arma processes. In IEEE Trans. Signal Process. (April 200), vol. 48, pp. 1164--1170.

Digital Library

[12]

{OCD*04} Oziem D., Campbell N., Dalton C., Gibson D., Thomas B.: Combining sampling and autoregression for motion synthesis. Proceedings of the Computer Graphics International Conference (IEEE Computer Society) (June 2004), 510--513.

Digital Library

[13]

{PB02} Pullen K., Bregler C.: Motion capture assisted animation: Texturing and synthesis: In ACM Transactions on Graphics (ACM SIGGRAPH 2002) (2002), vol. 29, pp. 501--508.

Digital Library

[14]

{Rey99} Reynolds C.: Steering behaviors for autonomous characters. In Game Developers Conference (1999).

[15]

{RF03} Ramanan D., Forsyth D.: Finding and tracking people from the bottom up. Computer Vision and Pattern Recognition (CVPR) (June 2003).

[16]

{SSSE00} Schödl A., Szeliski R., Salesin D., Essa I.: Video textures. In ACM Transactions on Graphics (ACM SIGGRAPH 2000), (2000), vol. 19, pp. 489--498.

Digital Library

[17]

{ST94} Sm. J., Tomasi C.: Good Features to Track. In Computer Vision and Pattern Recognition (CVPR) (Seattle, Washington, June 1994), IEEE Computer Society. pp. 593--600.

Cited By

Bhatti Z(2019)Oscillator driven central pattern generator (CPG) system for procedural animation of quadruped locomotionMultimedia Tools and Applications10.1007/s11042-019-7641-1Online publication date: 9-May-2019
https://doi.org/10.1007/s11042-019-7641-1
Guo SChang JYang XWang WZhang J(2014)Locomotion Skills for Insects with Sample-based ControllerComputer Graphics Forum10.1111/cgf.1247133:7(31-40)Online publication date: 1-Oct-2014
https://dl.acm.org/doi/10.1111/cgf.12471
Guo SChang JCao YZhang J(2014)Special Section on CAD/Graphics 2013Computers and Graphics10.1016/j.cag.2013.10.02138(78-85)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1016/j.cag.2013.10.021
Show More Cited By

Index Terms

Capture and synthesis of insect motion
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation

Recommendations

A system for the capture and synthesis of insect motion

We present an integrated system that enables the capture and synthesis of 3D motions of small scale dynamic creatures, typically insects and arachnids, in order to drive computer generated models. The system consists of a number of stages, initially, ...
Motion capture assisted animation: texturing and synthesis

We discuss a method for creating animations that allows the animator to sketch an animation by setting a small number of keyframes on a fraction of the possible degrees of freedom. Motion capture data is then used to enhance the animation. Detail is ...
Motion capture assisted animation: texturing and synthesis
SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

We discuss a method for creating animations that allows the animator to sketch an animation by setting a small number of keyframes on a fraction of the possible degrees of freedom. Motion capture data is then used to enhance the animation. Detail is ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation

July 2005

366 pages

ISBN:1595931988

DOI:10.1145/1073368

Conference Chairs:
Demetri Terzopoulos
New York University, USA
,
Victor Brian Zordan
University of California at Riverside, USA
,
Program Chairs:
Ken Anjyo
OLM Digital, Inc., Japan
,
Petros Faloutsos
University of California at Los Angeles, USA

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SCA05

Sponsor:

SIGGRAPH
EUROGRAPHICS

SCA05: Symposium on Computer Animation

July 29 - 31, 2005

California, Los Angeles

Acceptance Rates

Overall Acceptance Rate 183 of 487 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
557
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bhatti Z(2019)Oscillator driven central pattern generator (CPG) system for procedural animation of quadruped locomotionMultimedia Tools and Applications10.1007/s11042-019-7641-1Online publication date: 9-May-2019
https://doi.org/10.1007/s11042-019-7641-1
Guo SChang JYang XWang WZhang J(2014)Locomotion Skills for Insects with Sample-based ControllerComputer Graphics Forum10.1111/cgf.1247133:7(31-40)Online publication date: 1-Oct-2014
https://dl.acm.org/doi/10.1111/cgf.12471
Guo SChang JCao YZhang J(2014)Special Section on CAD/Graphics 2013Computers and Graphics10.1016/j.cag.2013.10.02138(78-85)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1016/j.cag.2013.10.021
Hoermann TMills SPaulin MReusenzehn S(2013)The design and calibration of a 3D motion capture system for arthropods2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013)10.1109/IVCNZ.2013.6727027(265-269)Online publication date: Nov-2013
https://doi.org/10.1109/IVCNZ.2013.6727027
Guo STharib SChang JZhang J(2013)Biologically---Inspired motion pattern design of multi---legged creaturesProceedings of the Second international conference on Evolutionary and Biologically Inspired Music, Sound, Art and Design10.1007/978-3-642-36955-1_13(145-156)Online publication date: 3-Apr-2013
https://dl.acm.org/doi/10.1007/978-3-642-36955-1_13
Skrba LReveret LHétroy FCani MO'Sullivan C(2009)Animating Quadrupeds: Methods and ApplicationsComputer Graphics Forum10.1111/j.1467-8659.2008.01312.x28:6(1541-1560)Online publication date: 16-Sep-2009
https://doi.org/10.1111/j.1467-8659.2008.01312.x
Mojdehi AAlitavoli MDarvizeh A(2009)Kinematic Simulation of Spider's Walking by Image ProcessingProceedings of the 2009 Second International Conference on Information and Computing Science - Volume 0210.1109/ICIC.2009.108(3-6)Online publication date: 21-May-2009
https://dl.acm.org/doi/10.1109/ICIC.2009.108
Gibson DOziem DDalton CCampbell N(2007)A system for the capture and synthesis of insect motionGraphical Models10.1016/j.gmod.2006.09.00569:5-6(231-245)Online publication date: 1-Sep-2007
https://dl.acm.org/doi/10.1016/j.gmod.2006.09.005
Courty NCorpetti T(2007)Crowd motion captureComputer Animation and Virtual Worlds10.1002/cav.19918:4-5(361-370)Online publication date: 2-Jul-2007
https://doi.org/10.1002/cav.199
Zhang LLi L(2006)Human animation from 2D correspondence based on motion trend predictionProceedings of the 5th WSEAS International Conference on Artificial Intelligence, Knowledge Engineering and Data Bases10.5555/1364262.1364340(458-463)Online publication date: 15-Feb-2006
https://dl.acm.org/doi/10.5555/1364262.1364340
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten