skip to main content
research-article

Example-based expressive animation of 2D rigid bodies

Published: 20 July 2017 Publication History

Abstract

We present a novel approach to facilitate the creation of stylized 2D rigid body animations. Our approach can handle multiple rigid objects following complex physically-simulated trajectories with collisions, while retaining a unique artistic style directly specified by the user. Starting with an existing target animation (e.g., produced by a physical simulation engine) an artist interactively draws over a sparse set of frames, and the desired appearance and motion stylization is automatically propagated to the rest of the sequence. The stylization process may also be performed in an off-line batch process from a small set of drawn sequences. To achieve these goals, we combine parametric deformation synthesis that generalizes and reuses hand-drawn exemplars, with non-parametric techniques that enhance the hand-drawn appearance of the synthesized sequence. We demonstrate the potential of our method on various complex rigid body animations which are created with an expressive hand-drawn look using notably less manual interventions as compared to traditional techniques.

Supplementary Material

ZIP File (a127-dvoroznak.zip)
Supplemental files.
MP4 File (papers-0149.mp4)

References

[1]
Yunfei Bai, Danny M Kaufman, C. Karen Liu, and Jovan Popović. 2016. Artist-directed dynamics for 2D animation. ACM Transactions on Graphics 35, 4 (2016), 145.
[2]
Ronen Barzel and Alan H. Barr. 1988. A Modeling System Based on Dynamic Constraints. In Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '88). ACM, 179--188.
[3]
Pierre Bénard, Forrester Cole, Michael Kass, Igor Mordatch, James Hegarty, Martin Sebastian Senn, Kurt Fleischer, Davide Pesare, and Katherine Breeden. 2013. Stylizing animation by example. ACM Transactions on Graphics 32, 4 (2013), 119.
[4]
Christoph Bregler, Lorie Loeb, Erika Chuang, and Hrishi Deshpande. 2002. Turning to the Masters: Motion Capturing Cartoons. ACM Transactions on Graphics 21, 3 (2002), 399--407.
[5]
Erin Catto. 2007. Box2d - a 2D physics engine for games. http://www.box2d.org. (2007).
[6]
Stephen Chenney, Mark Pingel, Rob Iverson, and Marcin Szymanski. 2002. Simulating Cartoon Style Animation. In Proceedings of International Symposium on Non-photorealistic Animation and Rendering. 133--138.
[7]
Stelian Coros, Sebastian Martin, Bernhard Thomaszewski, Christian Schumacher, Robert Sumner, and Markus Gross. 2012. Deformable Objects Alive! ACM Transactions on Graphics 31, 4 (2012), 69.
[8]
Jakub Fišer, Ondřej Jamriška, Michal Lukáč, Eli Shechtman, Paul Asente, Jingwan Lu, and Daniel Sýkora. 2016. StyLit: Illumination-guided Example-based Stylization of 3D Renderings. ACM Transactions on Graphics 35, 4 (2016), 92.
[9]
Marcos Garcia, John Dingliana, and Carol O'Sullivan. 2007. A Physically Based Deformation Model for Interactive Cartoon Animation. In Workshop in Virtual Reality Interactions and Physical Simulation "VRIPHYS" (2007). Eurographics Association.
[10]
Leon A Gatys, Alexander S Ecker, and Matthias Bethge. 2016. Image style transfer using convolutional neural networks. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2414--2423.
[11]
Ben Glocker, Nikos Komodakis, Georgios Tziritas, Nassir Navab, and Nikos Paragios. 2008. Dense Image Registration Through MRFs And Efficient Linear Programming. Medical Image Analysis 12, 6 (2008), 731--741.
[12]
Michael Haller, Christian Hanl, and Jeremiah Diephuis. 2004. Non-photorealistic Rendering Techniques for Motion in Computer Games. Computers in Entertainment 2, 4 (2004).
[13]
Aaron Hertzmann, Charles E Jacobs, Nuria Oliver, Brian Curless, and David H Salesin. 2001. Image analogies. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. ACM, 327--340.
[14]
Nicholas J. Higham and Robert S. Schreiber. 1990. Fast polar decomposition of an arbitrary matrix. SIAM J. Sci. Statist. Comput. 11, 4 (1990), 648--655.
[15]
Ben Jones, Jovan Popović, James McCann, Wilmot Li, and Adam W. Bargteil. 2015. Dynamic sprites: Artistic authoring of interactive animations. Journal of Visualization and Computer Animation 26, 2 (2015), 97--108.
[16]
Ben Jones, Nils Thuerey, Tamar Shinar, and Adam W. Bargteil. 2016. Example-based Plastic Deformation of Rigid Bodies. ACM Transactions on Graphics 35, 4 (2016), 34:1--34:11.
[17]
Henry Kang, Seungyong Lee, and Charles K. Chui. 2007. Coherent Line Drawing. In Proceedings of International Symposium on Non-photorealistic Animation and Rendering. 43--50.
[18]
Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, and George W. Fitzmaurice. 2014a. Kitty: Sketching dynamic and interactive illustrations. In Proceedings of ACM Symposium on User Interface Software and Technology. 395--405.
[19]
Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, Shengdong Zhao, and George W. Fitzmaurice. 2014b. Draco: Bringing life to illustrations with kinetic textures. In Proceedings of ACM Conference on Human Factors in Computing Systems. 351--360.
[20]
Rubaiat Habib Kazi, Tovi Grossman, Nobuyuki Umetani, and George Fitzmaurice. 2016. Motion Amplifiers: Sketching Dynamic Illustrations Using the Principles of 2D Animation. In Proceedings of ACM Conference on Human Factors in Computing Systems. 4599--4609.
[21]
Yuki Koyama, Kenshi Takayama, Nobuyuki Umetani, and Takeo Igarashi. 2012. Real-time Example-based Elastic Deformation. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA '12). Eurographics Association, 19--24.
[22]
John Lasseter. 1987. Principles of Traditional Animation Applied to 3D Computer Animation. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '87). ACM, 35--44.
[23]
Seungyong Lee, George Wolberg, and Sung Yong Shin. 1998. Polymorph: Morphing Among Multiple Images. IEEE Computer Graphics and Applications 18, 1 (1998), 58--71.
[24]
Sun-Young Lee, Jong-Chul Yoon, Ji-Yong Kwon, and In-Kwon Lee. 2012. CartoonModes: Cartoon stylization of video objects through modal analysis. Graphical Models 74, 2 (2012), 51--60.
[25]
Yin Li, Michael Gleicher, Ying-Qing Xu, and Heung-Yeung Shum. 2003. Stylizing Motion with Drawings. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA '03). Eurographics Association, 309--319.
[26]
Jingwan Lu, Fisher Yu, Adam Finkelstein, and Stephen DiVerdi. 2012. HelpingHand: example-based stroke stylization. ACM Transactions on Graphics 31, 4 (2012), 46.
[27]
Sebastian Martin, Bernhard Thomaszewski, Eitan Grinspun, and Markus Gross. 2011. Example-based Elastic Materials. ACM Transactions on Graphics 30, 4 (2011), 72:1--72:8.
[28]
Matthias Müller, Bruno Heidelberger, Matthias Teschner, and Markus Gross. 2005. Meshless Deformations Based on Shape Matching. ACM Transactions on Graphics 24, 3 (2005), 471--478.
[29]
Tom Ngo, Doug Cutrell, Jenny Dana, Bruce Donald, Lorie Loeb, and Shunhui Zhu. 2000. Accessible Animation and Customizable Graphics via Simplicial Configuration Modeling. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM, 403--410.
[30]
Paul Noble and Wen Tang. 2006. Automatic Expressive Deformations for Stylizing Motion. In Proceedings of the 4th International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia (GRAPHITE '06). ACM, 57--63.
[31]
Daniel Sýkora, John Dingliana, and Steven Collins. 2009. As-Rigid-As-Possible Image Registration for Hand-Drawn Cartoon Animations. In Proceedings of International Symposium on Non-photorealistic Animation and Rendering. 25--33.
[32]
Frank Thomas and Ollie Johnston. 1981. The illusion of life : Disney animation. Disney Editions, New York.
[33]
Jue Wang, Steven M. Drucker, Maneesh Agrawala, and Michael F. Cohen. 2006. The Cartoon Animation Filter. ACM Transactions on Graphics 25, 3 (2006), 1169--1173.
[34]
Richard Williams. 2001. The animator's survival kit. Faber and Faber, London, New York.
[35]
Andrew Witkin and Michael Kass. 1988. Spacetime Constraints. In Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '88). ACM, 159--168.
[36]
Jun Xing, Rubaiat Habib Kazi, Tovi Grossman, Li-Yi Wei, Jos Stam, and George Fitzmaurice. 2016. Energy-Brushes: Interactive Tools for Illustrating Stylized Elemental Dynamics. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, 755--766.
[37]
Jun Xing, Li-Yi Wei, Takaaki Shiratori, and Koji Yatani. 2015. Autocomplete Hand-drawn Animations. ACM Transactions on Graphics 34, 6 (2015), 169:1--169:11.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 36, Issue 4
August 2017
2155 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/3072959
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2017
Published in TOG Volume 36, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 2D animation
  2. example-based synthesis

Qualifiers

  • Research-article

Funding Sources

  • Grant Agency of the Czech Technical University in Prague
  • Technology Agency of the Czech Republic

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)53
  • Downloads (Last 6 weeks)6
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Joint Stroke Tracing and Correspondence for 2D AnimationACM Transactions on Graphics10.1145/364989043:3(1-17)Online publication date: 9-Apr-2024
  • (2024)SMEAR: Stylized Motion Exaggeration with ARt-directionACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657457(1-11)Online publication date: 13-Jul-2024
  • (2024)Automatic Inbetweening for Stroke‐Based Painterly AnimationComputer Graphics Forum10.1111/cgf.15201Online publication date: 8-Oct-2024
  • (2023)Wakey-Wakey: Animate Text by Mimicking Characters in a GIFProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606813(1-14)Online publication date: 29-Oct-2023
  • (2021)Part-based data-driven 3D shape interpolationComputer-Aided Design10.1016/j.cad.2021.103027136(103027)Online publication date: Jul-2021
  • (2018)1-2 Drawing Assistance Systems1-2 線画のお絵かき支援技術The Journal of The Institute of Image Information and Television Engineers10.3169/itej.72.34272:5(342-346)Online publication date: 2018
  • (2018)ToonsynthACM Transactions on Graphics10.1145/3197517.320132637:4(1-11)Online publication date: 30-Jul-2018
  • (2018)OptiMoProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173735(1-12)Online publication date: 21-Apr-2018
  • (2018)Voice Animator: Automatic Lip-Synching in Limited Animation by AudioAdvances in Computer Entertainment Technology10.1007/978-3-319-76270-8_12(153-171)Online publication date: 21-Feb-2018

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media