research-article

TexToons: practical texture mapping for hand-drawn cartoon animations

Authors:

Daniel Sýkora,

Mirela Ben-Chen,

Martin Čadík,

Maryann SimmonsAuthors Info & Claims

NPAR '11: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering

Pages 75 - 84

https://doi.org/10.1145/2024676.2024689

Published: 05 August 2011 Publication History

Abstract

We present a novel and practical texture mapping algorithm for hand-drawn cartoons that allows the production of visually rich animations with minimal user effort. Unlike previous techniques, our approach works entirely in the 2D domain and does not require the knowledge or creation of a 3D proxy model. Inspired by the fact that the human visual system tends to focus on the most salient features of a scene, which we observe for hand-drawn cartoons are the contours rather than the interior of regions, we can create the illusion of temporally coherent animation using only rough 2D image registration. This key observation allows us to design a simple yet effective algorithm that significantly reduces the amount of manual labor required to add visually complex detail to an animation, thus enabling efficient cartoon texturing for computer-assisted animation production pipelines. We demonstrate our technique on a variety of input animations as well as provide examples of postprocessing operations that can be applied to simulate 3D-like effects entirely in the 2D domain.

References

[1]

Alexa, M., Cohen-Or, D., and Levin, D. 2000. As-rigid-as-possible shape interpolation. In ACM SIGGRAPH Conference Proceedings, 157--164.

Digital Library

[2]

Belongie, S., Malik, J., and Puzicha, J. 2002. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 24, 509--522.

Digital Library

[3]

Bénard, P., Bousseau, A., and Thollot, J. 2009. Dynamic solid textures for real-time coherent stylization. In Proceedings of Symposium on Interactive 3D Graphics and Games, 121--127.

Digital Library

[4]

Bénard, P., Lagae, A., Vangorp, P., Lefebvre, S., Drettakis, G., and Thollot, J. 2010. A dynamic noise primitive for coherent stylization. Computer Graphics Forum 29, 4, 1497--1506.

Digital Library

[5]

Bookstein, F. 1989. Principal warps: Thin-plate splines and the decomposition of deformations. IEEE Transactions of Pattern Analysis and Machine Intelligence 11, 6, 567--585.

Digital Library

[6]

Borgefors, G. 1986. Distance transformations in digital images. Computer Vision, Graphics, and Image Processing 34, 3, 344--371.

Digital Library

[7]

Bousseau, A., Neyret, F., Thollot, J., and Salesin, D. 2007. Video watercolorization using bidirectional texture advection. ACM Transaction on Graphics 26, 3, 104.

Digital Library

[8]

Bregler, C., Loeb, L., Chuang, E., and Deshpande, H. 2002. Turning to the masters: Motion capturing cartoons. ACM Transactions on Graphics 21, 3, 399--407.

Digital Library

[9]

Breslav, S., Szerszen, K., Markosian, L., Barla, P., and Thollot, J. 2007. Dynamic 2D patterns for shading 3D scenes. ACM Transactions on Graphics 26, 3, 20.

Digital Library

[10]

Chen, B.-Y., Ono, Y., and Nishita, T. 2005. Character animation creation using hand-drawn sketches. The Visual Computer 21, 8--10, 551--558.

[11]

Corrêa, W. T., Jensen, R. J., Thayer, C. E., and Finkelstein, A. 1998. Texture mapping for cel animation. In ACM SIGGRAPH Conference Proceedings, 435--446.

Digital Library

[12]

Cunzi, M., Thollot, J., Paris, S., Debunne, G., Gascuel, J.-D., and Durand, F. 2003. Dynamic canvas for non-photorealistic walkthroughs. In Proceedings of Graphics Interface, 121--130.

[13]

Guo, C., Ma, Q., and Zhang, L. 2008. Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]

Hays, J., and Essa, I. A. 2004. Image and video based painterly animation. In Proceedings of International Symposium on Non-Photorealistic Animation and Rendering, 113--120.

Digital Library

[15]

Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: A sketching interface for 3D freeform design. In ACM SIGGRAPH Conference Proceedings, 409--416.

Digital Library

[16]

Itti, L. 2000. Models of Bottom-Up and Top-Down Visual Attention. PhD thesis, California Institute of Technology.

Digital Library

[17]

Jain, E., Sheikh, Y., and Hodgins, J. K. 2009. Leveraging the talent of hand animators to create three-dimensional animation. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 93--102.

Digital Library

[18]

Jain, E., Sheikh, Y. A., Mahler, M., and Hodgins, J. K. 2010. Augmenting hand animation with three-dimensional secondary motion. In Proceedings of the ACM SIG-GRAPH/Eurographics Symposium on Computer Animation, 93--102.

Digital Library

[19]

Jeschke, S., Cline, D., and Wonka, P. 2009. A GPU Laplacian solver for diffusion curves and Poisson image editing. ACM Transaction on Graphics 28, 5, 116.

Digital Library

[20]

Johnston, S. F. 2002. Lumo: Illumination for cel animation. In Proceedings of International Symposium on Non-photorealistic Animation and Rendering, 45--52.

Digital Library

[21]

de Juan, C. N., and Bodenheimer, B. 2006. Reusing traditional animation: methods for semi-automatic segmentation and inbetweening. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 223--232.

Digital Library

[22]

Kaneko, T., Takahei, T., Inami, M., Kawakami, N., Yanagida, Y., Maeda, T., and Tachi, S. 2001. Detailed shape representation with parallax mapping. In Proceedings of International Conference on Artificial Reality and Telexistence, 205--208.

[23]

Kort, A. 2002. Computer aided inbetweening. In Proceedings of International Symposium on Non-photorealistic Animation and Rendering, 125--132.

Digital Library

[24]

Leung, R., and Taubman, D. 2009. Perceptual optimization for scalable video compression based on visual masking principles. IEEE Transactions on Circuits and Systems for Video Technology 19, 309--322.

Digital Library

[25]

Madeira, J. S., Stork, A., and Grob, M. H. 1996. An approach to computer-supported cartooning. The Visual Computer 12, 1, 1--17.

[26]

Ono, Y., Chen, B.-Y., and Nishita, T. 2004. 3D character model creation from cel animation. In Proceedings of International Conference on Cyberworlds, 210--215.

Digital Library

[27]

Orzan, A., Bousseau, A., Winnemöller, H., Barla, P., Thollot, J., and Salesin, D. 2008. Diffusion curves: A vector representation for smooth-shaded images. ACM Transactions on Graphics 27, 3, 92.

Digital Library

[28]

Qiu, J., Seah, H. S., Tian, F., Chen, Q., and Wu, Z. 2005. Enhanced auto coloring with hierarchical region matching. Computer Animation and Virtual Worlds 16, 3--4, 463--473.

Digital Library

[29]

Qiu, J., Seah, H. S., Tian, F., Chen, Q., Wu, Z., and Melikhov, K. 2008. Auto coloring with enhanced character registration. International Journal of Computer Games Technology, 1, 2.

Digital Library

[30]

Schenk, O., and Gärtner, K. 2004. Solving unsymmetric sparse systems of linear equations with PARDISO. Journal of Future Generation Computer Systems 20, 3, 475--487.

Digital Library

[31]

Sýkora, D., Buriánek, J., and Žára, J. 2005. Colorization of black-and-white cartoons. Image and Vision Computing 23, 9, 767--782.

Digital Library

[32]

Sýkora, D., Dingliana, J., and Collins, S. 2009. As-rigid-as-possible image registration for hand-drawn cartoon animations. In Proceedings of International Symposium on Non-photorealistic Animation and Rendering, 25--33.

Digital Library

[33]

Sýkora, D., Dingliana, J., and Collins, S. 2009. Lazy-Brush: Flexible painting tool for hand-drawn cartoons. Computer Graphics Forum 28, 2, 599--608.

[34]

Sýkora, D., Sedlacek, D., Jinchao, S., Dingliana, J., and Collins, S. 2010. Adding depth to cartoons using sparse depth (in)equalities. Computer Graphics Forum 29, 2, 615--623.

[35]

Walther, D., and Koch, C. 2006. Modeling attention to salient proto-objects. Neural Networks 19, 9, 1395--1407.

Digital Library

[36]

Winnemöller, H., Orzan, A., Boissieux, L., and Thollot, J. 2009. Texture design and draping in 2D images. Computer Graphics Forum 28, 4, 1091--1099.

Digital Library

[37]

Wirtz, S., Fischer, G., Modersitzki, J., and Schmitt, O. 2004. Superfast elastic registration of histologic images of a whole rat brain for 3d reconstruction. In Proceedings of the SPIE, vol. 5370, 328--334.

[38]

Xie, M. 1995. Feature matching and affine transformation for 2D cell animation. The Visual Computer 11, 8, 419--428.

[39]

Xu, X., Wan, L., Liu, X., Wong, T.-T., Wang, L., and Leung, C.-S. 2008. Animating animal motion from still. ACM Transactions on Graphics 27, 5, 117.

Digital Library

[40]

Yarbus, A. L. 1967. Eye Movements and Vision. Plenum Press.

[41]

Yatziv, L., and Sapiro, G. 2006. Fast image and video colorization using chrominance blending. IEEE Transactions on Image Processing 15, 5, 1120--1129.

Digital Library

[42]

Yoshizawa, S., Belyaev, A., and peter Seidel, H. 2004. A fast and simple stretch-minimizing mesh parameterization. In Proceedings of the Shape Modeling International, 200--208.

Digital Library

[43]

Zayer, R., Rossl, C., and peter Seidel, H. 2005. Discrete tensorial quasiharmonic maps. In Proceedings of the International Conference on Shape Modeling and Applications, 276--285.

Digital Library

[44]

Zhang, S.-H., Chen, T., Zhang, Y.-F., Hu, S.-M., and Martin, R. R. 2009. Vectorizing cartoon animations. IEEE Transactions on Visualization and Computer Graphics 15, 618--629.

Digital Library

[45]

Zhu, Y., and Gortler, S. J. 2007. 3d deformation using moving least squares. Tech. Rep. TR-10-07, Harvard Univeristy.

[46]

Zitová, B., and Flusser, J. 2003. Image registration methods: A survey. Image and Vision Computing 21, 11, 977--1000.

Cited By

Wang NWang WYang HZhang HWang ZWang ZLi H(2025)Motion-guided semantic alignment for line art animation colorizationPattern Recognition10.1016/j.patcog.2024.111055158(111055)Online publication date: Feb-2025
https://doi.org/10.1016/j.patcog.2024.111055
Wu HWang ZLi YLiu XLee T(2024)Suitable and Style-Consistent Multi-Texture Recommendation for Cartoon IllustrationsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365251820:7(1-26)Online publication date: 12-Mar-2024
https://dl.acm.org/doi/10.1145/3652518
Ciao SGuan ZLiu QWei LWang Z(2024)Ciallo: GPU-Accelerated Rendering of Vector Brush StrokesACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657418(1-11)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657418
Show More Cited By

Index Terms

TexToons: practical texture mapping for hand-drawn cartoon animations
1. Applied computing
  1. Arts and humanities
    1. Fine arts
    2. Performing arts
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Image manipulation
      1. Texturing

Recommendations

Automatic expressive deformations for stylizing motion
GRAPHITE '06: Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia

3D computer animation often struggles to compete with the flexibility and expressiveness commonly found in traditional animation, particularly when rendered non-photorealistically. We present an animation tool that takes skeleton-driven 3D computer ...
Hair motion cloning from cartoon animation sequences: Research Articles
CASA 2006

This paper describes a new approach to create cartoon hair animation that allows users to use existing cel character animation sequences. We demonstrate the generation of cartoon hair animation accentuated in ‘anime-like’ motions. The novelty of this ...
Stylized lighting for cartoon shader
CASA' 2009 Special Issue

In the context of non-photorealistic imaging, such as digital cel animation, lighting is symbolic and stylized to depict the scene's mood and the geometric or physical features of the objects in the scene. Stylized light and shade should therefore be ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

NPAR '11: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering

August 2011

234 pages

ISBN:9781450309073

DOI:10.1145/2024676

Conference Chairs:
John Collomosse
University of Surrey, UK
,
Paul Asente
Adobe Systems
,
Editor:
Stephen N. Spencer
University of Washington

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 August 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SBIM/NPAR/CAe 2011

Sponsor:

SIGGRAPH
EUROGRAPHICS

SBIM/NPAR/CAe 2011: Joint Symposia on Sketch-Based Interfaces and Modeling, Non-Photorealistic Animation and Computational Aesthetics

August 5 - 7, 2011

British Columbia, Vancouver, Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

48
Total Citations
View Citations
819
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)5

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang NWang WYang HZhang HWang ZWang ZLi H(2025)Motion-guided semantic alignment for line art animation colorizationPattern Recognition10.1016/j.patcog.2024.111055158(111055)Online publication date: Feb-2025
https://doi.org/10.1016/j.patcog.2024.111055
Wu HWang ZLi YLiu XLee T(2024)Suitable and Style-Consistent Multi-Texture Recommendation for Cartoon IllustrationsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365251820:7(1-26)Online publication date: 12-Mar-2024
https://dl.acm.org/doi/10.1145/3652518
Ciao SGuan ZLiu QWei LWang Z(2024)Ciallo: GPU-Accelerated Rendering of Vector Brush StrokesACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657418(1-11)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657418
Karmakar AChowdhury A(2024)Unfolding a Hidden Risk of Direct 3D Software Usage for Animation Character DesignRecent Advancements in Product Design and Manufacturing Systems10.1007/978-981-97-6732-8_44(521-530)Online publication date: 17-Nov-2024
https://doi.org/10.1007/978-981-97-6732-8_44
Xu PHospedales TYin QSong YXiang TWang L(2023)Deep Learning for Free-Hand Sketch: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2022.314885345:1(285-312)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TPAMI.2022.3148853
Liu SWang XLiu XWu ZSeah H(2023)Shape correspondence for cel animation based on a shape association graph and spectral matchingComputational Visual Media10.1007/s41095-022-0298-09:3(633-656)Online publication date: 29-Apr-2023
https://doi.org/10.1007/s41095-022-0298-0
Zhang LWong TLiu Y(2022)Sprite-from-SpriteACM Transactions on Graphics10.1145/3550454.355543941:6(1-12)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3550454.3555439
Fukusato TShibata RNoh SIgarashi T(2022)Interactive texture editing for garment line drawingsComputer Animation and Virtual Worlds10.1002/cav.211733:6Online publication date: 16-Aug-2022
https://doi.org/10.1002/cav.2117
Zhang QWang BWen WLi HLiu J(2021)Line Art Correlation Matching Feature Transfer Network for Automatic Animation Colorization2021 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV48630.2021.00392(3871-3880)Online publication date: Jan-2021
https://doi.org/10.1109/WACV48630.2021.00392
Hashimoto MFukusato TIgarashi T(2020)Neurally-Guided Texturing for Garment Line DrawingsSIGGRAPH Asia 2020 Technical Communications10.1145/3410700.3425428(1-4)Online publication date: 1-Dec-2020
https://dl.acm.org/doi/10.1145/3410700.3425428
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten