research-article

Learning hatching for pen-and-ink illustration of surfaces

Authors:

Evangelos Kalogerakis,

Derek Nowrouzezahrai,

Aaron HertzmannAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 31, Issue 1

Article No.: 1, Pages 1 - 17

https://doi.org/10.1145/2077341.2077342

Published: 02 February 2012 Publication History

Abstract

This article presents an algorithm for learning hatching styles from line drawings. An artist draws a single hatching illustration of a 3D object. Her strokes are analyzed to extract the following per-pixel properties: hatching level (hatching, cross-hatching, or no strokes), stroke orientation, spacing, intensity, length, and thickness. A mapping is learned from input geometric, contextual, and shading features of the 3D object to these hatching properties, using classification, regression, and clustering techniques. Then, a new illustration can be generated in the artist's style, as follows. First, given a new view of a 3D object, the learned mapping is applied to synthesize target stroke properties for each pixel. A new illustration is then generated by synthesizing hatching strokes according to the target properties.

Supplementary Material

MP4 File (tp119_12.mp4)

Download
43.12 MB

References

[1]

Arvo, J. 1995. Applications of irradiance tensors to the simulation of non-lambertian phenomena. In Proceedings of the SIGGRAPH Conference. 335--342.

Digital Library

[2]

Barla, P., Breslav, S., Thollot, J., Sillion, F., and Markosian, L. 2006. Stroke pattern analysis and synthesis. Comput. Graph. Forum 25, 3.

[3]

Belongie, S., Malik, J., and Puzicha, J. 2002. Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24, 4.

Digital Library

[4]

Bishop, C. M. 2006. Pattern Recognition and Machine Learning. Springer.

Digital Library

[5]

Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23, 11.

Digital Library

[6]

Cole, F., Golovinskiy, A., Limpaecher, A., Barros, H. S., Finkelstein, A., Funkhouser, T., and Rusinkiewicz, S. 2008. Where do people draw lines&quest; ACM Trans. Graph. 27, 3.

Digital Library

[7]

DeCarlo, D. and Rusinkiewicz, S. 2007. Highlight lines for conveying shape. In Proceedings of the NPAR Conference.

Digital Library

[8]

Elber, G. 1998. Line art illustrations of parametric and implicit forms. IEEE Trans. Vis. Comput. Graph. 4, 1, 71--81.

Digital Library

[9]

Freeman, W. T., Tenenbaum, J., and Pasztor, E. 2003. Learning style translation for the lines of a drawing. ACM Trans. Graph. 22, 1, 33--46.

Digital Library

[10]

Friedman, J., Hastie, T., and Tibshirani, R. 2000. Additive logistic regression: A statistical view of boosting. Ann. Statist. 38, 2.

[11]

Goodwin, T., Vollick, I., and Hertzmann, A. 2007. Isophote distance: A shading approach to artistic stroke thickness. In Proceedings of the NPAR Conference. 53--62.

Digital Library

[12]

Guptill, A. L. 1997. Rendering in Pen and Ink, S. E. Meyer, Ed., Watson-Guptill.

[13]

Hamel, J. and Strothotte, T. 1999. Capturing and re-using rendition styles for non-photorealistic rendering. Comput. Graph. Forum 18, 3, 173--182.

[14]

Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In Proceedings of the SIGGRAPH Conference.

Digital Library

[15]

Hertzmann, A., Oliver, N., Curless, B., and Seitz, S. M. 2002. Curve analogies. In Proceedings of the EGWR Conference.

Digital Library

[16]

Hertzmann, A. and Zorin, D. 2000. Illustrating smooth surfaces. In Proceedings of the SIGGRAPH Conference. 517--526.

Digital Library

[17]

Hilaga, M., Shinagawa, Y., Kohmura, T., and Kunii, T. L. 2001. Topology matching for fully automatic similarity estimation of 3d shapes. In Proceedings of the SIGGRAPH Conference.

Digital Library

[18]

Jodoin, P.-M., Epstein, E., Granger-Piché, M., and Ostromoukhov, V. 2002. Hatching by example: A statistical approach. In Proceedings of the NPAR Conference. 29--36.

Digital Library

[19]

Jordan, M. I. and Jacobs, R. A. 1994. Hierarchical mixtures of experts and the em algorithm. Neur. Comput. 6, 181--214.

Digital Library

[20]

Judd, T., Durand, F., and Adelson, E. 2007. Apparent ridges for line drawing. ACM Trans. Graph. 26, 3.

Digital Library

[21]

Kalnins, R., Markosian, L., Meier, B., Kowalski, M., Lee, J., Davidson, P., Webb, M., Hughes, J., and Finkelstein, A. 2002. WYSIWYG NPR: Drawing strokes directly on 3D models. In Proceedings of the SIGGRAPH Conference. 755--762.

Digital Library

[22]

Kalogerakis, E., Hertzmann, A., and Singh, K. 2010. Learning 3d mesh segmentation and labeling. ACM Trans. Graph. 29, 3.

Digital Library

[23]

Kalogerakis, E., Nowrouzezahrai, D., Simari, P., McCrae, J., Hertzmann, A., and Singh, K. 2009. Data-Driven curvature for real-time line drawing of dynamic scenes. ACM Trans. Graph. 28, 1.

Digital Library

[24]

Kim, S., Maciejewski, R., Isenberg, T., Andrews, W. M., Chen, W., Sousa, M. C., and Ebert, D. S. 2009. Stippling by example. In Proceedings of the NPAR Conference.

Digital Library

[25]

Kim, S., Woo, I., Maciejewski, R., and Ebert, D. S. 2010. Automated hedcut illustration using isophotes. In Proceedings of the Smart Graphics Conference.

Digital Library

[26]

Kim, Y., Yu, J., Yu, X., and Lee, S. 2008. Line-Art illustration of dynamic and specular surfaces. ACM Trans. Graphics.

Digital Library

[27]

Liu, R. F., Zhang, H., Shamir, A., and Cohen-Or, D. 2009. A part-aware surface metric for shape analysis. Comput. Graph. Forum 28, 2.

[28]

Lum, E. B. and Ma, K.-L. 2005. Expressive line selection by example. Vis. Comput. 21, 8, 811--820.

[29]

Mertens, T., Kautz, J., Chen, J., Bekaert, P., and Durand., F. 2006. Texture transfer using geometry correlation. In Proceedings of the EGSR Conference.

Digital Library

[30]

Palacios, J. and Zhang, E. 2007. Rotational symmetry field design on surfaces. ACM Trans. Graph.

Digital Library

[31]

Praun, E., Hoppe, H., Webb, M., and Finkelstein, A. 2001. Real-Time Hatching. In Proceedings of the SIGGRAPH Conference.

Digital Library

[32]

Rusinkiewicz, S. and DeCarlo, D. 2007. rtsc library. http://www.cs. princeton.edu/gfx/proj/sugcon/.

[33]

Saito, T. and Takahashi, T. 1990. Comprehensible rendering of 3-D shapes. In Proceedings of the SIGGRAPH Conference. 197--206.

Digital Library

[34]

Salisbury, M. P., Anderson, S. E., Barzel, R., and Salesin, D. H. 1994. Interactive pen-and-ink illustration. In Proceedings of the SIGGRAPH Conference. 101--108.

Digital Library

[35]

Shapira, L., Shalom, S., Shamir, A., Zhang, R. H., and Cohen-Or, D. 2010. Contextual part analogies in 3D objects. Int. J. Comput. Vis.

Digital Library

[36]

Shotton, J., Johnson, M., and Cipolla, R. 2008. Semantic texton forests for image categorization and segmentation. In Proceedings of the CVPR Conference.

[37]

Shotton, J., Winn, J., Rother, C., and Criminisi, A. 2009. Textonboost for image understanding: Multi-Class object recognition and segmentation by jointly modeling texture, layout, and context. Int. J. Comput. Vis. 81, 1.

Digital Library

[38]

Simari, P., Kalogerakis, E., and Singh, K. 2006. Folding meshes: Hierarchical mesh segmentation based on planar symmetry. In Proceedings of the SGP Conference.

Digital Library

[39]

Singh, M. and Schaefer, S. 2010. Suggestive hatching. In Proceedings of the Computational Aesthetics Conference.

Digital Library

[40]

Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In Proceedings of the SIGGRAPH Conference. 527--536.

Digital Library

[41]

Torralba, A., Murphy, K. P., and Freeman, W. T. 2007. Sharing visual features for multiclass and multiview object detection. IEEE Trans. Pattern Anal. Mach. Intell. 29, 5.

Digital Library

[42]

Tu, Z. 2008. Auto-context and its application to high-level vision tasks. In Proceedings of the CVPR Conference.

[43]

Turk, G. and Banks, D. 1996. Image-Guided streamline placement. In Proceedings of the SIGGRAPH Confernce.

Digital Library

[44]

Wagstaff, K., Cardie, C., Rogers, S., and Schrödl, S. 2001. Constrained k-means clustering with background knowledge. In Proceedings of the ICML Conference.

Digital Library

[45]

Winkenbach, G. and Salesin, D. 1994. Computer-Generated pen-and-ink illustration. In Proceedings of the SIGGRAPH Conference. 91--100.

Digital Library

[46]

Winkenbach, G. and Salesin, D. 1996. Rendering parametric surfaces in pen and ink. In Proceedings of the SIGGRAPH Conference. 469--476.

Digital Library

[47]

Zemel, R. and Pitassi, T. 2001. A gradient-based boosting algorithm for regression problems. In Proceedings of the Conference on Neural Information Processing Systems.

[48]

Zeng, K., Zhao, M., Xiong, C., and Zhu, S.-C. 2009. From image parsing to painterly rendering. ACM Trans. Graph. 29.

Digital Library

Cited By

Wang WYou MZhou HHe B(2024)PhysFiT: Physical-aware 3D Shape Understanding for Finishing Incomplete AssemblyACM Transactions on Graphics10.1145/370222644:1(1-16)Online publication date: 29-Oct-2024
https://dl.acm.org/doi/10.1145/3702226
Wang QDai HYang JGuo CChilds PKleinsmann MGuo YWang P(2024)Learning-based Artificial Intelligence Artwork: Methodology Taxonomy and Quality EvaluationACM Computing Surveys10.1145/369810557:3(1-37)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3698105
Zhang TWang ZLi LLiu TWang ZHuang SZhang DPeng S(2024)A Sim-to-Real Pipeline for Stroke-Based Robotic Painting2024 3rd International Conference on Innovations and Development of Information Technologies and Robotics (IDITR)10.1109/IDITR62018.2024.10554296(78-83)Online publication date: 23-May-2024
https://doi.org/10.1109/IDITR62018.2024.10554296
Show More Cited By

Index Terms

Learning hatching for pen-and-ink illustration of surfaces
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
    2. Shape modeling
      1. Parametric curve and surface models
  2. Machine learning
    1. Learning paradigms
    2. Machine learning approaches
      1. Markov decision processes
2. Theory of computation
  1. Randomness, geometry and discrete structures
  2. Theory and algorithms for application domains
    1. Machine learning theory
      1. Markov decision processes

Recommendations

Computer-generated pen-and-ink illustration
SIGGRAPH '94: Proceedings of the 21st annual conference on Computer graphics and interactive techniques

This paper describes the principles of traditional pen-and-ink illustration, and shows how a great number of them can be implemented as part of an automated rendering system. It introduces “stroke textures,” which can be used for achieving both texture ...
Technical Section: Interactive example-based hatching

We present an approach for interactively generating pen-and-ink hatching renderings based on hand-drawn examples. We aim to overcome the regular and synthetic appearance of the results of existing methods by incorporating human virtuosity and ...
Real-time pen-and-ink illustration of landscapes
NPAR '06: Proceedings of the 4th international symposium on Non-photorealistic animation and rendering

Non-photorealistic rendering has been proven to be particularly efficient in conveying and transmitting selected visual information. Our paper presents a NPR rendering pipeline that supports pen-and-ink illustration for, but not limited to, complex ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 31, Issue 1

January 2012

149 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2077341

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 February 2012

Accepted: 01 July 2011

Revised: 01 June 2011

Received: 01 October 2010

Published in TOG Volume 31, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

65
Total Citations
View Citations
1,485
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)3

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang WYou MZhou HHe B(2024)PhysFiT: Physical-aware 3D Shape Understanding for Finishing Incomplete AssemblyACM Transactions on Graphics10.1145/370222644:1(1-16)Online publication date: 29-Oct-2024
https://dl.acm.org/doi/10.1145/3702226
Wang QDai HYang JGuo CChilds PKleinsmann MGuo YWang P(2024)Learning-based Artificial Intelligence Artwork: Methodology Taxonomy and Quality EvaluationACM Computing Surveys10.1145/369810557:3(1-37)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3698105
Zhang TWang ZLi LLiu TWang ZHuang SZhang DPeng S(2024)A Sim-to-Real Pipeline for Stroke-Based Robotic Painting2024 3rd International Conference on Innovations and Development of Information Technologies and Robotics (IDITR)10.1109/IDITR62018.2024.10554296(78-83)Online publication date: 23-May-2024
https://doi.org/10.1109/IDITR62018.2024.10554296
Yang WZhou X(2023)Structure-preserving Domain Adaptation Network for Generating Pencil Sketches2023 4th International Conference on Computer Vision, Image and Deep Learning (CVIDL)10.1109/CVIDL58838.2023.10166910(117-122)Online publication date: 12-May-2023
https://doi.org/10.1109/CVIDL58838.2023.10166910
Liu YSra M(2022)Mix3D: Assembly and Animation of Seamlessly Stitched Meshes for Creating Hybrid Creatures and ObjectsProceedings of the 2022 ACM Symposium on Spatial User Interaction10.1145/3565970.3567686(1-12)Online publication date: 1-Dec-2022
https://dl.acm.org/doi/10.1145/3565970.3567686
Wu RZheng C(2022)Learning to Generate 3D Shapes from a Single ExampleACM Transactions on Graphics10.1145/3550454.355548041:6(1-19)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3550454.3555480
Xu PLi YYang ZShi WFu HHuang H(2022)Hierarchical Layout Blending with Recursive Optimal CorrespondenceACM Transactions on Graphics10.1145/3550454.355544641:6(1-15)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3550454.3555446
Todo HKobayashi KKatsuragi JShimotahira HKaji SYue Y(2022)Stroke Transfer: Example-based Synthesis of Animatable Stroke StylesACM SIGGRAPH 2022 Conference Proceedings10.1145/3528233.3530703(1-10)Online publication date: 27-Jul-2022
https://dl.acm.org/doi/10.1145/3528233.3530703
Philbrick GKaplan C(2022)A Primitive for Manual HatchingACM Transactions on Graphics10.1145/350346041:2(1-17)Online publication date: 22-Jan-2022
https://dl.acm.org/doi/10.1145/3503460
Cao RZhang KChen YYang XJin CMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)Point Cloud Completion via Multi-Scale Edge Convolution and AttentionProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548360(6183-6192)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3548360
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents