skip to main content
research-article

Sketch-based tree modeling using Markov random field

Published: 01 December 2008 Publication History

Abstract

In this paper, we describe a new system for converting a user's freehand sketch of a tree into a full 3D model that is both complex and realistic-looking. Our system does this by probabilistic optimization based on parameters obtained from a database of tree models. The best matching model is selected by comparing its 2D projections with the sketch. Branch interaction is modeled by a Markov random field, subject to the constraint of 3D projection to sketch. Our system then uses the notion of self-similarity to add new branches before finally populating all branches with leaves of the user's choice. We show a variety of natural-looking tree models generated from freehand sketches with only a few strokes.

Supplementary Material

JPG File (a109-chen-mp4_hi.jpg)
MOV File (a109-chen-mp4_hi.mov)

References

[1]
Bishop, C. 2006. Pattern Recognition and Machine Learning. Springer.
[2]
de Reffye, P., Edelin, C., Francon, J., Jaeger, M., and Puech, C. 1988. Plant models faithful to botanical structure and development. In Computer Graphics (SIGGRAPH '88 Proc.), J. Dill, Ed., vol. 22, ACM SIGGRAPH, 151--158.
[3]
Holton, M. 1994. Strands, gravity and botanical tree imagery. Computer Graphics Forum 13, 1, 57--67.
[4]
Ijiri, T., Owada, S., and Igarashi, T. 2006. The sketch L-system: Global control of tree modeling using free-form strokes. In Smart Graphics, 138--146.
[5]
Jirasek, C., Prusinkiewicz, P., and Moulia, B. 2000. Integrating biomechanics into developmental plant models expressed using L-systems. In Proceedings of the 3rd Plant Biomechanics Conference, 615--624.
[6]
Lamdan, Y., Schwartz, J. T., and Wolfson, H. J. 1988. Object recognition by affine invariant matching. In CVPR, 335--344.
[7]
Lindenmayer, A. 1968. Mathematical models for cellular interaction in development, parts I and II. Journal of Theoretical Biology 18, 280--315.
[8]
Lintermann, B., and Deussen, O. 1999. Interactive modeling of plants. IEEE Computer Graphics and Applications 19, 1, 56--65.
[9]
Měch, R., and Prusinkiewicz, P. 1996. Visual models of plants interacting with their environment. In SIGGRAPH '96: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 397--410.
[10]
Neubert, B., Franken, T., and Deussen, O. 2007. Approximate image-based tree-modeling using particle flows. ACM Trans. Graph. (SIGGRAPH) 26, 3, 88.
[11]
Okabe, M., Owada, S., and Igarashi, T. 2005. Interactive design of botanical trees using freehand sketches and example-based editing. In Computer Graphics Forum, Eurographics 2005, vol. 24.
[12]
Oppenheimer, P. 1986. Real time design and animation of fractal plants and trees. In Computer Graphics (SIGGRAPH 86 Conf. Proc.), vol. 20, 55--64.
[13]
Prusinkiewicz, P., Hammel, M., Hanan, J., and Mech, R. 1996. L-systems: from the theory to visual models of plants. In Machine Graphics and Vision, 365--392.
[14]
Prusinkiewicz, P., Mündermann, L., Karwowski, R., and Lane, B. 2001. The use of positional information in the modeling of plants. In SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 289--300.
[15]
Reche-Martinez, A., Martin, I., and Drettakis, G. 2004. Volumetric reconstruction and interactive rendering of trees from photographs. ACM Trans. Graph. 23, 3, 720--727.
[16]
Shlyakhter, I., Rozenoer, M., Dorsey, J., and Teller, S. 2001. Reconstructing 3d tree models from instrumented photographs. IEEE Computer Graphics and Applications, 53--61.
[17]
Tan, P., Zeng, G., Wang, J., Kang, S. B., and Quan, L. 2007. Image-based tree modeling. In SIGGRAPH '07: ACM SIGGRAPH 2007 papers, ACM, New York, NY, USA, 87.
[18]
Ulam, S. 1966. Pattern of growth of figures: mathematical aspects. In Module, Proportion, Symmetry, Rhythm, G. Keps, Ed. Braziller, New York, 64--74.
[19]
Weber, J., and Penn, J. 1995. Creation and rendering of realistic trees. In SIGGRAPH 95 Conf. Proc., 119--128.

Cited By

View all
  • (2024)Light Distribution Models for Tree Growth SimulationComputer Graphics Forum10.1111/cgf.15268Online publication date: 5-Nov-2024
  • (2024)DeepTree: Modeling Trees With Situated LatentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.330788730:8(5795-5809)Online publication date: Aug-2024
  • (2023)Rhizomorph: The Coordinated Function of Shoots and RootsACM Transactions on Graphics10.1145/359214542:4(1-16)Online publication date: 26-Jul-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 27, Issue 5
December 2008
552 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1409060
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2008
Published in TOG Volume 27, Issue 5

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Markov random field
  2. geometric modeling
  3. sketching
  4. tree modeling

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)5
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Light Distribution Models for Tree Growth SimulationComputer Graphics Forum10.1111/cgf.15268Online publication date: 5-Nov-2024
  • (2024)DeepTree: Modeling Trees With Situated LatentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.330788730:8(5795-5809)Online publication date: Aug-2024
  • (2023)Rhizomorph: The Coordinated Function of Shoots and RootsACM Transactions on Graphics10.1145/359214542:4(1-16)Online publication date: 26-Jul-2023
  • (2023)Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single SketchIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.317085329:9(3826-3839)Online publication date: 1-Sep-2023
  • (2022)3D modeling and reconstruction of plants and trees: A cross-cutting review across computer graphics, vision, and plant phenotypingBreeding Science10.1270/jsbbs.2107472:1(31-47)Online publication date: 2022
  • (2022)Comparative Analysis of the Performance of Complex Texture Clustering Driven by Computational Intelligence Methods Using Multiple Clustering ModelsComputational Intelligence and Neuroscience10.1155/2022/84494912022(1-13)Online publication date: 29-Sep-2022
  • (2022)A Procedural Model for Diverse Tree SpeciesProceedings of the 17th International Conference on the Foundations of Digital Games10.1145/3555858.3564251(1-8)Online publication date: 5-Sep-2022
  • (2021)Fire in paradiseACM Transactions on Graphics10.1145/3450626.345995440:4(1-15)Online publication date: 19-Jul-2021
  • (2021)BuildingSketch: Freehand Mid-Air Sketching for Building Modeling2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR52148.2021.00049(329-338)Online publication date: Oct-2021
  • (2020)Pattern‐driven color pattern recognition for printed fabric motif designColor Research & Application10.1002/col.2256446:1(207-221)Online publication date: 7-Sep-2020
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media