research-article

Synthesizing structured image hybrids

Authors:

Eitan GrinspunAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 29, Issue 4

Article No.: 85, Pages 1 - 6

https://doi.org/10.1145/1778765.1778822

Published: 26 July 2010 Publication History

Abstract

Example-based texture synthesis algorithms generate novel texture images from example data. A popular hierarchical pixel-based approach uses spatial jitter to introduce diversity, at the risk of breaking coarse structure beyond repair. We propose a multiscale descriptor that enables appearance-space jitter, which retains structure. This idea enables repurposing of existing texture synthesis implementations for a qualitatively different problem statement and class of inputs: generating hybrids of structured images.

Supplementary Material

JPG File (tp112-10.jpg)

Download
10.02 KB

MP4 File (tp112-10.mp4)

Download
64.08 MB

References

[1]

Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Transactions on Graphics 23, 3, 294--302.

Digital Library

[2]

Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., and Werman, M. 2001. Texture mixing and texture movie synthesis using statistical learning. IEEE Transactions on Visualization and Computer Graphics 7, 2, 120--135.

Digital Library

[3]

Barnes, C., Shechtman, E., Finkelstein, A., and Goldman, D. B. 2009. PatchMatch: A randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics 28, 3, 3:1--3:11.

Digital Library

[4]

Cho, T. S., Butman, M., Avidan, S., and Freeman, W. T. 2008. The patch transform. In IEEE Conference on Computer Vision and Pattern Recognition.

[5]

DeBonet, J. 1997. Multiresolution sampling procedure for analysis and synthesis of texture images. In Proceedings of SIGGRAPH 1997, 361--368.

Digital Library

[6]

Dischler, J.-M., and Zara, F. 2006. Real-time structured texture synthesis and editing using image-mesh analogies. The Visual Computer 22, 9, 926--935.

Digital Library

[7]

Efros, A., and Leung, T. 1999. Texture synthesis by non-parametric sampling. In International Conference on Computer Vision, 1033--1038.

Digital Library

[8]

Han, C., Risser, E., Ramamoorthi, R., and Grinspun, E. 2008. Multiscale texture synthesis. ACM Transactions on Graphics 27, 3, 51:1--51:8.

Digital Library

[9]

Heeger, D. J., and Bergen, J. R. 1995. Pyramid-based texture analysis/synthesis. In Proceedings of SIGGRAPH 1995, 229--238.

Digital Library

[10]

Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In Proceedings of SIGGRAPH 2001, 327--340.

Digital Library

[11]

Kopf, J., Fu, C.-W., Cohen-Or, D., Deussen, O., Lischinski, D., and Wong, T.-T. 2007. Solid texture synthesis from 2d exemplars. ACM Transactions on Graphics 26, 3, 2:2--2:9.

Digital Library

[12]

Lefebvre, S., and Hoppe, H. 2005. Parallel controllable texture synthesis. ACM Transactions on Graphics 24, 3, 777--786.

Digital Library

[13]

Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. ACM Transactions on Graphics 25, 3, 541--548.

Digital Library

[14]

Liu, Y., Lin, W.-C., and Hays, J. 2004. Near-regular texture analysis and manipulation. ACM Transactions on Graphics 23, 3, 368--376.

Digital Library

[15]

Matusik, W., Zwicker, M., and Durand, F. 2005. Texture design using a simplicial complex of morphable textures. ACM Transactions on Graphics 24, 3, 787--794.

Digital Library

[16]

Moghaddam, B., and Pentland, A. 1997. Probabilistic visual learning for object representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 7.

Digital Library

[17]

Mohammed, U., Prince, S. J., and Kautz, J. 2009. Visio-lization: generating novel facial images. ACM Transactions on Graphics 28, 3, 57:1--57:8.

Digital Library

[18]

Pitié, F., Kokaram, A. C., and Dahyot, R. 2007. Automated colour grading using colour distribution transfer. Computer Vision and Image Understanding 107, 1--2, 123--137.

Digital Library

[19]

Portilla, J., and Simoncelli, E. 2000. A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision 40, 1, 49--70.

Digital Library

[20]

Pritch, Y., Kav-Venaki, E., and Peleg, S. 2009. Shift-map image editing. In International Conference on Computer Vision, 151--158.

[21]

Ramanarayanan, G., and Bala, K. 2007. Constrained texture synthesis via energy minimization. IEEE Transactions on Visualization and Computer Graphics 13, 1, 167--178.

Digital Library

[22]

Rosenberger, A., Cohen-Or, D., and Lischinski, D. 2009. Layered shape synthesis: automatic generation of control maps for non-stationary textures. ACM Transactions on Graphics 28, 5, 107:1--107:9.

Digital Library

[23]

Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM Transactions on Graphics 21, 3, 665--672.

Digital Library

[24]

Wei, L., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In Proceedings of SIGGRAPH 2000, 355--360.

Digital Library

[25]

Wei, L.-Y., Han, J., Zhou, K., Bao, H., Guo, B., and Shum, H.-Y. 2008. Inverse texture synthesis. ACM Transactions on Graphics 27, 3, 52:1--52:9.

Digital Library

[26]

Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In Eurographics 2009: State of the Art Reports.

[27]

Wu, Q., Shi, L., Bond, S., and Yu, Y. 2006. Laplacian texture synthesis and mixing on surfaces. In Pacific Graphics.

[28]

Zelinka, S., and Garland, M. 2002. Towards real-time texture synthesis with the jump map. In Eurographics Workshop on Rendering, 99--104.

Digital Library

[29]

Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively-variant textures on arbitrary surfaces. ACM Transactions on Graphics 22, 3, 295--302.

Digital Library

Cited By

Cai XLi HGuo SDu H(2021)Texture Synthesis Optimization for Large Scale Structures2021 2nd Information Communication Technologies Conference (ICTC)10.1109/ICTC51749.2021.9441501(81-85)Online publication date: 7-May-2021
https://doi.org/10.1109/ICTC51749.2021.9441501
Xue ZWang Z(2020)Texture Mixing by Interpolating Deep Statistics via Gaussian ModelsIEEE Access10.1109/ACCESS.2020.29814108(60747-60758)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2981410
Dai HWong RWang HZheng ZVasilakos A(2019)Big Data Analytics for Large-scale Wireless NetworksACM Computing Surveys10.1145/333706552:5(1-36)Online publication date: 13-Sep-2019
https://dl.acm.org/doi/10.1145/3337065
Show More Cited By

Index Terms

Synthesizing structured image hybrids
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Texturing

Recommendations

Synthesizing structured image hybrids
SIGGRAPH '10: ACM SIGGRAPH 2010 papers

Example-based texture synthesis algorithms generate novel texture images from example data. A popular hierarchical pixel-based approach uses spatial jitter to introduce diversity, at the risk of breaking coarse structure beyond repair. We propose a ...
Fast Patch-Based Image Hybrids Synthesis
CADGRAPHICS '11: Proceedings of the 2011 12th International Conference on Computer-Aided Design and Computer Graphics

To synthesize a variety of texture images from examples in common PCs is an important topic in computer graphics. This paper proposed a novel patch-based image hybrids synthesis method, which can generate plausible results with visual diversity. First, ...
Synthesizing transformations on hierarchically structured data
PLDI '16

This paper presents a new approach for synthesizing transformations on tree-structured data, such as Unix directories and XML documents. We consider a general abstraction for such data, called hierarchical data trees (HDTs) and present a novel example-...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 29, Issue 4

July 2010

942 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1778765

Issue’s Table of Contents

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2010

Published in TOG Volume 29, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
1,430
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cai XLi HGuo SDu H(2021)Texture Synthesis Optimization for Large Scale Structures2021 2nd Information Communication Technologies Conference (ICTC)10.1109/ICTC51749.2021.9441501(81-85)Online publication date: 7-May-2021
https://doi.org/10.1109/ICTC51749.2021.9441501
Xue ZWang Z(2020)Texture Mixing by Interpolating Deep Statistics via Gaussian ModelsIEEE Access10.1109/ACCESS.2020.29814108(60747-60758)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2981410
Dai HWong RWang HZheng ZVasilakos A(2019)Big Data Analytics for Large-scale Wireless NetworksACM Computing Surveys10.1145/333706552:5(1-36)Online publication date: 13-Sep-2019
https://dl.acm.org/doi/10.1145/3337065
Xu YDong DXu WLiao X(2019)SketchDLCACM Transactions on Architecture and Code Optimization10.1145/331257016:2(1-26)Online publication date: 18-Apr-2019
https://dl.acm.org/doi/10.1145/3312570
Shen ZWu CDing BYuan ZZhang NZhao MZhao Y(2017)GPU-based interactive near-regular texture synthesis for digital human modelsTechnology and Health Care10.3233/THC-17133925:1_suppl(357-365)Online publication date: 1-Jan-2017
https://doi.org/10.3233/THC-171339
Qian YChen YSun HShi JMa LGutierrez DHuang H(2017)Structure-guided texturing with embedded randomnessSIGGRAPH Asia 2017 Technical Briefs10.1145/3145749.3149428(1-4)Online publication date: 27-Nov-2017
https://dl.acm.org/doi/10.1145/3145749.3149428
Sendik OCohen-Or D(2017)Deep Correlations for Texture SynthesisACM Transactions on Graphics10.1145/3072959.301546136:4(1)Online publication date: 25-Jul-2017
https://dl.acm.org/doi/10.1145/3072959.3015461
Sendik OCohen-Or D(2017)Deep Correlations for Texture SynthesisACM Transactions on Graphics10.1145/301546136:5(1-15)Online publication date: 25-Jul-2017
https://dl.acm.org/doi/10.1145/3015461
Liu YAgarwala ALu JRusinkiewicz SMagalhães LFonseca MSezgin M(2016)Data-driven iconificationProceedings of the Joint Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering10.5555/2981324.2981341(113-124)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.5555/2981324.2981341
Yamaguchi SMorishima SKopf JFu C(2016)Face texture synthesis from multiple images via sparse and dense correspondenceSIGGRAPH ASIA 2016 Technical Briefs10.1145/3005358.3005386(1-4)Online publication date: 28-Nov-2016
https://dl.acm.org/doi/10.1145/3005358.3005386
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents