Article

Animating pictures with stochastic motion textures

Authors:

Yung-Yu Chuang,

Ke Colin Zheng,

David H. Salesin,

Richard SzeliskiAuthors Info & Claims

SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

Pages 853 - 860

https://doi.org/10.1145/1186822.1073273

Published: 01 July 2005 Publication History

Abstract

In this paper, we explore the problem of enhancing still pictures with subtly animated motions. We limit our domain to scenes containing passive elements that respond to natural forces in some fashion. We use a semi-automatic approach, in which a human user segments the scene into a series of layers to be individually animated. Then, a "stochastic motion texture" is automatically synthesized using a spectral method, i.e., the inverse Fourier transform of a filtered noise spectrum. The motion texture is a time-varying 2D displacement map, which is applied to each layer. The resulting warped layers are then recomposited to form the animated frames. The result is a looping video texture created from a single still image, which has the advantages of being more controllable and of generally higher image quality and resolution than a video texture created from a video source. We demonstrate the technique on a variety of photographs and paintings.

Supplementary Material

JPG File (pps055.jpg)

Download
16.19 KB

MP4 File (pps055.mp4)

Download
31.98 MB

References

[1]

Aoki, M., Shinya, M., Tsutsuguchi, K., and Kotani, N. 1999. Dynamic texture: Physically-based 2D animation. In ACM SIGGRAPH 1999 Conference Sketches and Applications, 239.

Digital Library

[2]

Barrett, W. A., and Cheney, A. S. 2002. Object-based image editing. ACM Transactions on Graphics 21, 3, 777--784.

Digital Library

[3]

Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C. 2000. Image inpainting. In Proceedings of ACM SIGGRAPH 2000, 417--424.

Digital Library

[4]

Chuang, Y.-Y., Curless, B., Salesin, D. H., and Szeliski, R. 2001. A Bayesian approach to digital matting. In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2001, vol. II, 264--271.

[5]

Criminisi, A., Reid, I. D., and Zisserman, A. 2000. Single view metrology. International Journal of Computer Vision 40, 2, 123--148.

Digital Library

[6]

Criminisi, A., Perez, P., and Toyama, K. 2003. Object removal by exemplar-based inpainting. In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2003, vol. II, 721--728.

[7]

Drori, I., Cohen-Or, D., and Yeshurun, H. 2003. Fragment-based image completion. ACM Transactions on Graphics 22, 3, 303--312.

Digital Library

[8]

Feynman, R. P., Leighton, R. B., and Sands, M. 1964. The Feynman Lectures On Physics, Volume II: Mainly Electromagnetism and Matter. Addison Wesley, Reading, Mass.

[9]

Freeman, W. T., Adelson, E. H., and Heeger, D. J. 1991. Motion without movement. Computer Graphics (Proceedings of ACM SIGGRAPH 91) 25, 4, 27--30.

Digital Library

[10]

Griffiths, D., 1997. Lake java applet. http://www.jaydax.co.uk/tutorials/laketutorial/dgclassfiles.html.

[11]

Hathaway, T., Bowers, D., Pease, D., and Wendel, S., 2003. http://www.mechanicalmusicpress.com/history/pianella/p40.htm.

[12]

Horry, Y., Anjyo, K.-I., and Arai, K. 1997. Tour into the picture: using a spidery mesh interface to make a nimation from a single image. In Proceedings of ACM SIGGRAPH 1997, 225--232.

Digital Library

[13]

Jia, J., and Tang, C.-K. 2003. Image repairing: Robust image synthesis by adaptive ND tensor voting. In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2003, vol. I, 643--650.

Digital Library

[14]

Li, Y., Wang, T., and Shum, H.-Y. 2002. Motion texture: a two-level statistical model for character motion synthesis. ACM Transactions on Graphics 21, 3, 465--472.

Digital Library

[15]

Li, Y., Sun, J., Tang, C.-K., and Shum, H.-Y. 2004. Lazy snapping. ACM Transactions on Graphics 23, 3, 303--308.

Digital Library

[16]

Litwinowicz, P., and Williams, L. 1994. Animating images with drawings. In Proceedings of ACM SIGGRAPH 1994, 409--412.

Digital Library

[17]

Mastin, G. A., Watterberg, P. A., and Mareda, J. F. 1987. Fourier synthesis of ocean scenes. IEEE Computer Graphics and Applications 7, 3, 16--23.

Digital Library

[18]

Mortensen, E. N., and Barrett, W. A. 1995. Intelligent scissors for image composition. In Proceedings of ACM SIGGRAPH 1995, 191--198.

Digital Library

[19]

Oh, B. M., Chen, M., Dorsey, J., and Durand, F. 2001. Image-based modeling and photo editing. In Proceedings of ACM SIGGRAPH 2001, 433--442.

Digital Library

[20]

Porter, T., and Duff, T. 1984. Compositing digital images. Computer Graphics (Proceedings of ACM SIGGRAPH 84) 18, 4, 253--259.

Digital Library

[21]

Rother, C., Kolmogorov, V., and Blake, A. 2004. Grabcut --- interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics 23, 3, 309--314.

Digital Library

[22]

Ruzon, M. A., and Tomasi, C. 2000. Alpha estimation in natural images. In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2000, 18--25.

[23]

Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. In Proceedings of ACM SIGGRAPH 2000, 489--498.

Digital Library

[24]

Shade, J., Gortler, S., He, L.-W., and Szeliski, R. 1998. Layered depth images. In Proceedings of ACM SIGGRAPH 1998, 231--242.

Digital Library

[25]

Shinya, M., and Fournier, A. 1992. Stochastic motion -- motion under the influence of wind. Computer Graphics Forum 11, 3, 119--128.

[26]

Shinya, M., Mori, T., and Osumi, N. 1998. Periodic motion synthesis and Fourier compression. The Journal of Visualization and Computer Animation 9, 3, 95--107.

[27]

Simiu, E., and Scanlan, R. H. 1986. Wind Effects on Structures. John Wiley & Sons.

[28]

Soatto, S., Doretto, G., and Wu, Y. N. 2001. Dynamic textures. In Proceedings of IEEE International Conference on Computer Vision (ICCV) 2001, 439--446.

[29]

Stam, J., and Fiume, E. 1993. Turbulent wind fields for gaseous phenomena. In Proceedings of ACM SIGGRAPH 1993, 369--376.

Digital Library

[30]

Stam, J. 1995. Multi-Scale Stochastic Modelling of Complex Natural Phenomena. PhD thesis, Dept. of Computer Science, University of Toronto.

Digital Library

[31]

Stam, J. 1997. Stochastic dynamics: Simulating the effects of turbulence on flexible structures. Computer Graphics Forum 16, 3, 159--164.

[32]

Sun, M., Jepson, A. D., and Fiume, E. 2003. Video input driven animation (VIDA). In Proceedings of IEEE International Conference on Computer Vision (ICCV) 2003, 96--103.

Digital Library

[33]

Szummer, M., and Picard, R. W. 1996. Temporal texture modeling. In Proceedings of IEEE International Conference on Image Processing (ICIP) 1996, vol. 3, 823--826.

[34]

Tessendorf, J. 2001. Simulating ocean water. ACM SIGGRAPH 2001 course notes No. 47 Simulating Nature: Realistic and Interactive Techniques.

[35]

Treuille, A., McNamara, A., Popović, Z., and Stam, J. 2003. Keyframe control of smoke simulations. ACM Trans. Graph. 22, 3, 716--723.

Digital Library

[36]

Wang, Y., and Zhu, S. C. 2003. Modeling textured motion: Particle, wave and sketch. In Proceedings of IEEE International Conference on Computer Vision (ICCV) 2003, 213--220.

Digital Library

[37]

Wei, L.-Y., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In Proceedings of ACM SIGGRAPH 2000, 479--488.

Digital Library

Cited By

Li JCheng LWang ZMu THe JCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)LoopGaussian: Creating 3D Cinemagraph with Multi-view Images via Eulerian Motion FieldProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681025(476-485)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681025
Zhai XJie YXie XHao AJiang NGao YCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)ANFluid: Animate Natural Fluid Photos base on Physics-Aware Simulation and Dual-Flow Texture LearningProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680950(3323-3331)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3680950
Zhang YXing ZZeng YFang YChen K(2024)PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Models2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00740(7747-7756)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00740
Show More Cited By

Index Terms

Animating pictures with stochastic motion textures
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
  2. Computer graphics
    1. Image manipulation
    2. Rendering

Recommendations

Video textures
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

This paper introduces a new type of medium, called a video texture, which has qualities somewhere between those of a photograph and a video. A video texture provides a continuous infinitely varying stream of images. While the individual frames of a ...
Animating pictures with stochastic motion textures

In this paper, we explore the problem of enhancing still pictures with subtly animated motions. We limit our domain to scenes containing passive elements that respond to natural forces in some fashion. We use a semi-automatic approach, in which a human ...
Video Textures
Seminal Graphics Papers: Pushing the Boundaries, Volume 2

This paper introduces a new type of medium, called a video texture, which has qualities somewhere between those of a photograph and a video. A video texture provides a continuous infinitely varying stream of images. While the individual frames of a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

July 2005

826 pages

ISBN:9781450378253

DOI:10.1145/1186822

Editor:
Markus Gross
Eidgenössische Technische Hochschule Zürich

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH05

Sponsor:

SIGGRAPH

SIGGRAPH05: Special Interest Group on Computer Graphics and Interactive Techniques Conference

July 31 - August 4, 2005

California, Los Angeles

Acceptance Rates

SIGGRAPH '05 Paper Acceptance Rate 98 of 461 submissions, 21%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

43
Total Citations
View Citations
2,207
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)2

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Li JCheng LWang ZMu THe JCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)LoopGaussian: Creating 3D Cinemagraph with Multi-view Images via Eulerian Motion FieldProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681025(476-485)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681025
Zhai XJie YXie XHao AJiang NGao YCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)ANFluid: Animate Natural Fluid Photos base on Physics-Aware Simulation and Dual-Flow Texture LearningProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680950(3323-3331)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3680950
Zhang YXing ZZeng YFang YChen K(2024)PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Models2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00740(7747-7756)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00740
Nie YZhao MZhang QLi PZhu JCai H(2024)Make static person walk again via separating pose action from shapeGraphical Models10.1016/j.gmod.2024.101222134(101222)Online publication date: Aug-2024
https://doi.org/10.1016/j.gmod.2024.101222
Liu SRen ZGupta SWang S(2024)PhysGen: Rigid-Body Physics-Grounded Image-to-Video GenerationComputer Vision – ECCV 202410.1007/978-3-031-73007-8_21(360-378)Online publication date: 1-Oct-2024
https://doi.org/10.1007/978-3-031-73007-8_21
Xing JXia MZhang YChen HYu WLiu HLiu GWang XShan YWong T(2024)DynamiCrafter: Animating Open-Domain Images with Video Diffusion PriorsComputer Vision – ECCV 202410.1007/978-3-031-72952-2_23(399-417)Online publication date: 1-Oct-2024
https://doi.org/10.1007/978-3-031-72952-2_23
Zhang TYu HWu RFeng BZheng CSnavely NWu JFreeman W(2024)PhysDreamer: Physics-Based Interaction with 3D Objects via Video GenerationComputer Vision – ECCV 202410.1007/978-3-031-72627-9_22(388-406)Online publication date: 20-Oct-2024
https://doi.org/10.1007/978-3-031-72627-9_22
Mahapatra ASiarohin ALee HTulyakov SZhu J(2023)Text-Guided Synthesis of Eulerian CinemagraphsACM Transactions on Graphics10.1145/361832642:6(1-13)Online publication date: 5-Dec-2023
https://dl.acm.org/doi/10.1145/3618326
Shen LLi XSun HPeng JXian KCao ZLin GEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)Make-It-4D: Synthesizing a Consistent Long-Term Dynamic Scene Video from a Single ImageProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612033(8167-8175)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3612033
Le TYeh CLin YLee T(2023)Animating Still Natural Images Using WarpingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/351189419:1(1-24)Online publication date: 5-Jan-2023
https://dl.acm.org/doi/10.1145/3511894
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten