article

Open access

Seam carving for content-aware image resizing

Authors:

Ariel ShamirAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 26, Issue 3

Pages 10 - es

https://doi.org/10.1145/1276377.1276390

Published: 29 July 2007 Publication History

Abstract

Effective resizing of images should not only use geometric constraints, but consider the image content as well. We present a simple image operator called seam carving that supports content-aware image resizing for both reduction and expansion. A seam is an optimal 8-connected path of pixels on a single image from top to bottom, or left to right, where optimality is defined by an image energy function. By repeatedly carving out or inserting seams in one direction we can change the aspect ratio of an image. By applying these operators in both directions we can retarget the image to a new size. The selection and order of seams protect the content of the image, as defined by the energy function. Seam carving can also be used for image content enhancement and object removal. We support various visual saliency measures for defining the energy of an image, and can also include user input to guide the process. By storing the order of seams in an image we create multi-size images, that are able to continuously change in real time to fit a given size.

Supplementary Material

MP4 File (pps010.mp4)

Download
50.71 MB

References

[1]

Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Trans. Graph. 23, 3, 294--302.

Digital Library

[2]

Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C. 2000. Image inpainting. In Proceedings of ACM SIGGRAPH, 417--424.

Digital Library

[3]

Bertalmio, M., Vese, L., Sapiro, G., and Osher, S. 2003. Simultaneous structure and texture image inpainting. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 707--714.

[4]

Boykov, Y., and Jolly, M.-P. 2001. Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images. In International Conference on Computer Vision, (ICCV), vol. I, 105--112.

[5]

Chen, L., Xie, X., Fan, X., Ma, W., Zhang, H., and Zhou, H. 2003. A visual attention model for adapting images on small displays. Multimedia Systems 9, 4, 353--364.

Digital Library

[6]

Christoudias, C., Georgescu, B., and Meer, P. 2002. Synergism in low-level vision. In 16th International Conference on Pattern Recognition, vol. IV, 150--155.

Digital Library

[7]

Criminisi, A., Perez, P., and Toyama, K. 2003. Object removal by exemplar-based inpainting. In In IEEE Conference on Computer Vision and Pattern Recognition, 417--424.

[8]

Dalal, N., and Triggs, B. 2005. Histograms of oriented gradients for human detection. In International Conference on Computer Vision & Pattern Recognition, vol. 2, 886--893.

Digital Library

[9]

Davis, J. 1998. Mosaics of scenes with moving objects. In Proceedings of CVPR.

Digital Library

[10]

DeCarlo, D., and Santella, A. 2002. Stylization and abstraction of photographs. In Proceedings of SIGGRAPH, 769--776.

Digital Library

[11]

Drori, I., Cohen-Or, D., and Yeshurun, Y. 2003. Fragment-based image completion. In Proceedings of ACM SIGGRAPH, 303--312.

Digital Library

[12]

Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In SIGGRAPH 2001, Computer Graphics Proceedings, ACM Press / ACM SIGGRAPH, E. Fiume, Ed., 341--346.

Digital Library

[13]

Gal, R., Sorkine, O., and Cohen-Or, D. 2006. Feature-aware texturing. In Eurographics Symposium on Rendering.

Digital Library

[14]

Harris, C., and Stephens, M. 1988. A combined corner and edge detector. In Proceedings of the 4th Alvey Vision Conference, 147--151.

[15]

Itti, L., Koch, C., and Neibur, E. 1999. A model of saliency-based visual attention for rapid scene analysis. PAMI 20, 11, 1254--1259.

Digital Library

[16]

Jacobs, C., Li, W., Schrier, E., Bargeron, D., and Salesin, D. 2003. Adaptive grid-based document layout. In Proceedings of ACM SIGGRAPH, 838--847.

Digital Library

[17]

Jia, J., Sun, J., Tang, C.-K., and Shum, H.-Y., 2006. Drag-and-drop pasting. In Proceedings of SIGGRAPH.

Digital Library

[18]

Kuhn, H. W. 1995. The hungarian method for the assignment problem. In Naval Research Logistic Quarterly, 2:83--97.

[19]

Liu, F., and Gleicher, M. 2005. Automatic Image Retargeting with Fisheye-View Warping. In ACM UIST, 153--162.

Digital Library

[20]

Liu, F., and Gleicher, M. 2006. Video Retargeting: Automating Pan and Scan. In ACM international conference on Multimedia, 241--250.

Digital Library

[21]

Liu, H., Xie, X., Ma, W., and Zhang, H. 2003. Automatic browsing of large pictures on mobile devices. Proceedings of the eleventh ACM international conference on Multimedia, 148--155.

Digital Library

[22]

Perez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. Graph. 22, 3, 313--318.

Digital Library

[23]

Rother, C., Bordeaux, L., Hamadi, Y., and Blake, A. 2006. Autocollage. In Proceedings of SIGGRAPH 2006.

Digital Library

[24]

Santella, A., Agrawala, M., DeCarlo, D., Salesin, D., and Cohen, M. 2006. Gaze-based interaction for semi-automatic photo cropping. In ACM Human Factors in Computing Systems (CHI), 771--780.

Digital Library

[25]

Setlur, V., Takagi, S., Raskar, R., Gleicher, M., and Gooch, B. 2005. Automatic Image Retargeting. In In the Mobile and Ubiquitous Multimedia (MUM), ACM Press.

Digital Library

[26]

Suh, B., Ling, H., Bederson, B. B., and Jacobs, D. W. 2003. Automatic thumbnail cropping and its effectiveness. In UIST '03: Proceedings of the 16th annual ACM symposium on User interface software and technology, ACM Press, New York, NY, USA, 95--104.

Digital Library

[27]

Sun, J., Yuan, L., Jia, J., and Shum, H. 2005. Image completion with structure propagation. In Proceedings of ACM SIGGRAPH.

Digital Library

[28]

V. Kwatra, A. Schdl, I. E. G. T., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. In Proceedings of SIGGRAPH.

Digital Library

[29]

Viola, P., and Jones, M. 2001. Rapid object detection using a boosted cascade of simple features. In Conference on Computer Vision and Pattern Recognition (CVPR).

[30]

Wang, J., and Cohen, M. 2006. Simultaneous Matting and Compositing. Microsoft Research Technical Report, MSR-TR-2006-63 (May).

[31]

Zomet, A., Levin, A., Peleg, S., and Weiss, Y. 2005. Seamless image stitching by minimizing false edges. IEEE Transactions on Image Processing 15, 4, 969--977.

Digital Library

Cited By

Knodt JGao X(2025)Texture Size Reduction Through Symmetric Overlap and Texture CarvingACM Transactions on Graphics10.1145/371440844:1(1-20)Online publication date: 25-Jan-2025
https://dl.acm.org/doi/10.1145/3714408
Wu HMeng HLi CLiu XWen ZLee T(2025)Cartoon Animation Outpainting With Region-Guided Motion InferenceIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337912531:4(2086-2100)Online publication date: Apr-2025
https://doi.org/10.1109/TVCG.2024.3379125
Lu RShang JWu JWang YMa D(2025)Panoramic Sea-Ice Map Construction for Polar Navigation Based on Multi-Perspective Images Projection and Camera Poses RectificationIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.352328726:3(3417-3430)Online publication date: Mar-2025
https://doi.org/10.1109/TITS.2024.3523287
Show More Cited By

Index Terms

Seam carving for content-aware image resizing
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
        Image representations
  2. Computer graphics

Recommendations

Seam Carving for Content-Aware Image Resizing
Seminal Graphics Papers: Pushing the Boundaries, Volume 2

Effective resizing of images should not only use geometric constraints, but consider the image content as well. We present a simple image operator called seam carving that supports content-aware image resizing for both reduction and expansion. A seam is ...
Seam carving for content-aware image resizing
SIGGRAPH '07: ACM SIGGRAPH 2007 papers

Effective resizing of images should not only use geometric constraints, but consider the image content as well. We present a simple image operator called seam carving that supports content-aware image resizing for both reduction and expansion. A seam is ...
Optimized image resizing using seam carving and scaling

We present a novel method for content-aware image resizing based on optimization of a well-defined image distance function, which preserves both the important regions and the global visual effect (the background or other decorative objects) of an image. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 26, Issue 3

July 2007

976 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1276377

Issue’s Table of Contents

Seminal Graphics Papers: Pushing the Boundaries, Volume 2
August 2023
893 pages
ISBN:9798400708978
DOI:10.1145/3596711
Editor:
Mary C. Whitton
Department of Computer Science, UNC Chapel Hill, USA

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2007

Published in TOG Volume 26, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Seminal Paper

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

917
Total Citations
View Citations
15,133
Total Downloads

Downloads (Last 12 months)841
Downloads (Last 6 weeks)98

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Knodt JGao X(2025)Texture Size Reduction Through Symmetric Overlap and Texture CarvingACM Transactions on Graphics10.1145/371440844:1(1-20)Online publication date: 25-Jan-2025
https://dl.acm.org/doi/10.1145/3714408
Wu HMeng HLi CLiu XWen ZLee T(2025)Cartoon Animation Outpainting With Region-Guided Motion InferenceIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337912531:4(2086-2100)Online publication date: Apr-2025
https://doi.org/10.1109/TVCG.2024.3379125
Lu RShang JWu JWang YMa D(2025)Panoramic Sea-Ice Map Construction for Polar Navigation Based on Multi-Perspective Images Projection and Camera Poses RectificationIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.352328726:3(3417-3430)Online publication date: Mar-2025
https://doi.org/10.1109/TITS.2024.3523287
Du ZYu Y(2025)Efficiency-Sensitive Feature Selection and Probabilistic Feature Transfer for Scenic Image RecompositionIEEE Access10.1109/ACCESS.2025.354631013(38430-38442)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2025.3546310
Haase CKindermann P(2025)On layered area-proportional rectangle contact representationsTheoretical Computer Science10.1016/j.tcs.2024.1150211027:COnline publication date: 19-Feb-2025
https://dl.acm.org/doi/10.1016/j.tcs.2024.115021
Dickman EDiefenbach P(2024)Directorial Editing: A Hybrid Deep-Learning Approach to Content-Aware Image Retargeting and ResizingElectronics10.3390/electronics1322445913:22(4459)Online publication date: 14-Nov-2024
https://doi.org/10.3390/electronics13224459
Jia YWang RJiang X(2024)A Real-Time Image Stitching and Fusion Algorithm Circuit Design Based on FPGAElectronics10.3390/electronics1302027113:2(271)Online publication date: 7-Jan-2024
https://doi.org/10.3390/electronics13020271
Aggarwal SMittal AAggarwal SSingh A(2024)Dynamic Programming-Based White Box Adversarial Attack for Deep Neural NetworksAI10.3390/ai50300595:3(1216-1234)Online publication date: 24-Jul-2024
https://doi.org/10.3390/ai5030059
Le THuang HChen YLee T(2024)Retargeting Video With an End-to-End FrameworkIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332782530:9(6164-6176)Online publication date: Sep-2024
https://doi.org/10.1109/TVCG.2023.3327825
Zhang LChen MTu BLi YXia Y(2024)Retargeting HR Aerial Photos Under Contaminated Labels With Application in Smart NavigationIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2023.328887725:1(349-358)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TITS.2023.3288877
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents