skip to main content
10.1145/1661412.1618471acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
research-article

Optimized image resizing using seam carving and scaling

Published: 01 December 2009 Publication History

Abstract

We present a novel method for content-aware image resizing based on optimization of a well-defined image distance function, which preserves both the important regions and the global visual effect (the background or other decorative objects) of an image. The method operates by joint use of seam carving and image scaling. The principle behind our method is the use of a bidirectional similarity function of image Euclidean distance (IMED), while cooperating with a dominant color descriptor (DCD) similarity and seam energy variation. The function is suitable for the quantitative evaluation of the resizing result and the determination of the best seam carving number. Different from the previous simplex-mode approaches, our method takes the advantages of both discrete and continuous methods. The technique is useful in image resizing for both reduction/retargeting and enlarging. We also show that this approach can be extended to indirect image resizing.

Supplementary Material

Supplemental material. (125-dong.zip)

References

[1]
Avidan, S., and Shamir, A. 2007. Seam carving for content-aware image resizing. ACM Trans. Graph. 26, 3, 10.
[2]
Chen, L., Xie, X., Fan, X., Ma, W., Zhang, H., and Zhou, H. 2003. A visual attention model for adapting images on small displays. ACM Multimedia Systems Journal 9, 4, 353--364.
[3]
Cho, T. S., Butman, M., Avidan, S., and Freeman, W. T. 2008. The patch transform and its applications to image editing. In IEEE Conference on Computer Vision and Pattern Recognition 2008 (CVPR 2008)., 1--8.
[4]
DeCarlo, D., and Santella, A. 2002. Stylization and abstraction of photographs. ACM Trans. Graph. 21, 3, 769--776.
[5]
El-Alfy, H., Jacobs, D., and Davis, L. 2007. Multi-scale video cropping. In MULTIMEDIA '07: Proceedings of the 15th international conference on Multimedia, ACM, New York, NY, USA, 97--106.
[6]
Gal, R., Sorkine, O., and Cohen-Or, D. 2006. Feature-aware texturing. In Proceedings of Eurographics Symposium on Rendering, 297--303.
[7]
Itti, L., Koch, C., and Niebur, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 11 (Nov), 1254--1259.
[8]
Li, J., and Lu, B.-L. 2009. An adaptive image euclidean distance. Pattern Recogn. 42, 3, 349--357.
[9]
Liu, H., Xie, X., Ma, W.-Y., and Zhang, H.-J. 2003. Automatic browsing of large pictures on mobile devices. In MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on Multimedia, ACM, New York, NY, USA, 148--155.
[10]
Manjunath, B. S., Ohm, J. R., Vasudevan, V. V., and Yamada, A. 2001. Color and texture descriptors. Circuits and Systems for Video Technology, IEEE Transactions on 11, 6, 703--715.
[11]
Manjunath, B., Salembier, P., and Sikora, T. 2002. Multimedia Content Description Interface. Wiley, Chichester.
[12]
Min, R., and Cheng, H. D. 2009. Effective image retrieval using dominant color descriptor and fuzzy support vector machine. Pattern Recogn. 42, 1, 147--157.
[13]
Pritch, Y., Kav-Venaki, E., and Peleg, S. 2009. Shift-map image editing. In ICCV 2009: Proceedings of the Twelfth IEEE International Conference on Computer Vision, 721.
[14]
Rubinstein, M., Shamir, A., and Avidan, S. 2008. Improved seam carving for video retargeting. ACM Trans. Graph. 27, 3, 16.
[15]
Rubinstein, M., Shamir, A., and Avidan, S. 2009. Multioperator media retargeting. ACM Trans. Graph. 28, 3, 23.
[16]
Santella, A., Agrawala, M., DeCarlo, D., Salesin, D., and Cohen, M. 2006. Gaze-based interaction for semiautomatic photo cropping. In CHI '06: Proceedings of the SIGCHI conference on Human Factors in computing systems, ACM, New York, NY, USA, 771--780.
[17]
Simakov, D., Caspi, Y., Shechtman, E., and Irani, M. 2008. Summarizing visual data using bidirectional similarity. In IEEE Conference on Computer Vision and Pattern Recognition 2008 (CVPR 2008), 1--8.
[18]
Snyman, J. A. 2005. Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms. Springer Publishing.
[19]
Suh, B., Ling, H., Bederson, B. B., and Jacobs, D. W. 2003. Automatic thumbnail cropping and its effectiveness. In UIST '03: Proceedings of the 16th annual ACM symposium on User interface software and technology, ACM, New York, NY, USA, 95--104.
[20]
Viola, P., and Jones, M. J. 2004. Robust real-time face detection. Int. J. Comput. Vision 57, 2, 137--154.
[21]
Walthera, D., and Koch, C. 2006. Modeling attention to salient proto-objects. Neural Networks 19, 9, 1395--1407.
[22]
Wang, L., Zhang, Y., and Feng, J. 2005. On the euclidean distance of images. IEEE Trans. Pattern Anal. Mach. Intell. 27, 8, 1334--1339.
[23]
Wang, Y.-S., Tai, C.-L., Sorkine, O., and Lee, T.-Y. 2008. Optimized scale-and-stretch for image resizing. ACM Trans. Graph. 27, 5, 118.
[24]
Wei, L.-Y., Han, J., Zhou, K., Bao, H., Guo, B., and Shum, H.-Y. 2008. Inverse texture synthesis. ACM Trans. Graph. 27, 3, 52.
[25]
Wolf, L., Guttmann, M., and Cohen-Or, D. 2007. Non-homogeneous content-driven video-retargeting. In Proceedings of the Eleventh IEEE International Conference on Computer Vision (ICCV-07) ICCV 2007, 1--6.
[26]
Zhang, Y. F., Hu, S. M., and Martin, R. R. 2008. Shrinkability maps for content-aware video resizing. Computer Graphics Forum 27, 7, 1797--1804.

Cited By

View all
  • (2024)Integration of local and global features for image retargeting quality assessmentSignal, Image and Video Processing10.1007/s11760-024-03022-618:4(3577-3586)Online publication date: 15-Feb-2024
  • (2022)Integration of Deep Learned and Handcrafted Features for Image Retargeting Quality AssessmentCybernetics and Systems10.1080/01969722.2022.207140854:5(673-696)Online publication date: 5-May-2022
  • (2021)Image Retargeting Quality Assessment Based on Registration Confidence Measure and Noticeability-Based PoolingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2020.299808731:3(972-985)Online publication date: Mar-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers
December 2009
669 pages
ISBN:9781605588582
DOI:10.1145/1661412
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. DCD
  2. IMED
  3. image distance function
  4. image resizing

Qualifiers

  • Research-article

Funding Sources

Conference

SA09
Sponsor:
SA09: SIGGRAPH ASIA 2009
December 16 - 19, 2009
Yokohama, Japan

Acceptance Rates

SIGGRAPH Asia '09 Paper Acceptance Rate 70 of 275 submissions, 25%;
Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Integration of local and global features for image retargeting quality assessmentSignal, Image and Video Processing10.1007/s11760-024-03022-618:4(3577-3586)Online publication date: 15-Feb-2024
  • (2022)Integration of Deep Learned and Handcrafted Features for Image Retargeting Quality AssessmentCybernetics and Systems10.1080/01969722.2022.207140854:5(673-696)Online publication date: 5-May-2022
  • (2021)Image Retargeting Quality Assessment Based on Registration Confidence Measure and Noticeability-Based PoolingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2020.299808731:3(972-985)Online publication date: Mar-2021
  • (2021)Rank Learning Based No-Reference Quality Assessment of Retargeted Images2015 IEEE International Conference on Systems, Man, and Cybernetics10.1109/SMC.2015.185(1023-1028)Online publication date: 10-Mar-2021
  • (2019)CMAIR: content and mask-aware image retargetingMultimedia Tools and Applications10.1007/s11042-019-7462-278:15(21731-21758)Online publication date: 1-Aug-2019
  • (2019)Seam Carve Detection Using Convolutional Neural NetworksAdvanced Hybrid Information Processing10.1007/978-3-030-19086-6_44(392-407)Online publication date: 12-May-2019
  • (2017)Learning quality assessment of retargeted imagesSignal Processing: Image Communication10.1016/j.image.2017.04.00556(12-19)Online publication date: Aug-2017
  • (2017)Near-reversible efficient image resizing for devices supporting different spatial resolutionsThe Journal of Supercomputing10.1007/s11227-016-1880-y73:7(3021-3037)Online publication date: 1-Jul-2017
  • (2016)Sparse Seam-Carving for Structure Preserving Image RetargetingJournal of Signal Processing Systems10.1007/s11265-015-1084-385:2(275-283)Online publication date: 1-Nov-2016
  • (2015)NIF-based seam carving for image resizingMultimedia Systems10.1007/s00530-014-0425-621:6(603-613)Online publication date: 1-Nov-2015
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media