skip to main content
10.1145/1179352.1141965acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
Article

AutoCollage

Published: 01 July 2006 Publication History

Abstract

The paper defines an automatic procedure for constructing a visually appealing collage from a collection of input images. The aim is that the resulting collage should be representative of the collection, summarising its main themes. It is also assembled largely seamlessly, using graph-cut, Poisson blending of alpha-masks, to hide the joins between input images. This paper makes several new contributions. Firstly, we show how energy terms can be included that: encourage the selection of a representative set of images; that are sensitive to particular object classes; that encourage a spatially efficient and seamless layout. Secondly the resulting optimization poses a search problem that, on the face of it, is computationally in-feasible. Rather than attempt an expensive, integrated optimization procedure, we have developed a sequence of optimization steps, from static ranking of images, through region of interest optimization, optimal packing by constraint satisfaction, and lastly graph-cut alpha-expansion. To illustrate the power of AutoCollage, we have used it to create collages of many home photo sets; we also conducted a user study in which AutoCollage outperformed competitive methods.

Supplementary Material

JPG File (p847-rother-high.jpg)
JPG File (p847-rother-low.jpg)
High Resolution (p847-rother-high.mov)
Low Resolution (p847-rother-low.mov)

References

[1]
Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Trans. Graph. 23, 3, 294--302.
[2]
Aggoun, A., and Beldiceanu, N. 1993. Extending CHIP in order to solve complex scheduling and placement problems. Mathematical Computer Modelling 17, 7, 57--73.
[3]
Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Trans. on Pattern Analysis and Machine Intelligence 23, 11.
[4]
Crow, F. 1984. Summed area tables for texture mapping. In Proc. ACM Siggraph, ACM, 207--212.
[5]
Dechter, R. 2003. Constraint Processing. Morgan Kaufmann.
[6]
Diakopoulos, N., and Essa, I. 2005. Mediating photo collage authoring. In UIST, CD--ROM.
[7]
Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. Proc. ACM Siggraph.
[8]
Itti, L., Koch, C., and Niebur, E. 1998. A model of saliency based visual attention for rapid scene analysis. IEEE Trans. on Pattern Analysis and Machine Intelligence 20, 11.
[9]
Kim, J., and Pellacini, F. 2002. Jigsaw image mosaics. In Proc. ACM Siggraph, ACM, 657--664.
[10]
Kwatra, V., Schodl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22, 3, 277--286.
[11]
Marriott, K., and Stuckey, P. 1998. Programming with Constraints. The MIT Press.
[12]
Perez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. Graph. 22, 3, 313--318.
[13]
Rother, C., Kolmogorov, V., and Blake, A. 2004. Grabcut: Interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23, 3, 309--314.
[14]
Rother, C., Kumar, S., Kolmogorov, V., and Blake, A. 2005. Digital tapestry. In Proc. Conf. Comp. Vision and Pattern Recog.
[15]
Shotton, J., Winn, J., Rother, C., and Criminisi, A. 2006. Textonboost: Joint appearance, shape and context modelling for multi-class object recognition and segmentation. In Europ. Conf. Comp. Vision.
[16]
Suh, B., Ling, H., Bederson, B. B., and Jacobs, D. W. 2005. Automatic thumbnail cropping and its effectiveness. In UIST, CD--ROM.
[17]
Viola, P., and Jones, M. 2001. Rapid object detection using a boosted cascade of simple features. In Proc. Conf. Comp. Vision and Pat. Recog.
[18]
Waltz, D. 1975. Understanding line drawings of scenes with shadows. In The Psychology of Vision, W. P. H., Ed. McGraw-Hill, New York.

Cited By

View all
  • (2020)Automatic Generation of Informative Video Thumbnail2020 8th International Conference on Digital Home (ICDH)10.1109/ICDH51081.2020.00050(254-259)Online publication date: Sep-2020
  • (2019)May AI?Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300863(1-12)Online publication date: 2-May-2019
  • (2018)An Improved and Optimized Content-Aware Resizing Algorithm for Images with Densely Situated Foreground Objects2018 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET)10.1109/WiSPNET.2018.8538628(1-6)Online publication date: Mar-2018
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH '06: ACM SIGGRAPH 2006 Papers
July 2006
742 pages
ISBN:1595933646
DOI:10.1145/1179352
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. constraint satisfaction
  2. energy minimization
  3. graph cut
  4. image editing
  5. photomontage
  6. poisson blending

Qualifiers

  • Article

Conference

SIGGRAPH06
Sponsor:

Acceptance Rates

SIGGRAPH '06 Paper Acceptance Rate 86 of 474 submissions, 18%;
Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 08 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2020)Automatic Generation of Informative Video Thumbnail2020 8th International Conference on Digital Home (ICDH)10.1109/ICDH51081.2020.00050(254-259)Online publication date: Sep-2020
  • (2019)May AI?Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300863(1-12)Online publication date: 2-May-2019
  • (2018)An Improved and Optimized Content-Aware Resizing Algorithm for Images with Densely Situated Foreground Objects2018 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET)10.1109/WiSPNET.2018.8538628(1-6)Online publication date: Mar-2018
  • (2018)Image montage for constructing photorealistic virtual world from different real scene images2018 International Workshop on Advanced Image Technology (IWAIT)10.1109/IWAIT.2018.8369729(1-4)Online publication date: Jan-2018
  • (2017)Content-Based Image Orientation RecognitionAdaptive Image Processing Algorithms for Printing10.1007/978-981-10-6931-4_12(269-277)Online publication date: 2-Nov-2017
  • (2015)Discontinuous seam cutting for enhanced video stitching2015 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME.2015.7177506(1-6)Online publication date: Jun-2015
  • (2015)Multi-objective content preserving warping for image stitching2015 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME.2015.7177505(1-6)Online publication date: Jun-2015
  • (2015)An improved content aware image resizing algorithm based on a novel adaptive seam detection technique2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI)10.1109/ICACCI.2015.7275963(2311-2316)Online publication date: Aug-2015
  • (2015)Dense, accurate optical flow estimation with piecewise parametric model2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2015.7298704(1019-1027)Online publication date: Jun-2015
  • (2014)Look over hereACM Transactions on Graphics10.1145/2601097.260118333:4(1-11)Online publication date: 27-Jul-2014
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media