skip to main content
10.1145/2072561.2072569acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Image collection summarization for search result overviewing on mobile devices

Published:29 November 2011Publication History

ABSTRACT

Due to small displays of mobile devices, overviewing an image search result that contains many and various images is difficult. To provide an overview of thousands of images, recent studies have tried to develop a framework for image collection summarization that extracts a smaller set of representative images from the original set. Most existing methods take (a) relevance and (b) coverage of each image into account. However, for the use on mobile devices, several important issues remain: generated summaries must be compact enough so as to suit the small mobile displays but the legibility of the summaries should be sufficient -- but how? Our focus in this paper is to extend the framework of image collection summarization to fit the context of overviewing image search results on mobile devices. The key advances of this paper are to introduce two primary factors of (c) compactness and (d) legibility when generating summaries. Our solution is a two-stage optimization method. Given a keyword query and display size, its first stage ranks the images by taking (a) relevance and (b) coverage into account. The second optimization stage takes into account (c) compactness and (d) legibility and determines the number and sizes of images included in the final summary so as to satisfy the display size constraint. Experiments conducted on over 240,000 images demonstrate the effectiveness of our method.

References

  1. S.C. Lee and S. Zhai. The Performance of Touch Screen Soft Buttons. In Proc. ACM Conference on Human Factors in Computing Systems (CHI), pages 309--318, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. B. Suh, H. Ling, B.B. Bederson and D.W. Jacobs. Automatic Thumbnail Cropping and Its Effectiveness. In Proc. Annual ACM Symposium on User Interface Software and Technology (UIST), pages 95--104, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. S. Avidan and A. Shamir. Seam Carving for Content-Aware Image Resizing. ACM Transactions on Graphics (TOG), 26(3), Article 10, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. I. Simon, N. Snavely, and S.M. Seitz. Scene Summarization for Online Image Collections. In Proc. IEEE International Conference on Computer Vision (ICCV), pages 1--8, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  5. R. Liu, L. Yang, and X.-S. Hua. Image Search Result Summarization with Informative Priors. In Proc. Asian Conference on Computer Vision (ACCV), pages 485--495, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Y. Ke, R. Sukthankar, and L. Hustion. Efficient Near-Duplicate Detection and Sub-Image Retrieval. In Proc. ACM International Conference on Multimedia (ACM MM), pages 869--876, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. J. Fan, Y. Gao, H. Luo, D.A. Keim, and Z. Li. A Novel Approach to Enable Semantic and Visual Image Summarization for Exploratory Image Search. In Proc. International Conference on Multimedia Information Retrieval (MIR), pages 358--365, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. R. Raguram, S. Lazebnik. Computing Iconic Summaries of General Visual Concepts. In Proc. of IEEE CVPR Workshop on Internet Vision, pages 1--8, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  9. K. Yang, M. Wang, X.-S. Hua, and H.-J. Zhang. Social Image Search with Diverse Relevance Ranking. In Proc. International Conference on Multimedia Modeling (MMM), pages 174--184, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. R.L. Cilibrasi and P.M.B. Vitanyi. The Google Similarity Distance. IEEE Transactions on Knowledge and Data Engineering (TKDE), 19(3):370--383, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. C. Surka, C. Bray, C. Dance, and L. Fan. Visual Categorization with Bags of Keypoints. in Proc. ECCV Workshop on Statistical Learning in Computer Vision, pages 1--22, 2004.Google ScholarGoogle Scholar
  12. Y. Taniguchi, A. Akutsu, and Y. Tonomura. PanoramaExcerpts: Extracting and Packing Panoramas for Video Browsing. in Proc. ACM International Conference on Multimedia (ACM MM), pages 427--436, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. H. Knoche, J.D. McCarthy, and M.A. Sasse. Can Small Be Beautiful? Assessing Image Resolution Requirements for Mobile TV. In Proc. ACM International Conference on Multimedia (ACM MM), pages 829--838, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. K. Járvelin and J. Kekáláinen. Cumulated Gain-based Evaluation of IR Techniques. ACM Transactions on Information Systems (TOIS), 20(4):422--446, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Image collection summarization for search result overviewing on mobile devices

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      IMMPD '11: Proceedings of the 2011 international ACM workshop on Interactive multimedia on mobile and portable devices
      November 2011
      46 pages
      ISBN:9781450309950
      DOI:10.1145/2072561

      Copyright © 2011 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 November 2011

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate7of14submissions,50%

      Upcoming Conference

      MM '24
      MM '24: The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader