ABSTRACT
Due to small displays of mobile devices, overviewing an image search result that contains many and various images is difficult. To provide an overview of thousands of images, recent studies have tried to develop a framework for image collection summarization that extracts a smaller set of representative images from the original set. Most existing methods take (a) relevance and (b) coverage of each image into account. However, for the use on mobile devices, several important issues remain: generated summaries must be compact enough so as to suit the small mobile displays but the legibility of the summaries should be sufficient -- but how? Our focus in this paper is to extend the framework of image collection summarization to fit the context of overviewing image search results on mobile devices. The key advances of this paper are to introduce two primary factors of (c) compactness and (d) legibility when generating summaries. Our solution is a two-stage optimization method. Given a keyword query and display size, its first stage ranks the images by taking (a) relevance and (b) coverage into account. The second optimization stage takes into account (c) compactness and (d) legibility and determines the number and sizes of images included in the final summary so as to satisfy the display size constraint. Experiments conducted on over 240,000 images demonstrate the effectiveness of our method.
- S.C. Lee and S. Zhai. The Performance of Touch Screen Soft Buttons. In Proc. ACM Conference on Human Factors in Computing Systems (CHI), pages 309--318, 2009. Google ScholarDigital Library
- B. Suh, H. Ling, B.B. Bederson and D.W. Jacobs. Automatic Thumbnail Cropping and Its Effectiveness. In Proc. Annual ACM Symposium on User Interface Software and Technology (UIST), pages 95--104, 2003. Google ScholarDigital Library
- S. Avidan and A. Shamir. Seam Carving for Content-Aware Image Resizing. ACM Transactions on Graphics (TOG), 26(3), Article 10, 2007. Google ScholarDigital Library
- I. Simon, N. Snavely, and S.M. Seitz. Scene Summarization for Online Image Collections. In Proc. IEEE International Conference on Computer Vision (ICCV), pages 1--8, 2007.Google ScholarCross Ref
- R. Liu, L. Yang, and X.-S. Hua. Image Search Result Summarization with Informative Priors. In Proc. Asian Conference on Computer Vision (ACCV), pages 485--495, 2009. Google ScholarDigital Library
- Y. Ke, R. Sukthankar, and L. Hustion. Efficient Near-Duplicate Detection and Sub-Image Retrieval. In Proc. ACM International Conference on Multimedia (ACM MM), pages 869--876, 2004. Google ScholarDigital Library
- J. Fan, Y. Gao, H. Luo, D.A. Keim, and Z. Li. A Novel Approach to Enable Semantic and Visual Image Summarization for Exploratory Image Search. In Proc. International Conference on Multimedia Information Retrieval (MIR), pages 358--365, 2008. Google ScholarDigital Library
- R. Raguram, S. Lazebnik. Computing Iconic Summaries of General Visual Concepts. In Proc. of IEEE CVPR Workshop on Internet Vision, pages 1--8, 2008.Google ScholarCross Ref
- K. Yang, M. Wang, X.-S. Hua, and H.-J. Zhang. Social Image Search with Diverse Relevance Ranking. In Proc. International Conference on Multimedia Modeling (MMM), pages 174--184, 2010. Google ScholarDigital Library
- R.L. Cilibrasi and P.M.B. Vitanyi. The Google Similarity Distance. IEEE Transactions on Knowledge and Data Engineering (TKDE), 19(3):370--383, 2007. Google ScholarDigital Library
- C. Surka, C. Bray, C. Dance, and L. Fan. Visual Categorization with Bags of Keypoints. in Proc. ECCV Workshop on Statistical Learning in Computer Vision, pages 1--22, 2004.Google Scholar
- Y. Taniguchi, A. Akutsu, and Y. Tonomura. PanoramaExcerpts: Extracting and Packing Panoramas for Video Browsing. in Proc. ACM International Conference on Multimedia (ACM MM), pages 427--436, 1997. Google ScholarDigital Library
- H. Knoche, J.D. McCarthy, and M.A. Sasse. Can Small Be Beautiful? Assessing Image Resolution Requirements for Mobile TV. In Proc. ACM International Conference on Multimedia (ACM MM), pages 829--838, 2005. Google ScholarDigital Library
- K. Járvelin and J. Kekáláinen. Cumulated Gain-based Evaluation of IR Techniques. ACM Transactions on Information Systems (TOIS), 20(4):422--446, 2002. Google ScholarDigital Library
Index Terms
Image collection summarization for search result overviewing on mobile devices
Recommendations
An image search for tourist information using a mobile phone
Currently, Mobile phones perform like a personal computer. In searching for information, people generally use keywords or character sets to search for information using a computer or mobile phone. When using keyword to search, users have to define the ...
Mobile interaction using steganographic image on mobile display
MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and servicesThis demonstration shows novel interaction between mobile devices and their nearby devices using digital images on a mobile display. The interaction needs neither special hardware for communication, nor additional software for existing mobile devices. ...
Why People Search for Images using Web Search Engines
WSDM '18: Proceedings of the Eleventh ACM International Conference on Web Search and Data MiningWhat are the intents or goals behind human interactions with image search engines? Knowing why people search for images is of major concern to Web image search engines because user satisfaction may vary as intent varies. Previous analyses of image ...
Comments