skip to main content
10.1145/2393347.2396328acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
poster

Image tag re-ranking by coupled probability transition

Published: 29 October 2012 Publication History

Abstract

The large amount of user-tagged images on social networks is helpful to facilitate image management and image search. However, many tags are weakly relevant or irrelevant to the visual content, resulting in unsatisfactory performance in tag related applications. In this paper, we propose a coupled probability transition algorithm to estimate the text-visual group relevance from the observed data and then leverage it to predict tag relevance for a new query image. The visual group for a given tag is a cluster of images that are visually similar and share the same tag. The tag-visual group relevance is uncovered by exploiting the mutual reinforcement in visual space and semantic space alternatively. Experiments on NUS-WIDE dataset show the validity and superiority of the proposed approach over existing methods.

References

[1]
T. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng. NUS-WIDE: a real-world web image database from National University of Singapore. In Proc. CIVR, 2009
[2]
S. Zhang, Q. Tian, G. Hua, Q. Huang, and S. Li. Descriptive Visual Words and Visual Phrases for Image Applications, In Proc. ACM Multimedia 2009
[3]
W. Zhou, Y. Lu, H. Li, Y. Song, and Q. Tian. Spatial Coding for Large Scale Partial-Duplicate Web Image Search. In Proc. ACM Multimedia, 2010
[4]
X. Li, W.Zhou, J.Tang, and Q. Tian. Query Expansion Enhancement by Fast Binary Matching. In Proc. ACM Multimedia, 2012
[5]
J. Xiao, Y. Fu, Y. Lu, and Q. Tian. Refining Image Retrieval Using One-Class Classification. In Proc. ICME, 2009
[6]
J. Cai, Z. Zha, Q. Tian, and Z. Wang. Semi-Automatic Flickr Group Suggestion. In Proc. MMM, 2011
[7]
C. Wang, F.Jing, L.Zhang, and H-J. Zhang. Image annotation refinement using random walk with restarts. In Proc. ACM Multimedia, 2006
[8]
C. Wang, F. Jing, L. Zhang, and H-J. Zhang. Content-based image annotation refinement. In Proc. ICCV, 2007
[9]
D. Liu, X.S. Hua, L. Yang, M. Wang, and H-J. Zhang. Tag ranking. In Proc. WWW, 2009.
[10]
J. Xiao, W. Zhou, and Q. Tian. Exploring Tag Relevance for Image Tag Re-ranking. In Proc. SIGIR, 2012
[11]
B.J. Frey and D. Dueck. Clustering by passing messages between data points. Science, vol. 315, 2007
[12]
J. Wang, J. Yang, K. Yu, F. Lv, T. Huang and Y. Gong. Locality-constrained Linear Coding for image classification. In Proc. CVPR, 2010.
[13]
X. J. Wang, W.Y. Ma, G.R. Xue, and X. Li. Multi-model similarity propagation and its application for web image retrieval. In Proc. ACM Multimedia, 2004
[14]
S. Deerwester, S.T. Dumais, G.W. Furnas, T.K. Landauer, R. Harshman. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 1990
[15]
K. Jarvelin and J. Kekalainen. Cumulated Grin-Based Evaluation of IR Techniques. In ACM Transactions of Information System, 2002.

Cited By

View all
  • (2018)Multimodal Semantics and Affective Computing from Multimedia ContentIntelligent Multidimensional Data and Image Processing10.4018/978-1-5225-5246-8.ch014(359-382)Online publication date: 2018
  • (2017)Conclusion and Future WorkMultimodal Analysis of User-Generated Multimedia Content10.1007/978-3-319-61807-4_8(235-260)Online publication date: 1-Sep-2017
  • (2017)Adaptive News Video UploadingMultimodal Analysis of User-Generated Multimedia Content10.1007/978-3-319-61807-4_7(205-234)Online publication date: 1-Sep-2017
  • Show More Cited By

Index Terms

  1. Image tag re-ranking by coupled probability transition

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '12: Proceedings of the 20th ACM international conference on Multimedia
    October 2012
    1584 pages
    ISBN:9781450310895
    DOI:10.1145/2393347
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 October 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. coupled probability transition
    2. image tag re-ranking

    Qualifiers

    • Poster

    Conference

    MM '12
    Sponsor:
    MM '12: ACM Multimedia Conference
    October 29 - November 2, 2012
    Nara, Japan

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2018)Multimodal Semantics and Affective Computing from Multimedia ContentIntelligent Multidimensional Data and Image Processing10.4018/978-1-5225-5246-8.ch014(359-382)Online publication date: 2018
    • (2017)Conclusion and Future WorkMultimodal Analysis of User-Generated Multimedia Content10.1007/978-3-319-61807-4_8(235-260)Online publication date: 1-Sep-2017
    • (2017)Adaptive News Video UploadingMultimodal Analysis of User-Generated Multimedia Content10.1007/978-3-319-61807-4_7(205-234)Online publication date: 1-Sep-2017
    • (2017)Lecture Video SegmentationMultimodal Analysis of User-Generated Multimedia Content10.1007/978-3-319-61807-4_6(173-203)Online publication date: 1-Sep-2017
    • (2017)Soundtrack Recommendation for UGVsMultimodal Analysis of User-Generated Multimedia Content10.1007/978-3-319-61807-4_5(139-171)Online publication date: 1-Sep-2017
    • (2017)Tag Recommendation and RankingMultimodal Analysis of User-Generated Multimedia Content10.1007/978-3-319-61807-4_4(101-138)Online publication date: 1-Sep-2017
    • (2017)Event UnderstandingMultimodal Analysis of User-Generated Multimedia Content10.1007/978-3-319-61807-4_3(59-99)Online publication date: 1-Sep-2017
    • (2017)Literature ReviewMultimodal Analysis of User-Generated Multimedia Content10.1007/978-3-319-61807-4_2(31-57)Online publication date: 1-Sep-2017
    • (2017)IntroductionMultimodal Analysis of User-Generated Multimedia Content10.1007/978-3-319-61807-4_1(1-30)Online publication date: 1-Sep-2017
    • (2016)Concept-Level Multimodal Ranking of Flickr Photo Tags via Recall Based WeightingProceedings of the 2016 ACM Workshop on Multimedia COMMONS10.1145/2983554.2983555(19-26)Online publication date: 16-Oct-2016

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media