skip to main content
10.1145/1390334.1390495acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
poster

Bag-of-visual-words expansion using visual relatedness for video indexing

Published: 20 July 2008 Publication History

Abstract

Bag-of-visual-words (BoW) has been popular for visual classification in recent years. In this paper, we propose a novel BoW expansion method to alleviate the effect of visual word correlation problem. We achieve this by diffusing the weights of visual words in BoW based on visual word relatedness, which is rigorously defined within a visual ontology. The proposed method is tested in video indexing experiment on TRECVID-2006 video retrieval benchmark, and an improvement of 7% over the traditional BoW is reported.

References

[1]
J. J. Jiang and D. W. Conrath, Semantic similarity based on corpus statistics and lexical taxonomy. In Proc. of ROCLING X, 1997.
[2]
Y. G. Jiang, C. W. Ngo, and J. Yang,Towards optimal bag-of-features for object categorization and semantic video retrieval. In ACM CIVR, 2007.
[3]
D. Lowe, Distinctive image features from scale-invariant keypoints. IJCV, 60(2):91--110, 2004.
[4]
J. Sivic and A. Zisserman, Video google: A text retrieval approach to object matching in videos. In ICCV, 2003.
[5]
TREC Video Retrieval Evaluation (TRECVID). http://www-nlpir.nist.gov/projects/trecvid/.
[6]
J. Zhang and et al, Local features and kernels for classification of texture and object categories: A comprehensive study. IJCV, 73(2):213--238, 2007.

Cited By

View all
  • (2023)eBoF: Interactive Temporal Correlation Analysis for Ensemble Data Based on Bag-of-FeaturesIEEE Transactions on Big Data10.1109/TBDATA.2023.33244829:6(1726-1737)Online publication date: Dec-2023
  • (2015)Dimension reduction with meta object-groups for efficient image retrievalNeurocomputing10.1016/j.neucom.2014.08.105169(50-54)Online publication date: Dec-2015
  • (2014)Probabilistic hypergraph based hash codes for social image searchJournal of Zhejiang University SCIENCE C10.1631/jzus.C130026815:7(537-550)Online publication date: 12-Jul-2014
  • Show More Cited By

Index Terms

  1. Bag-of-visual-words expansion using visual relatedness for video indexing

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
      July 2008
      934 pages
      ISBN:9781605581644
      DOI:10.1145/1390334
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 20 July 2008

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. bag-of-visual-words
      2. expansion
      3. video indexing
      4. visual relatedness

      Qualifiers

      • Poster

      Conference

      SIGIR '08
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 792 of 3,983 submissions, 20%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)4
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 10 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)eBoF: Interactive Temporal Correlation Analysis for Ensemble Data Based on Bag-of-FeaturesIEEE Transactions on Big Data10.1109/TBDATA.2023.33244829:6(1726-1737)Online publication date: Dec-2023
      • (2015)Dimension reduction with meta object-groups for efficient image retrievalNeurocomputing10.1016/j.neucom.2014.08.105169(50-54)Online publication date: Dec-2015
      • (2014)Probabilistic hypergraph based hash codes for social image searchJournal of Zhejiang University SCIENCE C10.1631/jzus.C130026815:7(537-550)Online publication date: 12-Jul-2014
      • (2014)A Hamming Embedding Kernel with Informative Bag-of-Visual Words for Video Semantic IndexingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/253593810:3(1-20)Online publication date: 17-Apr-2014
      • (2014)Video Event Detection Using Motion Relativity and Feature SelectionIEEE Transactions on Multimedia10.1109/TMM.2014.231578016:5(1303-1315)Online publication date: Aug-2014
      • (2014)Informative visual words construction to improve bag of words image representationIET Image Processing10.1049/iet-ipr.2013.04498:5(310-318)Online publication date: May-2014
      • (2013)Visual-Textual Joint Relevance Learning for Tag-Based Social Image SearchIEEE Transactions on Image Processing10.1109/TIP.2012.220267622:1(363-376)Online publication date: 1-Jan-2013
      • (2013)Presenting diverse location views with real-time near-duplicate photo eliminationProceedings of the 2013 IEEE International Conference on Data Engineering (ICDE 2013)10.1109/ICDE.2013.6544851(505-516)Online publication date: 8-Apr-2013
      • (2013)Improvement the Bag of Words Image Representation Using Spatial InformationAdvances in Computing and Information Technology10.1007/978-3-642-31552-7_69(681-690)Online publication date: 2013
      • (2011)Pursuing the holy grail by interrelating user intentions and bag of visual words to perform retrieval adaptationProceedings of the 2011 ACM workshop on Social and behavioural networked media access10.1145/2072627.2072631(3-8)Online publication date: 1-Dec-2011
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media