skip to main content
10.1145/1526709.1526753acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

A generalised cross-modal clustering method applied to multimedia news semantic indexing and retrieval

Published: 20 April 2009 Publication History

Abstract

Current Web technology has enabled the distribution of informative content through dynamic media platforms.
In addition, the availability of the same content in the form of digital multimedia data has dramatically increased.
Content-based, cross-media retrieval applications are needed to efficiently access desired information from this variety of data sources. This paper presents a novel approach for cross-media information aggregation, and describes a prototype system implementing this approach. The prototype adopts online newspaper articles and TV newscasts as information sources, to deliver a service made up of items including both contributions. Extensive experiments prove the effectiveness of the proposed approach in a real-world business context.

References

[1]
J. W. Ahn, P. Brusilovsky, J. Grady, D. He, and S. Y.Syn. Open user profiles for adaptive news systems: help or harm? In Proc. of WWW07, pages 11--20,2007.
[2]
J. Arlandis, P. Over, and W. Kraaij. Boundary Error Analysis and Categorization in the TRECVID News Story Segmentation Task. In Proc. of CIVR05, pages 103--112, 2005.
[3]
R. Basili, M. Cammisa, and E. Donati. RitroveRAI: A Web Application for Semantic Indexing and Hyperlinking of Multimedia News. In Proc. of the Intl. Semantic Web Conf., pages 97--111, 2005.
[4]
L. Bolelli, S. Ertekin, D. Zhou, and C. L. Giles. K-svmeans: A hybrid clustering algorithm for multi-type interrelated datasets. In Proc. of Web Intelligence 2007, pages 198--204, 2007.
[5]
F. Brugnara, M. Cettolo, M. Federico, and D. Giuliani. A system for the segmentation and transcription of Italian radio news. In Proc. of RIAO, Content-Based Multimedia Information Access, 2000.
[6]
A. S. Das, M. Datar, A. Garg, and S. Rajaram. Google news personalization: scalable online collaborative filtering. In Proc. of WWW07, pages 271--280, 2007.
[7]
K. Deschacht and M.-F. Moens. Finding the Best Picture: Cross-Media Retrieval of Content. In Proc. of ECIR 2008, pages 539--546, 2008.
[8]
M. Di Iulio and A. Messina. Use of Probabilistic Clusters Supports for Broadcast News Segmentation. In DEXA Workshops, pages 600--604, 2008.
[9]
M. Farr¶us, P. Ejarque, A. Temko, and J. Hernando. Histogram equalization in svm multimodal person verification. In Proc. of the Intl. Conf. on Advances in Biometrics, pages 819--827, 2007.
[10]
M. Henzinger, B. wei Chang, B. Milch, and S. Brin. Query-free news search. In Proc. of WWW03, pages 1--10, 2003.
[11]
V. Kashyap and A. Sheth. Semantic and schematic similarities between database objects: a context-based approach. The VLDB Journal, 5(4):276--304, 1996.
[12]
X. Li, J. Yan, Z. Deng, L. Ji, W. Fan, B. Zhang, and Z. Chen. A novel clustering-based RSS aggregator. In Proc. of WWW07, pages 1309--1310, 2007.
[13]
A. Messina. An application of NLP and audiovisual content analysis for integration of multimodal databases of current events. In Proc. of NLDB08, pages 350--351, 2008.
[14]
A. Messina, R. Borgotallo, G. Dimino, D. A. Gnota, and L. Boch. Ants: A complete system for automatic news programme annotation based on multimodal analysis. In Proc. of WIAMIS 2008, 2008.
[15]
H. T. Pao, Y. Y. Xu, S. C. Chung, and H. C. Fu. Constructing and application of multimedia tv news archives. In Intl. Workshop on Multimedia Content Analysis and Mining, pages 151--160, 2007.
[16]
C. Wang, M. Zhang, S. Ma, and L. Ru. Automatic online news issue construction in web environment. In Proc. of WWW08, pages 457--466, 2008.
[17]
D. Webster, W. Huang, D. Mundy, and P. Warren. Context-orientated news filtering for web 2.0 and beyond. In Proc. of WWW06, pages 1001--1002, 2006.
[18]
X. Wu, J. Li, Y. Zhang, S. Tang, and S. Y. Neo. Personalized multimedia web summarizer for tourist. In Proc. of WWW08, pages 1025--1026, 2008.
[19]
C. Xu, J. Wang, H. Lu, and Y. Zhang. A novel framework for semantic annotation and personalized retrieval of sports video. IEEE Trans. on Multimedia, 10(3):421--436, 2008.
[20]
Y. Zhang, C. Xu, Y. Rui, J. Wang, and H. Lu. Semantic event extraction from basketball games using multi-modal analysis. In Proc. of the ICME 2007, pages 2190--2193, 2007.

Cited By

View all
  • (2020)CAESAR: concept augmentation based semantic representation for cross-modal retrievalMultimedia Tools and Applications10.1007/s11042-020-09983-381:24(34213-34243)Online publication date: 30-Oct-2020
  • (2019)Clustering and Its Extensions in the Social Media DomainAdaptive Resonance Theory in Social Media Data Clustering10.1007/978-3-030-02985-2_2(15-44)Online publication date: 1-May-2019
  • (2017)A framework to explore results in multiple media information aggregated searchMultimedia Tools and Applications10.1007/s11042-017-4769-876:24(25787-25826)Online publication date: 1-Dec-2017
  • Show More Cited By

Index Terms

  1. A generalised cross-modal clustering method applied to multimedia news semantic indexing and retrieval

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      WWW '09: Proceedings of the 18th international conference on World wide web
      April 2009
      1280 pages
      ISBN:9781605584874
      DOI:10.1145/1526709

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 20 April 2009

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. cross-modal clustering
      2. multimedia mashup
      3. news retrieval

      Qualifiers

      • Research-article

      Conference

      WWW '09
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)6
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 22 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2020)CAESAR: concept augmentation based semantic representation for cross-modal retrievalMultimedia Tools and Applications10.1007/s11042-020-09983-381:24(34213-34243)Online publication date: 30-Oct-2020
      • (2019)Clustering and Its Extensions in the Social Media DomainAdaptive Resonance Theory in Social Media Data Clustering10.1007/978-3-030-02985-2_2(15-44)Online publication date: 1-May-2019
      • (2017)A framework to explore results in multiple media information aggregated searchMultimedia Tools and Applications10.1007/s11042-017-4769-876:24(25787-25826)Online publication date: 1-Dec-2017
      • (2015)People News Search via Name-Face Association AnalysisProceedings of the 5th ACM on International Conference on Multimedia Retrieval10.1145/2671188.2749301(467-470)Online publication date: 22-Jun-2015
      • (2014)Semi-Supervised Heterogeneous Fusion for Multimedia Data Co-ClusteringIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2013.4726:9(2293-2306)Online publication date: Sep-2014
      • (2014)Multi-modal and Cross-Modal for Lecture Videos RetrievalProceedings of the 2014 22nd International Conference on Pattern Recognition10.1109/ICPR.2014.461(2667-2672)Online publication date: 24-Aug-2014
      • (2014)A one-shot domain-independent robust multimedia clustering methodology based on hybrid multimodal fusionMultimedia Tools and Applications10.1007/s11042-013-1655-x73:3(1507-1543)Online publication date: 1-Dec-2014
      • (2013)Multi-modal Information Integration for Document RetrievalProceedings of the 2013 12th International Conference on Document Analysis and Recognition10.1109/ICDAR.2013.243(1200-1204)Online publication date: 25-Aug-2013
      • (2013)A semi-automatic text-based semantic video annotation system for Turkish facilitating multilingual retrievalExpert Systems with Applications: An International Journal10.1016/j.eswa.2012.12.04840:9(3398-3411)Online publication date: 1-Jul-2013
      • (2013)Hyper Media NewsMultimedia Tools and Applications10.1007/s11042-011-0859-163:2(427-460)Online publication date: 1-Mar-2013
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media