skip to main content
10.1145/1178677.1178721acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Benchmarking multimedia search in structured collections

Published: 26 October 2006 Publication History

Abstract

Structured document retrieval allows for the retrieval of document fragments as well as for the exploitation of relationships between document parts for identifying relevant information. This type of retrieval is studied at INEX,the initiative for the evaluation of XML retrieval. The INEX multimedia track provides an evaluation platform for the retrieval of multimedia document fragments.The track focuses on using the structure of the document to extract,relate, and combine the relevance of different multimedia fragments. This paper details the setup of this track. We discuss the document collections,the topics,the tasks and the assessment procedure. In addition results of the first running of this track in 2005 are summarised.

References

[1]
C. Buckley and E.M. Voorhees. Retrieval evaluation with incomplete information.In SIGIR 2004: Proceedings of the 27th annual international ACM SIGIR conference on Research and Development in Information Retrieval pages 25--32, New York, NY, USA, 2004.ACM Press.
[2]
C. W. Cleverdon. The cran field tests on index language devices. Aslib Proceedings pages 173--192, 1967.
[3]
L. Denoyer and P. Gallinari. The Wikipedia XML Corpus. SIGIR Forum 2006.
[4]
D. N. F. A. Iskandar, J. Pehcevski, J. A. Thom, and S. M. M. Tahaghoghi. Combining image and structured text retrieval. In Advances in XML Information Retrieval and Evaluation: 4th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2005 volume 3977 of Lecture Notes in Computer Science pages 525--539, Januari 2006.
[5]
Z. Kong and M. Lalmas. Xml multimedia retrieval. In SPIRE pages 218--223,2005.
[6]
W. Kraaij, A. Smeaton, P. Over, and J. Arlandis. Trecvid 2004 --an introduction. In TREC Video Retrieval Evaluation Online Proceedings 2004.
[7]
J. List, V. Mihajlovic, G. Ramirez, A. P. de Vries, D. Hiemstra, and H. E. Blok. TIJAH: Embracing IR Methods in XML Databases. Information Retrieval Journal toappear.
[8]
V. Mihajlovi, G. Ramrez, T. Westerveld, D. Hiemstra, H. E. Blok, and A. P. de Vries. Tijah scratches inex 2005: Vague element selection,image search, overlap, and relevance feedback. In dvances in XML Information Retrieval and Evaluation: 4th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2005 volume 3977 of Lecture Notes in Computer Science pages 72--87, January 2006.
[9]
R. U. S. of Computer Science and I. Technology. Wikipedia cbir system for the multimedia track. http://www.cs.rmit.edu.au/
[10]
P. over, T. Ianeva, W. Kraaij, and A. F. Smeaton. TRECVID 2005: An overview. In TREC Video Retrieval Evaluation Online Proceedings 2005.
[11]
A. F. Smeaton, W. Kraaij, and P. Over. TRECVID 2003 - an introduction. In A. F. Smeaton, W. Kraaij, and P. Over, editors, TRECVID 2003 Workshop Gaithersburg, MD, USA, 2003. NIST, NIST Special Publications.
[12]
C. Snoek, M. Worring, J. van Gemert, J. Geusebroek, and A. Smeulders. The challenge problem for automated detection of 101 semantic concepts in multimedia. In ACM Multimedia Conference 2006.
[13]
M. Theobald, R. Schenkel, and G. Weikum. An efficient and versatile query engine for topx search. In VLDB '05: Proceedings of the 31st international conference on Very large data bases pages 625--636. VLDB Endowment, 2005.
[14]
D. Tjondronegoro, J. Zhang, J. Gu, A. Nguyen, and S.Geva. Integrating text retrieval and image retrieval in xml document searching. In Advances in XML Information Retrieval and Evaluation: 4th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2005 volume 3977 of Lecture Notes in Computer Science pages 511--524, Januari 2006.
[15]
A. Trotman and B. Sigurbjörnsson. Narrowed extended xpath i (NEXI). In N. Fuhr, M. Lalmas, S. aadia Malik, and Z. Szlavik, editors, Advances in XML Information Retrieval: Third International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2004, Dagstuhl Castle, Germany, December 6-8, 2004, Revised Selected Papers volume 3493. Springer-Verlag GmbH, may 2005.http://www.springeronline.com/3-540-26166-4.
[16]
J. C. van Gemert, J. -M. Geusebroek, C. J. Veenman, C.G. Snoek, and A. W. Smeulders. Robust scene categorization by learning image statistics in context. In CVPR Workshop on Semantic Learning Applications in Multimedia New York, USA, June 2006.
[17]
R. van Zwol. Multimedia strategies for b3-sdr, based on principal component analysis.In Advances in XML Information Retrieval and Evaluation: 4th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2005 volume 3977 of Lecture Notes in Computer Science pages 540--553, Januari 2006.
[18]
R. van Zwol, G. Kazai, and M. Lalmas. Inex 2005 multimedia track. In Advances in XML Information Retrieval Lecture Notes in Computer Science. Springer, 2006.
[19]
E. M. Voorhees and D. K. Harman, editors. Experiment and Evaluation in Information Retrieval MIT press,2005.

Cited By

View all
  • (2006)Human performance measures for video retrievalProceedings of the 8th ACM international workshop on Multimedia information retrieval10.1145/1178677.1178720(307-312)Online publication date: 26-Oct-2006
  • (2006)Benchmarking image and video retrievalProceedings of the 8th ACM international workshop on Multimedia information retrieval10.1145/1178677.1178718(297-300)Online publication date: 26-Oct-2006

Index Terms

  1. Benchmarking multimedia search in structured collections

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MIR '06: Proceedings of the 8th ACM international workshop on Multimedia information retrieval
    October 2006
    344 pages
    ISBN:1595934952
    DOI:10.1145/1178677
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 October 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. INEX
    2. XML retrieval
    3. benchmarking
    4. multimedia retrieval

    Qualifiers

    • Article

    Conference

    MM06
    MM06: The 14th ACM International Conference on Multimedia 2006
    October 26 - 27, 2006
    California, Santa Barbara, USA

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 18 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2006)Human performance measures for video retrievalProceedings of the 8th ACM international workshop on Multimedia information retrieval10.1145/1178677.1178720(307-312)Online publication date: 26-Oct-2006
    • (2006)Benchmarking image and video retrievalProceedings of the 8th ACM international workshop on Multimedia information retrieval10.1145/1178677.1178718(297-300)Online publication date: 26-Oct-2006

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media