skip to main content
review-article

TREC-CHEM: large scale chemical information retrieval evaluation at TREC

Published: 14 December 2009 Publication History

Abstract

Over the past decades, significant progress has been made in Information Retrieval (IR), ranging from efficiency and scalability to theoretical modeling and evaluation. However, many grand challenges remain. Recently, more and more attention has been paid to the research in domain specific IR applications, as evidenced by the organization of Genomics and Legal tracks in the Text REtrieval Conference (TREC). Now it is the right time to carry out large scale evaluations on chemical datasets in order to promote the research in chemical IR in general and chemical Patent IR in particular. Accordingly, we organize a chemical IR track in TREC (TREC-CHEM) in order to address the challenges in chemical and patent IR. This paper describes these challenges and the accomplishments of the first year and opens up the discussions for the next year.

References

[1]
Information Retrieval Facility Newsletter - Special Issue: Chemistry. http://www.irfacility.org/the irf/newsletter, October 2009.
[2]
E. Yilmaz, E. Kanoulas, and J.A. Aslam. A simple and efficient sampling method for estimating AP and NDCG. In SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, pages 603--610, New York, NY, USA, 2008. ACM.
[3]
J. Zobel, A. Moffat, and L. Park. Against Recall: Is it Persistence, Cardinality, Density, Coverage, or Totality. SIGIR Forum, 43(1), June 2009.

Cited By

View all
  • (2025)LLM-based IR-system for bank supervisorsKnowledge-Based Systems10.1016/j.knosys.2024.112914310(112914)Online publication date: Feb-2025
  • (2024)Exploring ChatGPT for next-generation information retrieval: Opportunities and challengesWeb Intelligence10.3233/WEB-23036322:1(31-44)Online publication date: 26-Mar-2024
  • (2024)Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and ChallengesACM Computing Surveys10.1145/364847156:7(1-33)Online publication date: 14-Feb-2024
  • Show More Cited By

Index Terms

  1. TREC-CHEM: large scale chemical information retrieval evaluation at TREC

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM SIGIR Forum
        ACM SIGIR Forum  Volume 43, Issue 2
        December 2009
        79 pages
        ISSN:0163-5840
        DOI:10.1145/1670564
        Issue’s Table of Contents

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 14 December 2009
        Published in SIGIR Volume 43, Issue 2

        Check for updates

        Qualifiers

        • Review-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)6
        • Downloads (Last 6 weeks)1
        Reflects downloads up to 30 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2025)LLM-based IR-system for bank supervisorsKnowledge-Based Systems10.1016/j.knosys.2024.112914310(112914)Online publication date: Feb-2025
        • (2024)Exploring ChatGPT for next-generation information retrieval: Opportunities and challengesWeb Intelligence10.3233/WEB-23036322:1(31-44)Online publication date: 26-Mar-2024
        • (2024)Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and ChallengesACM Computing Surveys10.1145/364847156:7(1-33)Online publication date: 14-Feb-2024
        • (2024)Utilizing passage‐level relevance and kernel pooling for enhancing BERT‐based document rerankingComputational Intelligence10.1111/coin.1265640:3Online publication date: 7-Jun-2024
        • (2024)A multi-dimensional semantic pseudo-relevance feedback framework for information retrievalScientific Reports10.1038/s41598-024-82871-014:1Online publication date: 30-Dec-2024
        • (2020)Automatically transforming full length biomedical articles into search queries for retrieving related articlesEgyptian Informatics Journal10.1016/j.eij.2020.04.004Online publication date: May-2020
        • (2019)Patent retrieval: a literature reviewKnowledge and Information Systems10.1007/s10115-018-1322-761:2(631-660)Online publication date: 1-Nov-2019
        • (2019)Multilingual Patent Text Retrieval Evaluation: CLEF–IPInformation Retrieval Evaluation in a Changing World10.1007/978-3-030-22948-1_15(365-387)Online publication date: 14-Aug-2019
        • (2017)Information Retrieval and Text Mining Technologies for ChemistryChemical Reviews10.1021/acs.chemrev.6b00851117:12(7673-7761)Online publication date: 5-May-2017
        • (2017)Retrieval Models Versus RetrievabilityCurrent Challenges in Patent Information Retrieval10.1007/978-3-662-53817-3_7(185-212)Online publication date: 26-Mar-2017
        • Show More Cited By

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media