Scoring missing terms in information retrieval tasks

ABSTRACT

An usual approach to address mismatching vocabulary problem is to augment the original query using dictionaries and other lexical resources and/or by looking at pseudo-relevant documents. Either way, terms are added to form a new query that will be used to score all documents in a subsequent retrieval pass, and as consequence the original query's focus may drift because of the newly added terms. We propose a new method to address the mismatching vocabulary problem, expanding original query terms only when necessary and complementing the user query for missing terms while scoring documents. It allows related semantic aspects to be included in a conservative and selective way, thus reducing the possibility of query drift. Our results using replacements for the <i>missing query terms</i> in modified document and passages retrieval methods show significant improvement over the original ones.

REFERENCES

• 1: Adam Berger , John Lafferty, Information retrieval as statistical translation, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.222-229, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312681]
• 2: C. Buckley, G. Salton, J. Allan, and A. Singhal. Automatic query expansion using SMART: TREC 3. In In proceedings of Third Text REtrieval Conference Gaithersburg, MD, 1994.
• 3: David Carmel , Eitan Farchi , Yael Petruschka , Aya Soffer, Automatic query wefinement using lexical affinities with maximal information gain, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564427]
• 4: C. L. A. Clarke , G. V. Cormack , M. Laszlo , T. R. Lynam , E. L. Terra, The impact of corpus size on question answering performance, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564448]
• 5: Charles L. A. Clarke , Gordon V. Cormack , Thomas R. Lynam, Exploiting redundancy in question answering, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.358-365, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.384024]
• 6: C. L. A. Clarke, G. V. Cormack, T. R. Lynam, and E. Terra. Advances in Open Domain Question Answering chapter Question answering by passage selection. Kluwer Academic Publishers. To appear, 2004.
• 7: Kevyn Collins-Thompson , Jamie Callan , Egidio Terra , Charles L.A. Clarke, The effect of document retrieval quality on factoid question answering performance, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009127]
• 8: Carolyn J. Crouch , Donald B. Crouch , Qingyan Chen , Steven J. Holtz, Improving the retrieval effectiveness of very short queries, Information Processing and Management: an International Journal, v.38 n.1, p.1-36, January 2002 [doi>10.1016/S0306-4573(01)00023-1 ]
• 9: Kareem Darwish , Douglas W. Oard, Probabilistic structured query methods, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860497]
• 10: J. Firth. Studies In Linguistic Analisys chapter A Synopsis of Linguistic Theory, 1930-1955, pages 1--32. Basil Blackwell, Oxford, 3rd edition, 1957.
• 11: Jianfeng Gao , Ming Zhou , Jian-Yun Nie , Hongzhao He , Weijun Chen, Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependence relations, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564409]
• 12: K. Sparck Jones , S. Walker , S. E. Robertson, A probabilistic model of information retrieval: development and comparative experiments Part 2, Information Processing and Management: an International Journal, v.36 n.6, p.809-840, Nov.06.2000 [doi>10.1016/S0306-4573(00)00016-9 ]
• 13: Victor Lavrenko , W. Bruce Croft, Relevance based language models, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.120-127, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383972]
• 14: J. Lin, A. Fernandes, B. Katz, G. Marton, and S. Tellex. Extracting answers from the web using data annotation an knowledge mining techniques. In The Eleventh Text REtrieval Conference (TREC 2002), Gaithersburg, MD, 2002.
• 15: Mandar Mitra , Amit Singhal , Chris Buckley, Improving automatic query expansion, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.206-214, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290995]
• 16: Jay M. Ponte , W. Bruce Croft, A language modeling approach to information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.275-281, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.291008]
• 17: J. Rocchio. The SMART Retrieval System: Experiments in Automatic Document Processing chapter Relevance feedback in information retrieval, pages 313--323. Prentice-Hall Inc., 1971.
• 18: G. Salton , A. Wong , C. S. Yang, A vector space model for automatic indexing, Communications of the ACM, v.18 n.11, p.613-620, Nov. 1975 [doi>10.1145/361219.361220]
• 19: P. Schäuble and P. Sheridan. Cross-language information retrieval (clir) track overview. In The Sixth Text REtrieval Conference (TREC 6), Gaithersburg, MD, 1997.
• 20: Stefanie Tellex , Boris Katz , Jimmy Lin , Aaron Fernandes , Gregory Marton, Quantitative evaluation of passage retrieval algorithms for question answering, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860445]
• 21: E. Terra and C. L. Clarke. Fast computation of lexical affinity models. In Proceedings of the 20th International Conference on Computational Linguistics (COLING), 2004.
• 22: Egidio Terra , C. L. A. Clarke, Frequency estimates for statistical word similarity measures, Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, p.165-172, May 27-June 01, 2003, Edmonton, Canada [doi>10.3115/1073445.1073477]
• 23: Peter D. Turney, Mining the Web for Synonyms: PMI-IR versus LSA on TOEFL, Proceedings of the 12th European Conference on Machine Learning, p.491-502, September 05-07, 2001
• 24: Jinxi Xu , W. Bruce Croft, Improving the effectiveness of information retrieval with local context analysis, ACM Transactions on Information Systems (TOIS), v.18 n.1, p.79-112, Jan. 2000 [doi>10.1145/333135.333138]
• 25: Jinxi Xu , W. Bruce Croft, Corpus-based stemming using cooccurrence of word variants, ACM Transactions on Information Systems (TOIS), v.16 n.1, p.61-81, Jan. 1998 [doi>10.1145/267954.267957]
• 26: D. L. Yeung, C. L. A. Clarke, G. V. Cormack, T. R. Lynam, and E. Terra. Task-specific query expansion (multitext experiments for trec 2003). In 2002 Text REtrieval Conference Gaithersburg, MD, 2003.
• 27: Chengxiang Zhai , John Lafferty, Model-based feedback in the language modeling approach to information retrieval, Proceedings of the tenth international conference on Information and knowledge management, October 05-10, 2001, Atlanta, Georgia, USA [doi>10.1145/502585.502654]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Experimentation, Performance

Keywords:
automatic query expansion, document retrieval, passage retrieval