Finding relevant documents using top ranking sentences: an evaluation of two alternative schemes

ABSTRACT

In this paper we present an evaluation of techniques that are designed to encourage web searchers to interact more with the results of a web search. Two specific techniques are examined: the presentation of sentences that highly match the searcher's query and the use of implicit evidence. Implicit evidence is evidence captured from the searcher's interaction with the retrieval results and is used to automatically update the display. Our evaluation concentrates on the effectiveness and subject perception of these techniques. The results show, with statistical significance, that the techniques are effective and efficient for information seeking.

References

1. P. Borlund. Experimental components for the evaluation of interactive information retrieval systems. Journal of Documentation. 56. 1. pp 71--90. 2000.
2. A.L. Berger and V.O. Mittal. OCELOT: A System for Summarizing Web Pages. Proceedings of 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. pp 144--151. Athens 2000.
3. H. Fowkes and M. Beaulieu. Interactive searching behaviour: Okapi experiment for TREC-8. Proceedings of 22nd BCS-IRSG European Colloquium on IR Research. Electronic Workshops in Computing. Cambridge. 2000.
4. W. C. Hill, J. D. Hollan, D. Wroblewski, and Tim McCandless. Edit Wear and Read Wear. Proceedings of ACM SIGCHI'92. pp 3-9. 1992.
5. B. J. Jansen, A. Spink, and T. Saracevic. Real life, real users, and real needs: a study and analysis of user queries on the web. Information Processing and Management. 36. 2. pp 207--227. 2000.
6. M. Magennis and C. J. van Rijsbergen. The potential and actual effectiveness of interactive query expansion. Proceedings of the 20th International ACM SIGIR Conference on Research and Development in Information Retrieval pp 324--332. Philadelphia. 1997.
7. D. Oard and J. Kim. Implicit feedback for recommender systems. Proceedings of the AAAI Workshop on Recommender System. Madison, Wisconsin. 1998.
8. S. Robertson. On term selection for query expansion. Journal of Documentation. 46. pp 359--364. 1990.
9. R. W. White, I. Ruthven and J. M. Jose. The use of implicit evidence for relevance feedback in web retrieval. Proceedings of 24th BCS-IRSG European Colloquium on IR Research. Lecture notes in Computer Science 2291. pp 93--109. Glasgow. 2002.
10. R. W. White, J. M. Jose and I. Ruthven. A task-oriented study on the influencing effects of query-biased summarisation in web searching. Information Processing and Management. 2002. in press.

Index Terms

• Information systems

  • Information retrieval

    • Evaluation of retrieval results

      • Relevance assessment

    • Information retrieval query processing