Query-free news search

ABSTRACT

Many daily activities present information in the form of a stream of text, and often people can benefit from additional information on the topic discussed. TV broadcast news can be treated as one such stream of text; in this paper we discuss finding news articles on the web that are relevant to news currently being broadcast.We evaluated a variety of algorithms for this problem, looking at the impact of inverse document frequency, stemming, compounds, history, and query length on the relevance and coverage of news articles returned in real time during a broadcast. We also evaluated several postprocessing techniques for improving the precision, including reranking using additional terms, reranking by document similarity, and filtering on document similarity. For the best algorithm, 84%-91% of the articles found were relevant, with at least 64% of the articles being on the exact topic of the broadcast. In addition, a relevant article was found for at least 70% of the topics.

REFERENCES

• 1: James Allan , Rahul Gupta , Vikas Khandelwal, Temporal summaries of new topics, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.10-18, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383954]
• 2: CORPORATE Electronic Industries Association of Japan, Electronic industries in Japan; 1984 ed., Electronic Industries Association of Japan, Tokyo, Japan, 1984
• 3: Eric Brill, Transformation-based error-driven learning and natural language processing: a case study in part-of-speech tagging, Computational Linguistics, v.21 n.4, p.543-565, December 1995
• 4: S. Brin, R. Motwani, L. Page, and T. Winograd. What can you do with a web in your pocket? Data Engineering Bulletin, 21(2):37--47, 1998.
• 5: J. Budzik, K. Hammond, and L. Birnbaum. Information access in context. Knowledge based systems, 14(1-2):37--53, 2001.
• 6: J. Davis. Intercast dying of neglect. CNET News, January 29, 1997.
• 7: Eibe Frank , Gordon W. Paynter , Ian H. Witten , Carl Gutwin , Craig G. Nevill-Manning, Domain-Specific Keyphrase Extraction, Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, p.668-673, July 31-August 06, 1999
• 8: Peter E. Hart , Jamey Graham, Query-Free Information Retrieval, IEEE Expert: Intelligent Systems and Their Applications, v.12 n.5, p.32-37, September 1997 [doi>10.1109/64.621226 ]
• 9: B. Krulwich and C. Burkey. Learning user information interests through the extraction of semantically significant phrases. In AAAI 1996 Spring Symposium on Machine Learning in Information Access, 1996.
• 10: H. Lieberman. Letizia: An agent that assists web browsing. In C. S. Mellish, editor, Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI-95), pages 924-929, 1995.
• 11: Paul P. Maglio , Rob Barrett , Christopher S. Campbell , Ted Selker, SUITOR: an attentive information system, Proceedings of the 5th international conference on Intelligent user interfaces, p.169-176, January 09-12, 2000, New Orleans, Louisiana, United States [doi>10.1145/325737.325821]
• 12: A. Munoz. Compound key word generation from document databases using a hierarchical clustering art model. Intelligent Data Analysis, 1(1), 1997.
• 13: Morgan N. Price , Gene Golovchinsky , Bill N. Schilit, Linking by inking: trailblazing in a paper-like hypertext, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.30-39, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276631]
• 14: B. J. Rhodes , P. Maes, Just-in-time information retrieval agents, IBM Systems Journal, v.39 n.3-4, p.685-704, July 2000
• 15: Bradley James Rhodes , Pattie Maes, Just-in-time information retrieval, 2000
• 16: S. Robertson, S. Walker, and M. Beaulieu. Okapi at TREC-7: automatic ad hoc, filtering, VLC and interactive track. In Proceedings of the 7th International Text Retrieval Conference (TREC), pages 253--264, 1999.
• 17: G.D. Robson. Closed captions, V-chip, and other VBI data. Nuts and Volts, 2000.
• 18: G. Salton, The SMART Retrieval System—Experiments in Automatic Document Processing, Prentice-Hall, Inc., Upper Saddle River, NJ, 1971
• 19: A.M. Steier and R.K. Belew. Exporting phrases: A statistical analysis of topical language. In Second Symposium on Document Analysis and Information Retrieval, pages 179--190, 1993.
• 20: Peter D. Turney, Learning Algorithms for Keyphrase Extraction, Information Retrieval, v.2 n.4, p.303-336, May 2000 [doi>10.1023/A:1009976227802 ]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.5 On-line Information Services

General Terms:
Algorithms, Experimentation

Keywords:
query-free search, web information retrieval