Question-answering by predictive annotation

ABSTRACT

We present a new technique for question answering called Predictive Annotation. Predictive Annotation identifies potential answers to questions in text, annotates them accordingly and indexes them. This technique, along with a complementary analysis of questions, passage-level ranking and answer selection, produces a system effective at answering natural-language fact-seeking questions posed against large document collections. Experimental results show the effects of different parameter settings and lead to a number of general observations about the question-answering problem.

REFERENCES

• 1: AAAI Fall Symposium on Question Answering, North Falmouth, MA, 1999.
• 2: R. Byrd and Y. Ravin. "Identifying and Extracting Relations in Text", Proceedings of NLDB 99, Klagenfurt, Austria.
• 3: V. Chaudhri and R. Fikes. Question answering systems: Papers from the 1999 AAAI fall symposium. Technical Report FS-99-02, AAAI Press, 1999.
• 4: Fred J. Damerau, Problems and some solutions in customization of natural language database front ends, ACM Transactions on Information Systems (TOIS), v.3 n.2, p.165-184, April 1985 [doi>10.1145/3914.3915]
• 5: D. Harman and E. Voorhees, editors. The Eighth Text REtrieval Conference (TREC-8), Gaithersburg, MD, 2000. National Institute of Standards and Technology Special Publication.
• 6: D. Hawking, N. Craswell, and P. Thistlewaite. Overview of TREC-7 very large collection track. In D. K. Harman and E. M. Voorhees, editors, The Seventh Text REtrieval Conference (TREC-7), pages 91-104, Gaithersburg, MD, 1999. National Institute of Standards and Technology Special Publication 500-242.
• 7: Vladimir A. Kulyukin , Kristian J. Hammond , Robin D. Burke, Answering questions for an organization online, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.532-537, July 1998, Madison, Wisconsin, United States
• 8: Julian Kupiec, MURAX: a robust linguistic approach for question answering using an on-line encyclopedia, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.181-190, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160717]
• 9: George A. Miller, WordNet: a lexical database for English, Communications of the ACM, v.38 n.11, p.39-41, Nov. 1995 [doi>10.1145/219717.219748]
• 10: Proc. of the Sixth Message Understanding Conference (MUC-6), November 1995, San Francisco: Morgan Kaufmann.
• 11: E. Rosch et al. "Basic Objects in Natural Categories", Cognitive Psychology 8, 382-439, 1976.
• 12: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 13: R. Sfihari and W. Li. "Question Answering Supported by Information Extraction", Proceedings of TREC8, Gaithersburg, Md., 1999.
• 14: TREC Q&A Evaluation official Web site: http://www.research.att.com/~singhal/qatrack.htrnl
• 15: Efraim Turban , Jay Aronson, Decision Support Systems and Intelligent Systems, Prentice Hall PTR, Upper Saddle River, NJ, 1997
• 16: Ellen M. Voorhees, Query expansion using lexical-semantic relations, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.61-69, July 03-06, 1994, Dublin, Ireland
• 17: Nina Wacholder , Yael Ravin , Misook Choi, Disambiguation of proper names in text, Proceedings of the fifth conference on Applied natural language processing, p.202-208, March 31-April 03, 1997, Washington, DC [doi>10.3115/974557.974587]
• 18: Ian H. Witten , Alistair Moffat , Timothy C. Bell, Managing gigabytes (2nd ed.): compressing and indexing documents and images, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 19: E.W. Brown and H.A. Chong. The Guru System in TREC-6. Proceedings of TREC6, Gaithersburg, MD, 1998.
• 20: J.M. Prager, D. Radev, E.W. Brown and A.R. Coden. "The Use of Predictive Annotation for Question-Answering in TREC8", Proceedings of TREC8, Gaithersburg, MD., 2000.
• 21: Dragomir R. Radev , John Prager , Valerie Samn, Ranking suspected answers to natural language questions using predictive annotation, Proceedings of the sixth conference on Applied natural language processing, p.150-157, April 29-May 04, 2000, Seattle, Washington [doi>10.3115/974147.974168]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

Additional Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Text processing
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.5 Document Capture
          Subjects: Document analysis

General Terms:
Design, Experimentation, Human Factors, Theory