Two-phase learning for biological event extraction and verification

Abstract

Many previous biological event-extraction systems were based on hand-crafted rules which were specifically tuned to a specific biological application domain. But manually constructing and tuning the rules are time-consuming processes and make the systems less portable. So supervised machine-learning methods were developed to generate the extraction rules automatically, but accepting the trade-off between precision and recall (high recall with low precision, and vice versa) is a barrier to improving performance. To make matters worse, a text in the biological domain is more complex because it often contains more than two biological events in a sentence, and one event in a noun chunk can be an entity for the other event. As a result, there are as yet no systems that give a good performance in extracting events in biological domains by using supervised machine learning.To overcome the limitations of previous systems and the complexity of biological texts, we present the following new ideas. First, we adopted a supervised machine-learning method to reduce the human effort in making extraction rules in order to obtain a highly domain-portable system. Second, we overcame the classical trade-off between precision and recall by using an event component verification method. Thus, machine learning occurs in two phases in our architecture. In the first phase, the system focuses on improving recall in extracting events between biological entities during a supervised machine-learning period. After extracting the biological events with automatically learned rules, in the second phase the system removes incorrect biological events by verifying the extracted event components with a maximum entropy (ME) classification method. In other words, the system targets for high recall in the first phase and tries to achieve high precision with a classifier in the second phase. Finally, we improved a supervised machine-learning algorithm so that it could learn a rule in a noun chunk and a rule extending throughout a sentence at two different levels, separately, for nested biological events.

References

1. Blaschke, C., Andrade, M. A., Ouzous, C., and Valencia, A. 1999. Automatic extraction of biological information from scientific text: Protein-protein interactions. Intelligent Systems for Molecular Biology, 60--67.
2. Bunescu, R., Ge, R., Kate, R. J., Marcotte, E. M., Mooney, R. J., Ramani. A. K., and Wong, Y. W. 2004. Comparative experiments on learning information extractors for proteins and their interactions. J. Artif. Intell. Medicine (Dec. 2004). Available online: http://www.sciencedirect.com/.
3. Daraselia, N., Yuryev, A., Egorov, S., Novichkova, S., Niktin, A., and Mazo, I. 2004. Extracting human protein interactions from MEDLINE using a full-sentence parser. Bioinformatics. 20, 604--611.
4. Gildea, D. 2001. Corpus variation and parser performance. In Proceedings of the Conference on Empirical Methods in Natural Language Processing.
5. Park, J. C., Kim, H. S., and Kim, J. J. 2001. Bidirectional incremental parsing for automatic pathway identification with combinatory categorical grammar. Pac. Symp. Biocomput.
6. Pustejovsky, J., Castano, J., Kotechi, M., and Cochran, B. 2002. Robust relational parsing over biomedical literature: Extracting inhibit relations. Pac. Symp. Biocomput. 362--373.
7. Rindflesch, T. C., Rayan, J. V., and Hunter, L. 2000. Extracting molecular binding relationships from biomedical text. In Applied Natural Language Processing. North American Chapter of the Association for Computational Linguistics, 188--195.
8. Rosenfeld, R. 1996. A maximum entropy approach to adaptive statistical language modeling. Computer, Speech and Language 10, 187--228.
9. Sekimizu, T., Park, H. S., and Tsuijii, J. 1998. Identifying the interaction between genes and gene products based on frequently seen verbs in Medline abstracts. In Proceedings of the Genome Informatics Workshop, 62--71.
10. Soderland, S. 1999. Learning information extraction rules for semi-structured and free text. Machine Learning 34, 233--272.
11. Thomas, J., Milward, D., Ousounis, C., Pulman, S., and Carroll, M. 2000. Automatic extraction of protein interactions from scientific abstracts. Pac. Symp. Biocomput. 5, 541--552.
12. Wu, J. 2002. Maximum entropy language modeling with non-local dependencies. Ph.D. thesis, Johns Hopkins University.
13. Yakushiji, A., Tateisi, Y., and Miyao, Y. 2001. Event extraction from biomedical papers using a full parser. Pac. Symp. Biocomput.
14. Zhang, T., Damerau, F., and Johnson, D. 2001. Text chunking using regularized Winnow. In Proceedings of the ACL Conference.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Natural language processing

      • Language resources