Cross-Language Information Propagation for Arabic Mention Detection

Abstract

In the last two decades, significant effort has been put into annotating linguistic resources in several languages. Despite this valiant effort, there are still many languages left that have only small amounts of such resources. The goal of this article is to present and investigate a method of propagating information (specifically mention detection) from a resource-rich language into a relatively resource-poor language such as Arabic. Part of the investigation is to quantify the contribution of propagating information in different conditions based on the availability of resources in the target language. Experiments on the language pair Arabic-English show that one can achieve relatively decent performance by propagating information from a language with richer resources such as English into Arabic alone (no resources or models in the source language Arabic). Furthermore, results show that propagated features from English do help improve the Arabic system performance even when used in conjunction with all feature types built from the source language. Experiments also show that using propagated features in conjunction with lexically derived features only (as can be obtained directly from a mention annotated corpus) brings the system performance at the one obtained in the target language by using feature derived from many linguistic resources, therefore improving the system when such resources are not available. In addition to Arabic-English language pair, we investigate the effectiveness of our approach on other language pairs such as Chinese-English and Spanish-English.

References

1. Al-Onaizan, Y. and Papineni, K. 2006. Distortion models for statistical machine translation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (ACL’06). 529--536.
2. Benajiba, Y. and Zitouni, I. 2010. Morphology-based segmentation combination for arabic mention detection. Trans. Asian. Lang, Inform. Process. 8, 4.
3. Berger, A., Della Pietra, S., and Della Pietra, V. 1996. A maximum entropy approach to natural language processing. Comput. Linguist. 22, 1, 39--71.
4. Brown, P. F., Pietra, S., Pietra, V. D., and Mercer, R. L. 1991. Word-sense disambiguation using statistical methods. In Proceedings of the Association for Computational Linguistics (ACL’91).
5. Cabezas, C., Dorr, B., and Resnik, P. 2001. Spanish language processing at University of Maryland: Building infrastructure for multilingual applications. In Proceedings of the 2nd International Workshop on Spanish Language Processing and Language Technologies (SNLP’01).
6. Chen, S. and Rosenfeld, R. 2000. A survey of smoothing techniques for me models. IEEE Trans. Speech Audio Proc.
7. Dagan, I. and Itai, A. 1994. Word sense disambiguation using a second language monolingual corpus. Comput. Linguist. 20, 4, 563--596.
8. Dagan, I., Itai, A., and Schwall, U. 1991. Two languages are more informative than one. In Proceedings of the Meeting of the Association for Computational Linguistics (ACL’91). 130--137.
9. Diab, M., Hacioglu, K., and Jurafsky, D. 2004. Automatic tagging of Arabic text: From raw text to base phrase chunks. In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL’04).
10. Diab, M. and Resnik, P. 2001. An unsupervised method for word sense tagging using parallel corpora. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics (ACL’02). 255--262.
11. Florian, R., Hassan, H., Ittycheriah, A., Jing, H., Kambhatla, N., Luo, X., Nicolov, N., and Roukos, S. 2004. A statistical model for multilingual entity detection and tracking. In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL’04). 1--8.
12. Gale, W., Church, K., and Yarowsky, D. 1992. A method for disambiguating word senses in a large corpus. Comput. Hum. 26, 415--439.
13. Goodman, J. 2002. Sequential conditional generalized iterative scaling. In Proceedings of the Association for Computational Linguistics (ACL’02).
14. Grefenstette, G. 1998. Cross-Language Information Retrieval. Kluwer Academic Publishers.
15. Huang, F. and Papineni, K. 2007. Hierarchical system combination for machine translation. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL’07). 277--286.
16. Hwa, R., Resnik, P., and Weinberg, A. 2002. Breaking the resource bottleneck for multilingual parsing. In Proceedings of the Workshop on Linguistic Knowledge Acquisition and Representation: Bootstrapping Annotated Language Data (LREC’02).
17. Jing, H., Florian, R., Luo, X., Zhang, T., and Ittycheriah, A. 2003. How to get a Chinese Name (Entity): Segmentation and combination issues. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing (EMNLP’03). 200--207.
18. Koehn, P. 2004. Pharaoh: A beam search decoder for phrase-based statistical machine translation models. In Proceedings of the Association for Machine Translation in the Americas (AMTA’04).
19. Lee, Y.-S., Al-Onaizan, Y., Papineni, K., and Roukos, S. 2006. IBM spoken language translation system. In TC-STAR Workshop on Speech-to-Speech Translation (SST’06). 13--18.
20. Lee, Y.-S., Papineni, K., Roukos, S., Emam, O., and Hassan, H. 2003. Language model based Arabic word segmentation. In Proceedings of the Association for Computational Linguistics (ACL’03). 399--406.
21. Mihalcea, R. 1998. Semcor semantically tagged corpus. http://www.cse.unt.edu/rada/downloads.html.
22. Miller, G. A. 1995. WordNet: A lexical database. Comm. ACM 38, 11.
23. NIST. 2007. The ACE evaluation plan. www.nist.gov/speech/tests/ace/index.htm.
24. Noreen, E. W. 1989. Computer-Intensive Methods for Testing Hypotheses. John Wiley & Sons.
25. Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. 2002. Bleu: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL’02). 311--318.
26. Ramshaw, L. and Marcus, M. 1994. Exploring the statistical derivation of transformational rule sequences for part-of-speech tagging. In Proceedings of the ACL Workshop on Combining Symbolic and Statistical Approaches to Language (ACL/EACL’94).
27. Ramshaw, L. and Marcus, M. 1995. Text chunking using transformation-based learning. In Proceedings of the 3rd Workshop on Very Large Corpora (WVLC’95). D. Yarowsky and K. Church, Eds. Association for Computational Linguistics. 82--94.
28. Riloff, E., Schafer, C., and Yarowsky, D. 2002. Inducing information extraction systems for new languages via cross-language projection. In Proceedings of the International Conference on Computer Linguistics (COLING’02).
29. Tjong Kim Sang, E. F. 2002. Introduction to the CONLL-2002 shared task: Language-independent named entity recognition. In Proceedings of the International Conference on Computer Linguistics (COLING’02). 155--158.
30. Tjong Kim Sang, E. F. and Veenstra, J. 1999. Representing text chunks. In Proceedings of the Conference on the European Chapter of the Association for Computational Linguistics (EACL’99).
31. Toutanova, K., Klein, D., Manning, C., and Singer, Y. 2003. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proceedings of the Human Language Technology Conference/North American Chapter of the Association for Computational Linguistics (HLT-NAACL’03).
32. Yarowsky, D., Ngai, G., and Wicentowski, R. 2001. Inducing multilingual text analysis tools via robust projection across aligned corpora. In Proceedings of the Conference on Human Language Technology (HLT’01).
33. Zitouni, I. and Florian, R. 2008. Mention detection crossing the language barrier. In Proceedings of the Joint Meeting of the Conference on Empirical Methods in Natural Language Processing (EMNLP’08).
34. Zitouni, I., Sorensen, J., Luo, X., and Florian, R. 2005. The impact of morphological stemming on Arabic mention detection and coreference resolution. In Proceedings of the ACL Workshop on Computational Approaches to Semitic Languages (CASL’05). 63--70.