Intelligent GP fusion from multiple sources for text classification

ABSTRACT

This paper shows how citation-based information and structural content (e.g., title, abstract) can be combined to improve classification of text documents into predefined categories. We evaluate different measures of similarity -- five derived from the citation information of the collection, and three derived from the structural content -- and determine how they can be fused to improve classification effectiveness. To discover the best fusion framework, we apply Genetic Programming (GP) techniques. Our experiments with the ACM Computing Classification Scheme, using documents from the ACM Digital Library, indicate that GP can discover similarity functions superior to those based solely on a single type of evidence. Effectiveness of the similarity functions discovered through simple majority voting is better than that of content-based as well as combination-based Support Vector Machine classifiers. Experiments also were conducted to compare the performance between GP techniques and other fusion techniques such as Genetic Algorithms (GA) and linear fusion. Empirical results show that GP was able to discover better similarity functions than GA or other fusion techniques.

REFERENCES

• 1: R. Amsler. Application of citation-based automatic classification. Technical report, The University of Texas at Austin, Linguistics Research Center, Austin, TX, 1972.
• 2: Pável Calado , Marco Cristo , Edleno Moura , Nivio Ziviani , Berthier Ribeiro-Neto , Marcos André Gonçalves, Combining link-based and content-based methods for web document classification, Proceedings of the twelfth international conference on Information and knowledge management, November 03-08, 2003, New Orleans, LA, USA [doi>10.1145/956863.956938]
• 3: Soumen Chakrabarti , Byron Dom , Piotr Indyk, Enhanced hypertext categorization using hyperlinks, Proceedings of the 1998 ACM SIGMOD international conference on Management of data, p.307-318, June 01-04, 1998, Seattle, Washington, United States
• 4: S. M. Cheang, K. H. Lee, and K. S. Leung. Data classification using genetic parallel programming. In GECCO-03, volume 2724 of LNCS, pages 1918--1919, Chicago, 2003.
• 5: CITIDEL. Computing and Information Technology Interactive Digital Educational Library, www.citidel.org, 2004.
• 6: Chris Clack , Johnny Farringdon , Peter Lidwell , Tina Yu, Autonomous document classification for business, Proceedings of the first international conference on Autonomous agents, p.201-208, February 05-08, 1997, Marina del Rey, California, United States [doi>10.1145/267658.267716]
• 7: D. Cohn and T. Hofmann. The missing link - a probabilistic model of document content and hypertext connectivity. In NIPS 13, pages 430--436. MIT Press, 2001.
• 8: Jeffrey Dean , Monika R. Henzinger, Finding related pages in the World Wide Web, Proceeding of the eighth international conference on World Wide Web, p.1467-1479, May 1999, Toronto, Canada
• 9: M. Dolores del Castillo , José Ignacio Serrano, A multistrategy approach for digital text categorization from imbalanced documents, ACM SIGKDD Explorations Newsletter, v.6 n.1, June 2004 [doi>10.1145/1007730.1007740]
• 10: J. Eggermont, J. N. Kok, and W. A. Kosters. Genetic programming for data classification: Refining the search space. In Proc. of BNAIC-03, pages 123--130, Nijmegen, 2003.
• 11: Weiguo Fan , Edward A. Fox , Praveen Pathak , Harris Wu, The effects of fitness functions on genetic programming-based ranking discovery for Web search: Research Articles, Journal of the American Society for Information Science and Technology, v.55 n.7, p.628-636, May 2004 [doi>10.1002/asi.v55:7]
• 12: Weiguo Fan , Michael D. Gordon , Praveen Pathak, Discovery of Context-Specific Ranking Functions for Effective Information Retrieval Using Genetic Programming, IEEE Transactions on Knowledge and Data Engineering, v.16 n.4, p.523-527, April 2004 [doi>10.1109/TKDE.2004.1269663]
• 13: Weiguo Fan , Michael D. Gordon , Praveen Pathak , Wensi Xi , Edward A. Fox, Ranking Function Optimization for Effective Web Search by Genetic Programming: An Empirical Study, Proceedings of the Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04) - Track 4, p.40105, January 05-08, 2004
• 14: M. Fisher and R. Everson. When are links useful? Experiments in text classification. In Proc. of ECIR-03, pages 41--56, 2003.
• 15: Johannes Fürnkranz, Exploiting Structural Information for Text Classification on the WWW, Proceedings of the Third International Symposium on Advances in Intelligent Data Analysis, p.487-498, August 01, 1997
• 16: Eric J. Glover , Kostas Tsioutsiouliklis , Steve Lawrence , David M. Pennock , Gary W. Flake, Using web structure for classifying and describing web pages, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511520]
• 17: M. Gordon, Probabilistic and genetic algorithms in document retrieval, Communications of the ACM, v.31 n.10, p.1208-1218, Oct. 1988 [doi>10.1145/63039.63044]
• 18: John H. Holland, Adaptation in natural and artificial systems, MIT Press, Cambridge, MA, 1992
• 19: Thorsten Joachims, Text Categorization with Suport Vector Machines: Learning with Many Relevant Features, Proceedings of the 10th European Conference on Machine Learning, p.137-142, April 21-23, 1998
• 20: Thorsten Joachims , Nello Cristianini , John Shawe-Taylor, Composite Kernels for Hypertext Categorisation, Proceedings of the Eighteenth International Conference on Machine Learning, p.250-257, June 28-July 01, 2001
• 21: N. Kampanya, R. Shen, S. Kim, C. North, and E. A. Fox. CitiViz: A visual user interface to the CITIDEL system. In Proc. of ECDL-04, pages 122--133, Bath, UK, 2004.
• 22: M. M. Kessler. Bibliographic coupling between scientific papers. American Documentation, 14(1):10--25, 1963.
• 23: J. K. Kishore, L. M. Patnaik, V. Mani, and V. K. Agrawal. Application of genetic programming for multicategory pattern classification. IEEE TEC-00, 4(3):242--258, 2000.
• 24: J. K. Kishore , L. M. Patnaik , V. Mani , V. K. Agrawal, Genetic programming based pattern classification with feature space partitioning, Information Sciences: an International Journal, v.131 n.1-4, p.65-86, Jan. 2001 [doi>10.1016/S0020-0255(00)00081-5 ]
• 25: John R. Koza, Genetic programming: on the programming of computers by means of natural selection, MIT Press, Cambridge, MA, 1992
• 26: A. Krowne and E. A. Fox. An architecture for multischeming in digital libraries. In Proc. of ICADL-03, pages 563--577, Kuala Lumpur, Malaysia, 2003.
• 27: William B. Langdon , Koza John R, Genetic Programming and Data Structures: Genetic Programming + Data Structures = Automatic Programming!, Kluwer Academic Publishers, Norwell, MA, 1998
• 28: Foundations of genetic programming, Springer-Verlag New York, Inc., New York, NY, 2002
• 29: Steve Lawrence , C. Lee Giles , Kurt Bollacker, Digital Libraries and Autonomous Citation Indexing, Computer, v.32 n.6, p.67-71, June 1999 [doi>10.1109/2.769447 ]
• 30: T. M. Mitchell. Machine learning. McGraw Hill, New York, US, 1996.
• 31: Hyo-Jung Oh , Sung Hyon Myaeng , Mann-Ho Lee, A practical hypertext catergorization method using links and incrementally available class information, Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.264-271, July 24-28, 2000, Athens, Greece [doi>10.1145/345508.345594]
• 32: H. G. Small. Co-citation in the scientific literature: A new measure of relationship between two documents. JASIS, 24(4):265--269, 1973.
• 33: Aixin Sun , Ee-Peng Lim , Wee-Keong Ng, Web classification using support vector machine, Proceedings of the 4th international workshop on Web information and data management, November 08-08, 2002, McLean, Virginia, USA [doi>10.1145/584931.584952]
• 34: Yiming Yang, Expert network: effective and efficient learning from human decisions in text categorization and retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.13-22, July 03-06, 1994, Dublin, Ireland
• 35: Yiming Yang , Seán Slattery , Rayid Ghani, A Study of Approaches to Hypertext Categorization, Journal of Intelligent Information Systems, v.18 n.2-3, p.219-241, March-May 2002
• 36: B. Zhang, M. A. Gonçalves, W. Fan, Y. Chen, E. A. Fox, P. Calado, and M. Cristo. Intelligent fusion of structural and citation-based evidence for text classification. Technical Report TR-04-16, Computer Science, Virginia Tech, 2004.
• 37: B. Zhang, M. A. Gonçalves, and E. A. Fox. An OAI-based filtering service for CITIDEL from NDLTD. In Proc. of ICADL-03, pages 590--601, Kuala Lumpur, Malaysia, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Text processing

General Terms:
Algorithms, Experimentation, Measurement, Performance

Keywords:
classification, genetic programming