Vagueness and uncertainty in information retrieval: how can fuzzy sets help?

ABSTRACT

The field of fuzzy information systems has grown and is maturing. In this paper, some applications of fuzzy set theory to information retrieval are described, as well as the more recent outcomes of research in this field. Fuzzy set theory is applied to information retrieval with the main aim being to define flexible systems, i.e., systems that can represent and manage the vagueness and subjectivity which characterizes the process of information representation and retrieval, one of the main objectives of artificial intelligence.

REFERENCES

• 1: Serge Abiteboul, Querying Semi-Structured Data, Proceedings of the 6th International Conference on Database Theory, p.1-18, January 08-10, 1997
• 2: Azzopardi, L., Girolami M. L., and C. J. van Rijsbergen (2004). Topic Based Language Models for ad hoc Information Retrieval. In Proceedings of the International Joint Conference on Neural Networks, Budapest, Hungary.
• 3: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 4: Carol L. Barry, User-defined relevance criteria: an exploratory study, Journal of the American Society for Information Science, v.45 n.3, p.149-159, April 1994 [doi>10.1002/(SICI)1097-4571(199404)45:3<149::AID-ASI5>3.0.CO;2-J]
• 5: Bordogna, G. and Pasi, G. (1993) Multicriteria decision making in information retrieval. In Proceedings of the 3rd International Conference on Current Issues in Fuzzy Technologies '93, Roncegno, Trento, Italy, 3--4 June
• 6: Bordogna, G. and Pasi, G. (1993). A fuzzy linguistic approach generalizing Boolean information retrieval: a model and its evaluation. Journal of the American Society for Information Science, 44(2), 70--82.
• 7: Bordogna, G., Pasi, G.(1995).Controlling retrieval through a user-adaptive representation of documents. Int. Journal of Approximate Reasoning, 12, 317--339.
• 8: Bordogna, G. and Pasi, G. (1995). Linguistic aggregation operators in fuzzy information retrieval. International Journal of Intelligent systems, 10(2), 233--248.
• 9: Bordogna, G. and Pasi, G. (2004). Soft fusion of Infomation Accesses. Fuzzy Sets and Systems, 148, 205--218.
• 10: Gloria Bordogna , Gabriella Pasi, An ordinal information retrieval model, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, v.9 n.Supplement, p.63-75, September 2001
• 11: Gloria Bordogna , Gabriella Pasi, Modeling vagueness in information retrieval, Lectures on information retrieval, Springer-Verlag New York, Inc., New York, NY, 2001
• 12: Gloria Bordogna , Gabriella Pasi, Personalised Indexing and Retrieval of Heterogeneous Structured Documents, Information Retrieval, v.8 n.2, p.301-318, April 2005 [doi>10.1007/s10791-005-5664-x]
• 13: Bordogna, G., Pagani, M., and Pasi, G., (2006). A dynamical Hierarchical fuzzy clustering algorithm for document filtering". In Soft Computing for Information Retrieval on the Web, Springer Verlag.
• 14: Bordogna, G., Pasi, G., and Yager, R. R. (2003). Soft approaches to distributed information retrieval, International Journal of Intelligent Systems, Vol. 34, 105--120.
• 15: Bosc, P. and Prade, H. (1997) An Introduction to the FUZZY Set and Possibility Theory-based Treatment of flexible Queries and Uncertain or Imprecise databases. In: Motro, A. and Smet, P. (Eds.), Uncertainty Management in Information Systems, Kluwer Academic Publishers, 285--324.
• 16: Boughanem, M., Loiseau, Y., and Prade, H. (2005). Improving document ranking in information retrieval using ordered weighted aggregation and leximin refinement. In EUSFLAT-LFA 2005, 4th Conference of the European Society for Fuzzy Logic and Technology and 11me Rencontres Francophones sur la Logique Floue et ses Applications, Barcelonan, Spain, 7 septembre 9 septembre 2005, 1269--1274.
• 17: Boughanem, M., Pasi, G., Prade, H., and Baziz, M. (2006). A fuzzy logic approach to information retrieval using an ontology-based representation of documents. In Sanchez, E. (Ed.), Fuzzy Logic and the Semantic Web, Elsevier Science.
• 18: Braga, D., Campi, A., Damiani, E., Pasi, G., and Lanzi P. (2002). FXPath: flexible querying of XML documents, In Proceedings of EUROFUSE 2002, Varenna, Italy.
• 19: Brini, A., Boughanem, M., and Dubois, D. (2005). A Model for Information Retrieval Based on Possibilistic Networks. In String Processing and Information Retrieval (SPIRE 2005), Buenos Aires, ARGENTINE, janvier 2005. LNCS, Springer Verlag, 271--282.
• 20: Buell, D. A. and Kraft, D. H. (1981) Threshold values and Boolean retrieval systems. Information Processing and Management 17, 127--136.
• 21: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 22: Contributor's Manual. (1996). Handbook of Fuzzy Computation, Oxford, England: Oxford University Press.
• 23: Crestani, F. and Pasi, G. (1999). Soft Information Retrieval: Applications of Fuzzy Set Theory and Neural Networks. In Neuro-fuzzy Techniques for Intelligent Information Systems, N. Kaabov and Robert Kozma Editors, Physica-Verlag, Springer-Verlag Group, 287--313.
• 24: Crestani, F. and Pasi, G. (Eds.) (2000). Soft Computing in Information Retrieval: Techniques and Applications, Physica Verlag, Studies in Fuzziness Series.
• 25: Dubois, D. and Prade, H. (1988) Theorie des possibilites, Applications a la representation des connaissances en informatique. Method + programmes. Paris, France: Masson
• 26: J. Stephen Downie, Introduction and overview: a sample of music information retrieval approaches, Journal of the American Society for Information Science and Technology, v.55 n.12, p.1033-1036, October 2004 [doi>10.1002/asi.20054]
• 27: Norbert Fuhr , Mounia Lalmas, Introduction to the Special Issue on INEX, Information Retrieval, v.8 n.4, p.515-519, December 2005 [doi>10.1007/s10791-005-0745-4]
• 28: Eric J. Glover , Steve Lawrence , Michael D. Gordon , William P. Birmingham , C. Lee Giles, Web Search---Your Way, Communications of the ACM, v.44 n.12, p.97-102, December 2001 [doi>10.1145/501317.501319]
• 29: Hathaway, R. J., Bezdek, J. C., and Hu, Y. (2000). Generalized Fuzzy C-Means Clustering Strategies Using Lp Norm Distances. IEEE Transactions on Fuzzy Systems, 8(5), 576--582.
• 30: E. Herrera-Viedma, Modeling the retrieval process for an information retrieval system using an ordinal fuzzy linguistic approach, Journal of the American Society for Information Science and Technology, v.52 n.6, p.460-475, April 2001 [doi>10.1002/1532-2890(2001)9999:9999<::AID-ASI1087>3.3.CO;2-H]
• 31: Herrera-Viedma, E., Cordon, O., Luque, M., Lopez, A. G., and Muñoz, A. N. (2003). A Model of Fuzzy Linguistic IRS Based on Multi-Granular Linguistic Information. International Journal of Approximate Reasoning, 34(3), 221--239.
• 32: Enrique Herrera-Viedma , Gabriella Pasi , Fabio Crestani, Soft Computing in Web Information Retrieval: Models and Applications (Studies in Fuzziness and Soft Computing), Springer-Verlag New York, Inc., Secaucus, NJ, 2006
• 33: S. S. Lyengar, Visual based retrieval systems and web mining---introduction, Journal of the American Society for Information Science and Technology, v.52 n.10, p.829-830, August 2001 [doi>10.1002/asi.1136.abs]
• 34: George J. Klir , Tina A. Folger, Fuzzy sets, uncertainty, and information, Prentice-Hall, Inc., Upper Saddle River, NJ, 1987
• 35: Kraft, D., Bordogna, G., and Pasi, G. (1999). Fuzzy Set Techniques in Information Retrieval, In Fuzzy Sets in Approximate Reasoning and Information Systems, J. C. Bezdek, D. Dubois and H. Prade (Eds.), Kluwer Academic Publishers, 469--510.
• 36: Donald H. Kraft , Jianhua Chen , Maria J. Martin-Bautista , Maria-Amparo Vila, Textual information retrieval with user profiles using fuzzy clustering and inferencing, Intelligent exploration of the web, Physica-Verlag GmbH, Heidelberg, Germany, 2003
• 37: Kraft, D. H. (1985). Advances in Information Retrieval: Where is That /#*%@^ Record?. In Yovits, M. (Ed.), Advances in Computers, 24, New York, NY: Academic Press, 277--318.
• 38: Kraft, D. H. and Buell, D. A. (1983). Fuzzy sets and generalized Boolean retrieval systems. International Journal of Man-Machine Studies, 19(1), 45--56.
• 39: Donald H. Kraft , Gloria Bordogna , Gabriella Pasi, An extended fuzzy linguistic approach to generalize Boolean information retrieval, Information Sciences—Applications: An International Journal, v.2 n.3, p.119-134, Nov. 1994
• 40: Kraft, D. H., Bordogna, G., and Pasi, G. (1998). Information Retrieval Systems: Where is the Fuzz?. Presentation at the IEEE International Conference on Fuzzy Systems, Anchorage, Alaska.
• 41: Kraft, D. H., Martin-Bautista, M. J., Chen, J., and Sanchez, D. (2003). Rules and Fuzzy Rules in Text: Concept, Extraction and Usage, Special Issue on Soft Computing Applications to Intelligent Information Retrieval on the Internet, International Journal of Approximate Reasoning, 34(2--3), 145--162.
• 42: Kraft, D. H., Petry, F. E., Buckles, B. P., and Sadasivan, T. (1995). Applying Genetic Algorithms to Information Retrieval Systems Via Relevance Feedback. In Bosc, P. and Kacprzyk, J. (Eds.), Fuzziness in Database Management Systems, Studies in Fuzziness Series, Heidelberg, Germany: Physica-Verlag, 330--344.
• 43: Kraft, D. H., Petry, F. E., Buckles, B. P., and Sadasivan, T. (1997). Genetic Algorithms for Query Optimization in Information Retrieval: Relevance Feedback. In Sanchez, E., Shibata, T., and Zadeh, L. A. (Eds.), Genetic Algorithms and Fuzzy Logic Systems, Singapore: World Scientific.
• 44: K. Lin , Ravikuma Kondadadi, A Similarity-Based Soft Clustering Algorithm for Documents, Proceedings of the 7th International Conference on Database Systems for Advanced Applications, p.40-47, April 18-20, 2001
• 45: Loiseau, Y., Boughanem, M., and Prade, H. (2006). Evaluation of term-based queries using possibilistic ontologies. In Herrera-Viedma, E., Pasi, G., and Crestani, F. (Eds.), Soft Computing for Information Retrieval on the Web. Springer-Verlag.
• 46: Losada, D., Diaz-Hermida, F. and Bugarin, A. (2006). Semi-fuzzy quantifiers for information retrieval. In Herrera-Viedma, E., Pasi, G., and Crestani, F. (Eds.), Soft Computing in Web Information Retrieval: Models and Applications, Series of Studies in Fuzziness and Soft Computing, 97, Springer Verlag.
• 47: R. A. Marques Pereira , A. Molinari , G. Pasi, Contextual weighted representations and indexing models for the retrieval of HTML documents, Soft Computing - A Fusion of Foundations, Methodologies and Applications, v.9 n.7, p.481-492, July 2005 [doi>10.1007/s00500-004-0361-z]
• 48: Martin-Bautista, M. J., Kraft, D. H., Vila, M. A., Chen, J., and Cruz, J. (2002). User Profiles and Fuzzy Logic for Web Retrieval. Journal of Soft Computing, 6(2), 365--372.
• 49: Mendes, Rodrigues M. E. S. and Sacks, L. (2004). A Scalable Hierarchical Fuzzy Clustering Algorithm for Text Mining, In Proceedings of the 4th International Conference on Recent Advances in Soft Computing, <u>RASC'2004</u>, 269--274, Nottingham, UK.
• 50: S. Miyamoto, Information retrieval based on fuzzy associations, Fuzzy Sets and Systems, v.38 n.2, p.191-205, Nov. 1990 [doi>10.1016/0165-0114(90)90149-Z]
• 51: Miyamoto, S. (1990). Fuzzy sets in Information Retrieval and Cluster Analysis. Dordrecht, The Netherlands: Kluwer Academic Publishers.
• 52: Molinari, A. and Pasi, G. (1996). A Fuzzy Representation of HTML Documents for Information Retrieval Systems. In Proceedings of the IEEE International Conference on Fuzzy Systems, 8--12 September, New Orleans, 1, 107--112.
• 53: Nomoto, K., Wakayama, S., Kirimoto, T., and Kondo, M. (1987). A fuzzy retrieval system based on citation. Systems and Control, 31(10), 748--755.
• 54: Yasushi Ogawa , Tetsuya Morita , Kiyohiko Kobayashi, A fuzzy document retrieval system using the keyword connection matrix and a learning method, Fuzzy Sets and Systems, v.39 n.2, p.163-179, Jan. 25, 1991 [doi>10.1016/0165-0114(91)90210-H]
• 55: Pasi, G., (2003). Modelling Users' Preferences in Systems for Information Access, International Journal of Intelligent Systems, 18, 793--808.
• 56: Pedrycz, W. (2005). Clustering and Fuzzy Clustering, chapter 1, In Knowledge-based clustering, J. Wiley and Sons.
• 57: Petry, F. E., Buckles, B. P., Kraft, D. H., Prabhu, D., and Sadasivan, T. (1997). The Use of Genetic Programming to Build Queries for Information Retrieval," In Baeck, T., Fogel, D., and Michalewicz, Z. (Eds.), Handbook of Evolutionary Computation, Section G2.1, New York: Oxford University Press, 1--6.
• 58: Gerard Salton, Automatic text processing: the transformation, analysis, and retrieval of information by computer, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1989
• 59: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 60: Sparck Jones, K. A. (1972). A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation, 28(1), 11--20.
• 61: Padmini Srinivasan , Miguel E. Ruiz , Donald H. Kraft , Jianhua Chen, Vocabulary mining for information retrieval: rough sets and fuzzy sets, Information Processing and Management: an International Journal, v.37 n.1, p.15-38, 2001 [doi>10.1016/S0306-4573(00)00014-5 ]
• 62: Thomopoulos, R., Buche, P., Haemmerlé, O. (2003). Representation of weakly structured imprecise data for fuzzy querying. Fuzzy Sets and Systems, 140, 111--128.
• 63: Vincke, P. (1992), Multicriteria Decision Aid, John Wiley & Sons.
• 64: Ronald R. Yager, On ordered weighted averaging aggregation operators in multicriteria decisionmaking, IEEE Transactions on Systems, Man and Cybernetics, v.18 n.1, p.183-190, January/February 1988 [doi>10.1109/21.87068 ]
• 65: Christopher C. Yang , Wai Lam, Introduction to the special topic section on multilingual information systems, Journal of the American Society for Information Science and Technology, v.57 n.5, p.629-631, March 2006 [doi>10.1002/asi.v57:5]
• 66: Zadeh, L. A. (1975). The concept of a linguistic variable and its application to approximate reasoning. Parts I and II. Information Science, 8, 199--249, 301--357.
• 67: Zadeh, L. A. (1983). A Computational Approach to Fuzzy Quantifiers in Natural Languages, Computing and Mathematics with Applications. 9, 149--184.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Keywords:
artificial intelligence, clustering, fuzzy indexing, fuzzy set, fuzzy set theory, genetic programming, imprecision, information retrieval, rough sets, uncertainty, vagueness