Different indexing strategies for multilingual web retrieval: experiments with the EuroGOV corpus

ABSTRACT

Experiments with a multi-lingual web collection are presented. The EuroGOV corpus is the first multi-lingual web corpus for retrieval evaluation. We show how indexes based on words and n-rams are developed for different document parts. Different indexes werde based on the full document content, partial content and the title. The best results were achieved for a title only index based on words.

REFERENCES

• 1: Liang Chen , Shaozhi Ye , Xing Li, Template detection for large scale search engines, Proceedings of the 2006 ACM symposium on Applied computing, April 23-27, 2006, Dijon, France [doi>10.1145/1141277.1141534]
• 2: Hackl, R.; Mandl, T.; Womser-Hacker, C.: Ad-hoc Mono and Multilingual Retrieval Experiments at the University of Hildesheim. In: Working Notes of the 6th Workshop of the Cross-Language Evaluation Forum, CLEF 2005. Sept. 2005, Wien. http://www.clef-campaign.org/2005/working_notes/
• 3: Jensen, N.; Hackl, R.; Mandl, T.; Strötgen, R.: Web Retrieval Experiments with the EuroGOV Corpus at the University of Hildesheim. In: Accessing Multilingual Information Repositories: 6th Workshop of the Cross-Language Evaluation Forum, CLEF 2005, Vienna, Austria, Revised Selected Papers. Springer {LNCS 4022} (2006)
• 4: Lucene Project Homepage http://lucene.apache.org
• 5: Thomas Mandl, Implementation and evaluation of a quality-based search engine, Proceedings of the seventeenth conference on Hypertext and hypermedia, August 22-25, 2006, Odense, Denmark [doi>10.1145/1149941.1149957]
• 6: Paul Mcnamee , James Mayfield, Character N-Gram Tokenization for European Language Text Retrieval, Information Retrieval, v.7 n.1-2, p.73-97, January-April 2004
• 7: Sigurbjörnsson, B.; Kamps, J.; de Rijke, M: Blueprint of a crosslingual web retrieval collection. In: Digital Information Management vol. 3 (2005) 9--13.
• 8: Sigurbjörnsson, B.; Kamps, J.; de Rijke, M.: Overview of WebCLEF 2005. In: Working Notes of the 6th Workshop of the Cross-Language Evaluation Forum, CLEF 2005. Sept. 2005, Wien. http://www.clef-campaign.org/2005/workingnotes/ workingnotes2005/sigurbjornsson05.pdf

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software
          Subjects: Performance evaluation (efficiency and effectiveness)

General Terms:
Experimentation, Measurement

Keywords:
multi-lingual systems, web retrieval