Web-a-where: geotagging web content

ABSTRACT

We describe Web-a-Where, a system for associating geography with Web pages. Web-a-Where locates mentions of places and determines the place each name refers to. In addition, it assigns to each page a geographic focus --- a locality that the page discusses as a whole. The tagging process is simple and fast, aimed to be applied to large collections of Web pages and to facilitate a variety of location-based applications and data analyses.Geotagging involves arbitrating two types of ambiguities: geo/non-geo and geo/geo. A geo/non-geo ambiguity occurs when a place name also has a non-geographic meaning, such as a person name (e.g., Berlin) or a common word (Turkey). Geo/geo ambiguity arises when distinct places have the same name, as in London, England vs. London, Ontario.An implementation of the tagger within the framework of the WebFountain data mining system is described, and evaluated on several corpora of real Web pages. Precision of up to 82% on individual geotags is achieved. We also evaluate the relative contribution of various heuristics the tagger employs, and evaluate the focus-finding algorithm using a corpus pretagged with localities, showing that as many as 91% of the foci reported are correct up to the country level.

REFERENCES

• 1: Google Search by Location http://labs.google.com/location.
• 2: ISO 3166 code lists. http://www.iso.ch/iso/en/prods-services/iso3166ma/02iso-3166-code-lists/index.html.
• 3: MεταCARTA, Inc. 875 Massachusetts Avenue, Cambridge, MA 02139. http://www.metacarta.com.
• 4: ODP: Regional. http://dmoz.org/regional.
• 5: Text REtrieval Conference 2003: .gov test collection. http://es.cmis.csiro.au/trecweb/access_to_data.html.
• 6: United Nations department of economic and social affairs. http://unstats.un.org/unsd.
• 7: USGS Geographic Names Information System (GNIS). http://geonames.usgs.gov.
• 8: WebFountain framework for data mining. http://www.almaden.ibm.com/webfountain.
• 9: World Gazetteer. http://www.world-gazetteer.com.
• 10: The 6th message understanding conference task definition, March 1995. http://www.cs.nyu.edu/cs/faculty/grishman/COtask21.book_1.html.
• 11: Language-independent named entity recognition: shared task, 2002. http://cnts.uia.ac.be/conll2002/ner.
• 12: Frédérik Bilhaut , Thierry Charnois , Patrice Enjalbert , Yann Mathet, Geographic reference analysis for geographic document querying, Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references, p.55-62, May 31, 2003 [doi>10.3115/1119394.1119403]
• 13: John D. Burger , John C. Henderson , William T. Morgan, Statistical named entity recognizer adaptation, proceeding of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118856]
• 14: Silviu Cucerzan , David Yarowsky, Language independent NER using a unified model of internal and contextual evidence, proceeding of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118860]
• 15: Junyan Ding , Luis Gravano , Narayanan Shivakumar, Computing Geographical Scopes of Web Resources, Proceedings of the 26th International Conference on Very Large Data Bases, p.545-556, September 10-14, 2000
• 16: G. Eriksson, K. Franzén, F. Olsson, L. Asker, and P. Lidén. Exploiting syntax when detecting protein names in text. In Proceedings of Workshop on Natural Language Processing in Biomedical Applications, 2002.
• 17: Jochen L. Leidner , Gail Sinclair , Bonnie Webber, Grounding spatial named entities for information extraction and question answering, Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references, p.31-38, May 31, 2003 [doi>10.3115/1119394.1119399]
• 18: Huifeng Li , Rohini K. Srihari , Cheng Niu , Wei Li, Location normalization for information extraction, Proceedings of the 19th international conference on Computational linguistics, p.1-7, August 24-September 01, 2002, Taipei, Taiwan [doi>10.3115/1072228.1072355]
• 19: Huifeng Li , Rohini K. Srihari , Cheng Niu , Wei Li, InfoXtract location normalization: a hybrid approach to geographic references in information extraction, Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references, p.39-44, May 31, 2003 [doi>10.3115/1119394.1119400]
• 20: Robert Malouf, Markov models for language-independent named entity recognition, proceeding of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118872]
• 21: Kevin S. McCurley, Geospatial mapping and navigation of the web, Proceedings of the 10th international conference on World Wide Web, p.221-229, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372056]
• 22: Paul McNamee , James Mayfield, Entity extraction without language-specific resources, proceeding of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118873]
• 23: Jon Patrick , Casey Whitelaw , Robert Munro, SLINERC: the Sydney Language-Independent Named Entity Recogniser and Classifier, proceeding of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118875]
• 24: Erik Rauch , Michael Bukatin , Kenneth Baker, A confidence-based framework for disambiguating geographic terms, Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references, p.50-54, May 31, 2003 [doi>10.3115/1119394.1119402]
• 25: Y. Ravin and N. Wacholder. Extracting names from natural-language text. Technical Report RC-20338, IBM Research Division, T.J.Watson, Yorktown Heights, NY, October 1997.
• 26: David A. Smith , Gregory Crane, Disambiguating Geographic Names in a Historical Digital Library, Proceedings of the 5th European Conference on Research and Advanced Technology for Digital Libraries, p.127-136, September 04-09, 2001
• 27: Beth M. Sundheim, Overview of results of the MUC-6 evaluation, Proceedings of the 6th conference on Message understanding, November 06-08, 1995, Columbia, Maryland [doi>10.3115/1072399.1072402]
• 28: Dekai Wu , Grace Ngai , Marine Carpuat , Jeppe Larsen , Yongsheng Yang, Boosting for named entity recognition, proceeding of the 6th conference on Natural language learning, p.1-4, August 31, 2002 [doi>10.3115/1118853.1118888]
• 29: GuoDong Zhou , Jian Su, Named entity recognition using an HMM-based chunk tagger, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, July 07-12, 2002, Philadelphia, Pennsylvania [doi>10.3115/1073083.1073163]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software

          Nouns: World Wide Web (WWW)

General Terms:
Algorithms, Design, Experimentation, Verification

Keywords:
disambiguation, gazetteer, geographic tagging, information retrieval, natural language processing, text mining