Interactive and context-aware tag spell check and correction

ABSTRACT

Collaborative content creation and annotation creates vast repositories of all sorts of media, and user-defined tags play a central role as they are a simple yet powerful tool for organizing, searching and exploring the available resources. We observe that when a user annotates a resource with a set of tags, those tags are introduced one at a time. Therefore, when the fourth tag is introduced, a knowledge represented by the previous three tags, i.e., the context in which the fourth tag is produced, is available and exploitable for generating potential correction of the current tag. This context, together with the "wisdom of the crowd" represented by the co-occurrences of tags in all the resources of the repository, can be exploited to provide interactive tag spell check and correction. We develop this idea in a framework, based on a weighted tag co-occurrence graph and on nodes relatedness measures defined on weighted neighborhoods. We test our proposal on a dataset coming from YouTube. The results show that our framework is effective as it outperforms two important baselines. We also show that it is efficient, thus enabling its use in modern tagging services.

References

1. Z. Bao, B. Kimelfeld, and Y. Li. A graph approach to spelling correction in domain-centric search. In Proc. HLT'11, pages 905--914, Stroudsburg, PA, USA, 2011. ACL.
2. S. Cucerzan and E. Brill. Spelling correction as an iterative process that exploits the collective knowledge of web users. In Proc. EMNLP, 2004.
3. J. Gao, X. Li, D. Micol, C. Quirk, and X. Sun. A large scale ranker-based system for search query spelling correction. In Proc. COLING'10, pages 358--366, Stroudsburg, PA, USA, 2010. ACL.
4. A. R. Golding and D. Roth. A winnow-based approach to context-sensitive spelling correction. Mach. Learn., 34(1-3):107--130, 1999.
5. K. Kukich. Techniques for automatically correcting words in text. ACM Comput. Surv., 24(4):377--439, 1992.
6. D. Liben-Nowell and J. Kleinberg. The link-prediction problem for social networks. JASIST, 58(7):1019--1031, 2007.
7. L. Mangu and E. Brill. Automatic rule acquisition for spelling correction. In Proc. ICML'97, pages 187--194, San Francisco, CA, USA, 1997. Morgan Kaufmann Publishers Inc.
8. Y. Merhav and O. Frieder. On multiword entity ranking in peer-to-peer search. In Proc. SIGIR'08. ACM, 2008.
9. F. M. Nardini, F. Silvestri, H. Vahabi, P. Vahabi, and O. Frieder. On tag spell checking. In Proc. SPIRE'10, SPIRE'10, pages 37--42. Springer-Verlag, 2010.
10. C. Whitelaw, B. Hutchinson, G. Y. Chung, and G. Ellis. Using the web for language independent spellchecking and autocorrection. In Proc. EMNLP'09. ACL, 2009.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Natural language processing

• Information systems

  • Information retrieval

    • Document representation

      • Content analysis and feature selection