Using annotations in enterprise search

ABSTRACT

A major difference between corporate intranets and the Internet is that in intranets the barrier for users to create web pages is much higher. This limits the amount and quality of anchor text, one of the major factors used by Internet search engines, making intranet search more difficult. The social phenomenon at play also means that spam is relatively rare. Both on the Internet and in intranets, users are often willing to cooperate with the search engine in improving the search experience. These characteristics naturally lead to considering using user feedback to improve search quality in intranets. In this paper we show how a particular form of feedback, namely user annotations, can be used to improve the quality of intranet search. An annotation is a short description of the contents of a web page, which can be considered a substitute for anchor text. We propose two ways to obtain user annotations, using explicit and implicit feedback, and show how they can be integrated into a search engine. Preliminary experiments on the IBM intranet demonstrate that using annotations improves the search quality.

REFERENCES

• 1: Anchor text optimization. www.seo-gold.com/tutorial/anchor-text-optimization.html
• 2: Google enterprise solutions. http://www.google.com/enterprise/http://www.google.com/enterprise/.
• 3: IBM OmniFind solution for enterprise search. http://www-306.ibm.com/software/data/integration/db2ii/editions_womnifind.html
• 4: NCSA mosaic: Annotations overview. http://archive.ncsa.uiuc.edu/SDG/Software/XMosaic/Annotations/overview.html
• 5: Panoptic enterprise search engine. http://www.panopticsearch.comhttp://www.panopticsearch.com.
• 6: StumbleUpon. http://www.stumbleupon.comhttp://www.stumbleupon.com.
• 7: Verity enterprise search solution. http://www.verity.com/products/search/enterprise_web_search/index.html
• 8: Yahoo! MyWeb 2.0 BETA. http://myweb2.search.yahoo.com/
• 9: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
• 10: Vannevar Bush. As we may think. In The Atlantic Monthly, July 1945.
• 11: Junghoo Cho , Sourashis Roy, Impact of search engines on page popularity, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988676]
• 12: Thomas T. Cormen , Charles E. Leiserson , Ronald L. Rivest, Introduction to algorithms, MIT Press, Cambridge, MA, 1990
• 13: Laurent Denoue and Laurence Vignollet. New ways of using web annotations. In Proc. 9th World Wide Web Conference, Amsterdam, 2000.
• 14: Nadav Eiron , Kevin S. McCurley, Analysis of anchor text for web search, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860550]
• 15: Ronald Fagin , Ravi Kumar , Kevin S. McCurley , Jasmine Novak , D. Sivakumar , John A. Tomlin , David P. Williamson, Searching the workplace web, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775204]
• 16: Susan Feldman and Chris Sherman. The high cost of not finding information. In IDC Technical Report 29127, 2003.
• 17: Marcus Fontoura, Eugene J. Shekita, Jason Y. Zien, Sridhar Rajagopalan, and Andreas Neumann. High performance index build algorithms for intranet search engines. In VLDB, pages 1158--1169, 2004.
• 18: David Hawking, Challenges in enterprise search, Proceedings of the 15th Australasian database conference, p.15-24, January 01, 2004, Dunedin, New Zealand
• 19: Thorsten Joachims, Optimizing search engines using clickthrough data, Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, July 23-26, 2002, Edmonton, Alberta, Canada [doi>10.1145/775047.775067]
• 20: Thorsten Joachims, Dayne Freitag, and Tom Mitchell. Webwatcher: A tour guide for the world wide web. In Proc. International Joint Conference on Artificial Intelligence, Nagoya, Japan, 1997.
• 21: Thorsten Joachims , Laura Granka , Bing Pan , Helene Hembrooke , Geri Gay, Accurately interpreting clickthrough data as implicit feedback, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076063]
• 22: Charles Kemp , Kotagiri Ramamohanarao, Long-Term Learning for Web Search Engines, Proceedings of the 6th European Conference on Principles of Data Mining and Knowledge Discovery, p.263-274, August 19-23, 2002
• 23: Hannes Marais , Krishna Bharat, Supporting cooperative and personal surfing with a desktop assistant, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.129-138, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263531]
• 24: Lawrence Page, Sergey Brin, Rajeev Motwani, and Terry Winograd. The PageRank citation ranking: Bringing order to the web. Technical report, Stanford Digital Library Technologies Project, 1998. Paper SIDL-WP-1999-0120 (version of 11/11/1999).
• 25: Filip Radlinski , Thorsten Joachims, Query chains: learning to rank from implicit feedback, Proceeding of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining, August 21-24, 2005, Chicago, Illinois, USA [doi>10.1145/1081870.1081899]
• 26: Robert Sedgewick, Algorithms in C++, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1992
• 27: Venu Vasudevan , Mark Palmer, On Web Annotations: Promises and Pitfalls of Current Web Infrastructure, Proceedings of the Thirty-Second Annual Hawaii International Conference on System Sciences-Volume 2, p.2012, January 05-08, 1999
• 28: Vishwa Vinay , Ken Wood , Natasa Milic-Frayling , Ingemar J. Cox, Comparing relevance feedback algorithms for web search, Special interest tracks and posters of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1062745.1062864]
• 29: I. Witten, A. Moffat, and T. Bell. Managing Gigabytes. Morgan Kaufmann, 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms, Experimentation, Human Factors

Keywords:
anchortext, community ranking, enterprise search