From social bookmarking to social summarization: an experiment in community-based summary generation

ABSTRACT

We describe a novel document summarization technique that uses informational cues, such as social bookmarks or search queries, as the basis for summary construction by leveraging the snippet-generation capabilities of standard search engines. A comprehensive evaluation demonstrates how the social summarization technique can generate summaries that are of significantly higher quality that those produced by a number of leading alternatives.

REFERENCES

• 1: Harris Wu , Mohammad Zubair , Kurt Maly, Harvesting social knowledge from folksonomies, Proceedings of the seventeenth conference on Hypertext and hypermedia, August 22-25, 2006, Odense, Denmark [doi>10.1145/1149941.1149962]
• 2: Stergos D. Afantenos, Vangelis Karkaletsis, and Panagiotis Stamatopoulos. Summarization from medical documents: a survey. Artificial Intelligence in Medicine, 33(2):157--177, 2005.
• 3: Einat Amitay , Cécile Paris, Automatically summarising Web sites: is there a way around it?, Proceedings of the ninth international conference on Information and knowledge management, p.173-179, November 06-11, 2000, McLean, Virginia, United States [doi>10.1145/354756.354816]
• 4: R. Barzilay and M. Elhadad. Using lexical chains for text summarization. In ACL'97/EACL'97 Workshop on Intelligent Scalable Text Summarization, Madrid, Spain, May 1997.
• 5: J.-Y. Delort , B. Bouchon-Meunier , M. Rifqi, Enhanced web document summarization using hyperlinks, Proceedings of the fourteenth ACM conference on Hypertext and hypermedia, August 26-30, 2003, Nottingham, UK [doi>10.1145/900051.900097]
• 6: H. P. Edmundson, New Methods in Automatic Extracting, Journal of the ACM (JACM), v.16 n.2, p.264-285, April 1969 [doi>10.1145/321510.321519]
• 7: Yihong Gong , Xin Liu, Generic text summarization using relevance measure and latent semantic analysis, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.19-25, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383955]
• 8: U. Hahn and U. Reimer. Knowledge-based text summarization: Salience and generalization operators for knowledge base abstraction. The MIT Press, 1999.
• 9: Julian Kupiec , Jan Pedersen , Francine Chen, A trainable document summarizer, Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, p.68-73, July 09-13, 1995, Seattle, Washington, United States [doi>10.1145/215206.215333]
• 10: Chin-Yew Lin. Rouge: a package for automatic evaluation of summaries. In Proceedings of the Workshop on Text Summarization Branches Out (WAS 2004), 2004.
• 11: Chin-Yew Lin , Eduard Hovy, Automatic evaluation of summaries using N-gram co-occurrence statistics, Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, p.71-78, May 27-June 01, 2003, Edmonton, Canada [doi>10.3115/1073445.1073465]
• 12: H. P. Luhn. The automatic creation of literature abstracts. IBM Journal of Research and Development, 2:159--165, 1958.
• 13: Daniel Marcu, The Theory and Practice of Discourse Parsing and Summarization, MIT Press, Cambridge, MA, 2000
• 14: Kathleen McKeown , Dragomir R. Radev, Generating summaries of multiple news articles, Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, p.74-82, July 09-13, 1995, Seattle, Washington, United States [doi>10.1145/215206.215334]
• 15: Chris D. Paice , Paul A. Jones, The identification of important concepts in highly structured technical papers, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.69-78, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160696]
• 16: Dragomir Radev, Timothy Allison, Sasha Blair-Goldensohn, John Blitzer, Arda Celebi, Stanko Dimitrov, Elliott Drabek, Ali Hakim, Wai Lam, Danyu Liu, Jahna Otterbacher, Hong Qi, Horacio Saggion, Simone Teufel, Michael Topper, Adam Winkel, and Zhu Zhang. MEAD - a platform for multidocument multilingual text summarization. In LREC 2004, Lisbon, Portugal, May 2004.
• 17: Nadav Rotem. The Open Text Summarizer. http://libots.sourceforge.net/, 2003.
• 18: Barry Smyth , Evelyn Balfe , Jill Freyne , Peter Briggs , Maurice Coyle , Oisin Boydell, Exploiting Query Repetition and Regularity in an Adaptive Community-Based Web Search Engine, User Modeling and User-Adapted Interaction, v.14 n.5, p.383-423, January 2005 [doi>10.1007/s11257-004-5270-4]
• 19: Jian-Tao Sun , Dou Shen , Hua-Jun Zeng , Qiang Yang , Yuchang Lu , Zheng Chen, Web-page summarization using clickthrough data, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076070]
• 20: Anastasios Tombros , Mark Sanderson, Advantages of query biased summaries in information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.2-10, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290947]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms, Design, Human Factors

Keywords:
click-through data, community, social bookmarks, summarization, web search