Summarizing email conversations with clue words

ABSTRACT

Accessing an ever increasing number of emails, possibly on small mobile devices, has become a major problem for many users. Email summarization is a promising way to solve this problem. In this paper, we propose a new framework for email summarization. One novelty is to use a fragment quotation graph to try to capture an email conversation. The second novelty is to use clue words to measure the importance of sentences in conversation summarization. Based on clue words and their scores, we propose a method called CWS, which is capable of producing a summary of any length as requested by the user. We provide a comprehensive comparison of CWS with various existing methods on the Enron data set. Preliminary results suggest that CWS provides better summaries than existing methods.

REFERENCES

• 1: Regina Barzilay and Michael Elhadad. Using lexical chains for text summarization. In Proceedings of the Intelligent Scalable Text Summarization Workshop (ISTS'97), ACL, Madrid, Spain, 1997.
• 2: Giuseppe Carenini , Raymond T. Ng , Xiaodong Zhou, Scalable discovery of hidden emails from large folders, Proceeding of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining, August 21-24, 2005, Chicago, Illinois, USA [doi>10.1145/1081870.1081934]
• 3: Giuseppe Carenini , Raymond Ng , Xiaodong Zhou , Ed Zwart, Discovery and regeneration of hidden emails, Proceedings of the 2005 ACM symposium on Applied computing, March 13-17, 2005, Santa Fe, New Mexico [doi>10.1145/1066677.1066792]
• 4: Chris Schmandt Derek Lam, Steven L. Rohall and Mia K. Stern. Exploiting e-mail structure to improve summarization. In CSCW'02 Poster Session, 2002.
• 5: Günes Erkan and Dragomir R. Radev. Lexrank: Graph-based lexical centrality as salience in text summarization. Journal of Artificial Intelligence Research(JAIR), 22:457--479, 2004.
• 6: Aaron Harnly Jen-Yuan Yeh. Email thread reassembly using similarity matching. In Third Conference on Email and Anti-Spam (CEAS), July 27--28 2006.
• 7: Dragomir R. Radev , Hongyan Jing , Małgorzata Styś , Daniel Tam, Centroid-based summarization of multiple documents, Information Processing and Management: an International Journal, v.40 n.6, p.919-938, November 2004 [doi>10.1016/j.ipm.2003.10.006]
• 8: Rakesh Agrawal , Sridhar Rajagopalan , Ramakrishnan Srikant , Yirong Xu, Mining newsgroups using networks arising from social behavior, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775227]
• 9: Owen Rambow, Lokesh Shrestha, John Chen, and Chirsty Lauridsen. Summarizing email threads. In HLT/NAACL, May 2-7 2004.
• 10: Gordon Rios and Hongyuan Zha. Exploring support vector machines and random forests for spam detection. In First Conference on Email and Anti-Spam (CEAS), July 30--31, 2004.
• 11: Lokesh Shrestha , Kathleen McKeown, Detection of question-answer pairs in email conversations, Proceedings of the 20th international conference on Computational Linguistics, p.889-es, August 23-27, 2004, Geneva, Switzerland [doi>10.3115/1220355.1220483]
• 12: Salvatore J. Stolfo , Shlomo Hershkop , Chia-Wei Hu , Wei-Jen Li , Olivier Nimeskern , Ke Wang, Behavior-based modeling and its application to Email analysis, ACM Transactions on Internet Technology (TOIT), v.6 n.2, p.187-221, May 2006 [doi>10.1145/1149121.1149125]
• 13: Jie Tang , Hang Li , Yunbo Cao , Zhaohui Tang, Email data cleaning, Proceeding of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining, August 21-24, 2005, Chicago, Illinois, USA [doi>10.1145/1081870.1081926]
• 14: Gina Danielle Venolia , Carman Neustaedter, Understanding sequence and reply relationships within email conversations: a mixed-model visualization, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642674]
• 15: Stephen Wan , Kathy McKeown, Generating overview summaries of ongoing email thread discussions, Proceedings of the 20th international conference on Computational Linguistics, p.549-es, August 23-27, 2004, Geneva, Switzerland [doi>10.3115/1220355.1220434]
• 16: Xiaojun Wan and Jianwu Yang. Improved affinity graph based multi-document summarization. In HLT/NAACL, June 2006.
• 17: Steve Whittaker , Candace Sidner, Email overload: exploring personal information management of email, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.276-283, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238530]
• 18: Jihoon Yang , Sung-Yong Park, Email Categorization Using Fast Machine Learning Algorithms, Proceedings of the 5th International Conference on Discovery Science, p.316-323, November 24-26, 2002

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

General Terms:
Algorithms

Keywords:
email summarization, text mining