Information re-retrieval: repeat queries in Yahoo's logs

ABSTRACT

People often repeat Web searches, both to find new information on topics they have previously explored and to re-find information they have seen in the past. The query associated with a repeat search may differ from the initial query but can nonetheless lead to clicks on the same results. This paper explores repeat search behavior through the analysis of a one-year Web query log of 114 anonymous users and a separate controlled survey of an additional 119 volunteers. Our study demonstrates that as many as 40% of all queries are re-finding queries. Re-finding appears to be an important behavior for search engines to explicitly support, and we explore how this can be done. We demonstrate that changes to search engine results can hinder re-finding, and provide a way to automatically detect repeat searches and predict repeat clicks.

REFERENCES

• 1: Anne Aula , Natalie Jhaveri , Mika Käki, Information search and re-access strategies of experienced web users, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1060745.1060831]
• 2: Steven M. Beitzel , Eric C. Jensen , Abdur Chowdhury , David Grossman , Ophir Frieder, Hourly analysis of a very large topically categorized web query log, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009048]
• 3: Bruce, H., Jones, W. and Dumais, S. Keeping and re-finding information on the Web: What do people do and what do they need? In Proceedings of ASIST '04, 2004.
• 4: Robert G. Capra, III , Manuel A. Pérez-Quiñones, Using Web Search Engines to Find and Refind Information, Computer, v.38 n.10, p.36-42, October 2005 [doi>10.1109/MC.2005.355]
• 5: Cockburn, A., Greenberg, S., Jones, S., Mckenzie, B. and Moyle, M. Improving Web page revisitation: Analysis, design and evaluation. IT & Society, 1 (3), 2003, 159--183.
• 6: Susan Dumais , Edward Cutrell , JJ Cadiz , Gavin Jancke , Raman Sarin , Daniel C. Robbins, Stuff I've seen: a system for personal information retrieval and re-use, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860451]
• 7: Enquiro. Did-it, Enquiro, and Eyetools uncover search's golden triangle. www.enquiro.com/eye-tracking-pr.asp (last retrieved 9/29/2006)
• 8: Laura A. Granka , Thorsten Joachims , Geri Gay, Eye-tracking analysis of user behavior in WWW search, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009079]
• 9: Graphic, Visualization, and Usability Center. GVU's Tenth WWW User Survey, October 1998.
• 10: Bernard J. Jansen , Amanda Spink , Tefko Saracevic, Real life, real users, and real needs: a study and analysis of user queries on the web, Information Processing and Management: an International Journal, v.36 n.2, p.207-227, Jan.1.2000 [doi>10.1016/S0306-4573(99)00056-4 ]
• 11: Rosie Jones , Daniel C. Fain, Query word deletion prediction, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860538]
• 12: Anita Komlodi , Dagobert Soergel , Gary Marchionini, Search histories for user support in user interfaces, Journal of the American Society for Information Science and Technology, v.57 n.6, p.803-807, April 2006 [doi>10.1002/asi.v57:6]
• 13: Tessa Lau , Eric Horvitz, Patterns of search: analyzing and modeling Web query refinement, Proceedings of the seventh international conference on User modeling, p.119-128, June 1999, Banff, Canada
• 14: Hartmut Obendorf , Harald Weinreich , Eelco Herder , Matthias Mayer, Web page revisitation revisited: implications of a long-term click-stream study of browser usage, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240719]
• 15: Vijay V. Raghavan , Hayri Sever, On the reuse of past optimal queries, Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, p.344-350, July 09-13, 1995, Seattle, Washington, United States [doi>10.1145/215206.215381]
• 16: Rainie, L., and Shermak, J. Search engine use November 2005, Pew Internet & American Life Project, Washington DC, 2005.
• 17: Nancy C. M. Ross, End user searching on the Internet: an analysis of term pair topics submitted to the excite search engine, Journal of the American Society for Information Science, v.51 n.10, p.949-958, Aug. 2000 [doi>10.1002/1097-4571(2000)51:10<949::AID-ASI70>3.0.CO;2-5]
• 18: Sanderson, M. and Dumais, S. Examining repetition in user search behavior. In Proceedings of ECIR '07, 2007.
• 19: Linda Tauscher , Saul Greenberg, How people revisit web pages: empirical findings and implications for the design of history systems, International Journal of Human-Computer Studies, v.47 n.1, p.97-137, July 1997 [doi>10.1006/ijhc.1997.0125 ]
• 20: Jaime Teevan , David R. Karger, Supporting finding and re-finding through personalization, Massachusetts Institute of Technology, Cambridge, MA, 2007
• 21: Jaime Teevan , Eytan Adar , Rosie Jones , Michael Potts, History repeats itself: repeat queries in Yahoo's logs, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148326]
• 22: Jaime Teevan , Christine Alvarado , Mark S. Ackerman , David R. Karger, The perfect search engine is not enough: a study of orienteering behavior in directed search, Proceedings of the SIGCHI conference on Human factors in computing systems, p.415-422, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985745]
• 23: Peiling Wang , Michael W. Berry , Yiheng Yang, Mining longitudinal web queries: trends and patterns, Journal of the American Society for Information Science and Technology, v.54 n.8, p.743-758, June 2003 [doi>10.1002/asi.10262]
• 24: Steve Wedig , Omid Madani, A large-scale analysis of query logs for assessing personalization opportunities, Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, August 20-23, 2006, Philadelphia, PA, USA [doi>10.1145/1150402.1150497]
• 25: Query clustering using user logs, ACM Transactions on Information Systems (TOIS), v.20 n.1, p.59-81, January 2002 [doi>10.1145/503104.503108]
• 26: Ryen W. White , Steven M. Drucker, Investigating behavioral variability in web search, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242576]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Experimentation, Human Factors, Measurement

Keywords:
query log analysis, re-finding, repeat queries, web search