What are you looking for?: an eye-tracking study of information usage in web search

ABSTRACT

Web search services are among the most heavily used applications on the World Wide Web. Perhaps because search is used in such a huge variety of tasks and contexts, the user interface must strike a careful balance to meet all user needs. We describe a study that used eye tracking methodologies to explore the effects of changes in the presentation of search results. We found that adding information to the contextual snippet significantly improved performance for informational tasks but degraded performance for navigational tasks. We discuss possible reasons for this difference and the design implications for better presentation of search results.

REFERENCES

• 1: Andrei Broder, A taxonomy of web search, ACM SIGIR Forum, v.36 n.2, Fall 2002 [doi>10.1145/792550.792552]
• 2: Brumby, D.P. and Howes, A. Good enough but I'll just check: Web-page search as attentional refocusing. Proc. 6th Int'l Conference on Cognitive Modeling, Lawrence Erlbaum (2004), 46--50.
• 3: Stuart K. Card , Peter Pirolli , Mija Van Der Wege , Julie B. Morrison , Robert W. Reeder , Pamela K. Schraedley , Jenea Boshart, Information scent as a driver of Web behavior graphs: results of a protocol analysis method for Web usability, Proceedings of the SIGCHI conference on Human factors in computing systems, p.498-505, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365331]
• 4: Ed H. Chi , Peter Pirolli , Kim Chen , James Pitkow, Using information scent to model user information needs and actions and the Web, Proceedings of the SIGCHI conference on Human factors in computing systems, p.490-497, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365325]
• 5: Edward Cutrell , Susan T. Dumais , Jaime Teevan, Searching to eliminate personal information management, Communications of the ACM, v.49 n.1, January 2006 [doi>10.1145/1107458.1107492]
• 6: Cutrell, E., & Guan, Z. Eye tracking in MSN Search: Investigating snippet length, target position and task types. Microsoft Technical Report, MSR-TR-2007-01. ftp://ftp.research.microsoft.com/pub/tr/TR-2007-01.pdf. (2007).
• 7: Susan Dumais , Edward Cutrell , Hao Chen, Optimizing search by showing results in context, Proceedings of the SIGCHI conference on Human factors in computing systems, p.277-284, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365116]
• 8: Zhiwei Guan , Edward Cutrell, An eye tracking study of the effect of target rank on web search, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240691]
• 9: Anthony J. Hornof , Tim Halverson, Cognitive strategies and eye movements for searching hierarchical computer displays, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642656]
• 10: Hotchkiss, G., Alston, S. and Edwards, G. Eye Tracking Study. http://www.enquiro.com/eyetrackingreport.asp.
• 11: Bernard J. Jansen , Udo Pooch, A review of web searching studies and a framework for future research, Journal of the American Society for Information Science and Technology, v.52 n.3, p.235-246, Feb. 1, 2001 [doi>10.1002/1097-4571(2000)9999:9999<::AID-ASI1607>3.3.CO;2-6]
• 12: Thorsten Joachims , Laura Granka , Bing Pan , Helene Hembrooke , Geri Gay, Accurately interpreting clickthrough data as implicit feedback, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076063]
• 13: Kerstin Klöckner , Nadine Wirschum , Anthony Jameson, Depth- and breadth-first processing of search result lists, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986115]
• 14: Tessa Lau , Eric Horvitz, Patterns of search: analyzing and modeling Web query refinement, Proceedings of the seventh international conference on User modeling, p.119-128, June 1999, Banff, Canada
• 15: Uichin Lee , Zhenyu Liu , Junghoo Cho, Automatic identification of user goals in Web search, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1060745.1060804]
• 16: Jimmy Lin , Dennis Quan , Vineet Sinha , Karun Bakshi , David Huynh , Boris Katz , David R. Karger, The role of context in question answering systems, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.766119]
• 17: Lori Lorigo , Bing Pan , Helene Hembrooke , Thorsten Joachims , Laura Granka , Geri Gay, The influence of task and gender on search and evaluation behavior using Google, Information Processing and Management: an International Journal, v.42 n.4, p.1123-1131, July 2006 [doi>10.1016/j.ipm.2005.10.001]
• 18: Mazlita Mat-Hassan , Mark Levene, Associating search and navigation behavior through log analysis: Research Articles, Journal of the American Society for Information Science and Technology, v.56 n.9, p.913-934, July 2005 [doi>10.1002/asi.v56:9]
• 19: Pratt, W. and Fagan, L. The usefulness of dynamically categorizing search results. J American Medical Informatics Association, 7 6(2000), 605--617.
• 20: Rele, R.S. and Duchowski, A.T. Using eye tracking to evaluate alternate search results interfaces. In Proc. HFES,49th Annual Meeting (2005).
• 21: Daniel E. Rose, Reconciling information-seeking behavior with search user interfaces for the Web, Journal of the American Society for Information Science and Technology, v.57 n.6, p.797-799, April 2006 [doi>10.1002/asi.v57:6]
• 22: Daniel E. Rose , Danny Levinson, Understanding user goals in web search, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988675]
• 23: Silverstein, C., Henzinger, M., Marais, H. and Moricz, M. Analysis of a very large AltaVista query log. SRC Technical note #1998-14. http://gatekeeper.dec.com/ pub/DEC/SRC/technical-notes/abstracts/src-tn-1998-014.html. (1998).
• 24: Jaime Teevan , Christine Alvarado , Mark S. Ackerman , David R. Karger, The perfect search engine is not enough: a study of orienteering behavior in directed search, Proceedings of the SIGCHI conference on Human factors in computing systems, p.415-422, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985745]
• 25: Ka-Ping Yee , Kirsten Swearingen , Kevin Li , Marti Hearst, Faceted metadata for image search and browsing, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642681]
• 26: Junliang Zhang , Gary Marchionini, Evaluation and evolution of a browse and search interface: relation browser, Proceedings of the 2005 national conference on Digital government research, May 15-18, 2005, Atlanta, Georgia

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

General Terms:
Experimentation, Human Factors

Keywords:
contextual snippets, eye tracking, user studies, web search