ABSTRACT
When search results fail to satisfy users» information needs, users often reformulate their search query in the hopes of receiving better results. In many cases, users immediately requery without clicking on any search results. In this paper, we report on a user study designed to investigate the rate at which users immediately reformulate at different levels of search quality. We had users search for answers to questions as we manipulated the placement of the only relevant document in a ranked list of search results. We show that as the quality of search results decreases, the probability of immediately requerying increases. We find that users can quickly decide to immediately reformulate, and the time to immediately reformulate appears to be independent of the quality of the search results. Finally, we show that there appears to be two types of users. One group has a high probability of immediately reformulating and the other is unlikely to immediately reformulate unless no relevant documents can be found in the search results. While requerying takes time, it is the group of users who are more likely to immediately requery that are able to able find answers to questions the fastest.
- Anne Aula, Päivi Majaranta, and Kari-Jouko Räihä. 2005. Eye-Tracking Reveals the Personal Styles for Search Result Evaluation. In Human-Computer Interaction -- INTERACT 2005 ( LNCS), Vol. 3585, 1058--1061. Google ScholarDigital Library
- Leif Azzopardi. 2011. The economics in interactive information retrieval. In SIGIR, 15--24. Google ScholarDigital Library
- Leif Azzopardi, Kalervo Järvelin, Jaap Kamps, and Mark D. Smucker. 2011. Report on the SIGIR 2010 workshop on the simulation of interaction. SIGIR Forum 44 (January 2011), 35--47. Issue 2. Google ScholarDigital Library
- Feza Baskaya, Heikki Keskustalo, and Kalervo Järvelin. 2012. Time Drives Interaction: Simulating Sessions in Diverse Searching Environments. In SIGIR, 105--114. Google ScholarDigital Library
- Ben Carterette, Evangelos Kanoulas, and Emine Yilmaz. 2011. Simulating simple user behavior for system effectiveness evaluation. In CIKM, 611--620. Google ScholarDigital Library
- Charles L.A. Clarke, Luanne Freund, Mark D. Smucker, and Emine Yilmaz. 2013. Report on the SIGIR 2013 Workshop on Modeling User Behavior for Information Retrieval Evaluation (MUBE 2013). SIGIR Forum 47, 2 (Jan. 2013), 84--95. Google ScholarDigital Library
- Edward Cutrell and Zhiwei Guan. 2007. What are you looking for?: an eyetracking study of information usage in web search. In SIGCHI, 407--416. Google ScholarDigital Library
- Arjen P. de Vries, Gabriella Kazai, and Mounia Lalmas. 2004. Tolerance to Irrelevance: A User-effort Oriented Evaluation of Retrieval Systems without Predefined Retrieval Unit. In RIAO, 463--473. Google ScholarDigital Library
- Abdigani Diriye, Ryen White, Georg Buscher, and Susan Dumais. 2012. Leaving so soon?: understanding and predicting web search abandonment rationales. In CIKM, 1025--1034. Google ScholarDigital Library
- Susan T. Dumais, Georg Buscher, and Edward Cutrell. 2010. Individual differences in gaze patterns for web search. In IIiX, 185--194. Google ScholarDigital Library
- Laura A. Granka, Thorsten Joachims, and Geri Gay. 2004. Eye-tracking analysis of user behavior in WWW search. In SIGIR, 478--479. Google ScholarDigital Library
- Marti A. Hearst. 2009. Search User Interfaces (1st ed.). Cambridge University Press. Google ScholarDigital Library
- Jeff Huang, Ryen W White, and Susan Dumais. 2011. No clicks, no problem: using cursor movements to understand and improve search. In SIGCHI, 1225--1234. Google ScholarDigital Library
- Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay. 2005. Accurately interpreting clickthrough data as implicit feedback. In SIGIR, 154--161. Google ScholarDigital Library
- Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, Filip Radlinski, and Geri Gay. 2007. Evaluating the Accuracy of Implicit Feedback from Clicks and Query Reformulations in Web Search. ACM TOIS 25, 2 (2007), 1--27. Google ScholarDigital Library
- Thorsten Joachims and Filip Radlinski. 2007. Search Engines That Learn from Implicit Feedback. Computer 40, 8 (Aug. 2007), 34--40. Google ScholarDigital Library
- Kerstin Klöckner, Nadine Wirschum, and Anthony Jameson. 2004. Depth- and breadth-first processing of search result lists. In SIGCHI extended abstracts, 1539-- 1539. Google ScholarDigital Library
- Jane Li, Scott Huffman, and Akihito Tokuda. 2009. Good Abandonment in Mobile and PC Internet Search. In SIGIR, 43--50. Google ScholarDigital Library
- Lori Lorigo, Maya Haridasan, Hrönn Brynjarsdóttir, Ling Xia, Thorsten Joachims, Geri Gay, Laura Granka, Fabio Pellacini, and Bing Pan. 2008. Eye tracking and online search: Lessons learned and challenges ahead. JASIS 59, 7 (2008), 1041-- 1052. Google ScholarDigital Library
- Lori Lorigo, Maya Haridasan, Hrönn Brynjarsdóttir, Ling Xia, Thorsten Joachims, Geri Gay, Laura Granka, Fabio Pellacini, and Bing Pan. 2008. Eye tracking and online search: Lessons learned and challenges ahead. JAIST 59, 7 (2008), 1041-- 1052. Google ScholarDigital Library
- Andrew MacFarlane, George Buchanan, Areej Al-Wabil, Gennady Andrienko, and Natalia Andrienko. 2017. Visual Analysis of Dyslexia on Search. In CHIIR, 285--288. Google ScholarDigital Library
- David Maxwell, Leif Azzopardi, Kalervo Järvelin, and Heikki Keskustalo. 2015. Searching and Stopping: An Analysis of Stopping Rules and Strategies. In CIKM, 313--322. Google ScholarDigital Library
- Teemu Pääkkönen, Jaana Kekäläinen, Heikki Keskustalo, Leif Azzopardi, David Maxwell, and Kalervo Järvelin. 2017. Validating simulated interaction for retrieval evaluation. Information Retrieval (2017), 1--25. Google ScholarDigital Library
- Filip Radlinski, Madhu Kurup, and Thorsten Joachims. 2008. How Does Clickthrough Data Reflect Retrieval Quality?. In CIKM, 43--52. Google ScholarDigital Library
- Mark D. Smucker and Charles L.A. Clarke. 2012. Time-based calibration of effectiveness measures. In SIGIR, 95--104. Google ScholarDigital Library
- Mark D. Smucker and Charles L.A. Clarke. 2016. Modeling Optimal Switching Behavior. In CHIIR, 317--320. Google ScholarDigital Library
- Mark D. Smucker and Charles L. A. Clarke. 2012. Modeling User Variance in Time-Biased Gain. In HCIR. ACM, 1--10. Google ScholarDigital Library
- Sofia Stamou and Efthimis N Efthimiadis. 2009. Queries without clicks: Successful or failed searches. In SIGIR 2009 Workshop on the Future of IR Evaluation. 13--14.Google Scholar
- Sofia Stamou and Efthimis N. Efthimiadis. 2010. Interpreting User Inactivity on Search Results. In ECIR, 100--113. Google ScholarDigital Library
- Paul Thomas, Alistair Moffat, Peter Bailey, and Falk Scholer. 2014. Modeling Decision Points in User Search Behavior. In IIiX, 239--242. Google ScholarDigital Library
- Wan-Ching Wu and Diane Kelly. 2014. Online search stopping behaviors: An investigation of query abandonment and task stopping. Proceedings of the Association for Information Science and Technology 51, 1 (2014), 1--10.Google ScholarCross Ref
- Wan-Ching Wu, Diane Kelly, and Avneesh Sud. 2014. Using information scent and need for cognition to understand online search behavior. In SIGIR, 557--566. Google ScholarDigital Library
Index Terms
A Study of Immediate Requery Behavior in Search
Recommendations
Patterns of Search Result Examination: Query to First Action
CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge ManagementTo determine key factors that affect a user's behavior with search results, we conducted a controlled eye-tracking study of users completing search tasks using both desktop and mobile devices. We focus our investigation on users' behavior from their ...
The Effect of Queries and Search Result Quality on the Rate of Query Abandonment in Interactive Information Retrieval
CHIIR '20: Proceedings of the 2020 Conference on Human Information Interaction and RetrievalWhen a search result does not satisfy a user's needs, the user often abandons their query and submits a reformulated query in the hopes of receiving better search results. The action of abandoning search results is termed query abandonment, and previous ...
The Dark Side of Relevance: The Effect of Non-Relevant Results on Search Behavior
CHIIR '22: Proceedings of the 2022 Conference on Human Information Interaction and RetrievalUnderstanding and modelling user behavior with search results is important to both search engine designers and the design of effectiveness measures. It is well established that users are less likely to view lower ranked search results, and recent ...
Comments