Personalizing Information Retrieval Using Search Behaviors and Time Constraints

ABSTRACT

Studies have examined how time constraints influence search behaviors; however, no effort has been spent on how time constraints may help predict document usefulness for personalization purposes. This study aims to fill this gap by researching the relationships between time constraints, search behaviors, and usefulness judgments. A controlled lab experiment was conducted with 40 participants searching for four tasks of two types (fact finding and information understanding), under two time conditions (with or without time constraints). Results show that time constraints and usefulness had interaction effects on first dwell time; while usefulness had positive relationship with total dwell time. Results indicate that knowing time constraints helps predict document usefulness from dwell time. The findings provide implications on personalization in information search.

References

1. Anderson, L. W.&Krathwohl, D. A. (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom's taxonomy of educational objectives. New York: Longman.
2. Box, G. E. P., Cox, D. R. (1964). An Analysis of Transformations. Journal of the Royal Statistical Society, 26(2), 211--252.
3. Burton, R.,&Collins-Thompson, K. (2016). User Behavior in Asynchronous Slow Search. The International ACM SIGIR Conference (pp.345--354). ACM.
4. Crescenzi, A., Capra, R.,&Arguello, J. (2013). Time Pressure, User Satisfaction and Task Difficulty. Proceedings of ASIS&T 13'.
5. Crescenzi,A., Kelly, D., and Azzopardi, L. (2015). Time Pressure and System Delays in Information Search. SIGIR '15.
6. Crescenzi,A., Kelly, D., and Azzopardi, L. (2016). Impacts of Time Constraints and System Delays on User Experience. Proceedings of CHIIR'16.
7. Kelly, D.,&Belkin, N.J. (2004). Display time as implicit feedback: Understanding task effects. Proceedings of SIGIR 04' (pp. 377--384).ACM.
8. Liu, C., Belkin, N. J.,&Cole, M. J. (2012). Personalization of search results using interaction behaviors in search sessions. Proceedings of SIGIR 12' (pp.205--214). ACM.
9. Liu, C.,&Wei, Y. (2016). The impacts of time constraint on users' search strategy during search process. Proceedings of the Association for Information Science&Technology, 53(1), 1--9.
10. Liu, C., Yang, F., Zhao, Y., Jiang, Q.,&Zhang, L. (2014). What does time constraint mean to information searchers'. Information Interaction in Context Symposium (pp.227--230). ACM.
11. Liu, J.,&Belkin, N. J. (2010). Personalizing information retrieval for multisession tasks: The roles of task stage and task type. Proceeding of SIGIR 2010', Geneva, Switzerland, July (Vol.66, pp.26--33).
12. Luo, C., Zhang, F., Li, X., Liu, Y., Zhang, M.,&Ma, S., et al. (2016). Manipulating Time Perception of Web Search Users. CHIIR 16' (pp.293- 296). ACM.
13. Mishra, N., White, R. W., Ieong, S.,&Horvitz, E. (2014). Time-critical search. Proceedings of SIGIR 14' (pp.747--756). ACM.
14. Morita, M.,&Shinoda, Y. (1994). Information filtering based on user behavior analysis and best match text retrieval. SIGIR 94', 272--281.
15. Teevan, J., Collins-Thompson, K., White, R. W., Dumais, S. T.,&Kim, Y. (2013). Slow Search: Information Retrieval without Time Constraints.
16. Vakkari, P., Luoma, A.,&Ntinen, J. (2014). Books' interest grading and dwell time in metadata in selecting fiction. Information Interaction in Context Symposium (pp.28--37). ACM.
17. Weenig, M. W.,&Maarleveld, M. (2002). The impact of time constraints on information search strategies in complex choice tasks. Journal of Economic Psychology, 23(6), 689--702.
18. White, R. W.,&Kelly, D. (2006). A study on the effects of personalization and task information on implicit feedback performance. CIKM 2006', Arlington, Virginia, USA, November (Vol.92, pp.297--306). DBLP.

Index Terms

• Information systems

  • Information retrieval

    • Users and interactive retrieval

      • Personalization