David Elsweiler
ABSTRACT
Personal Information Management (PIM) is a rapidly growing area of research concerned with how people store, manage and refind information. A feature of PIM research is that many systems have been designed to assist users manage and refind information, but very few have been evaluated. This has been noted by several scholars and explained by the difficulties involved in performing PIM evaluations. The difficulties include that people re-find information from within unique personal collections; researchers know little about the tasks that cause people to re-find information; and numerous privacy issues concerning personal information. In this paper we aim to facilitate PIM evaluations by addressing each of these difficulties. In the first part, we present a diary study of information re-finding tasks. The study examines the kind of tasks that require users to refind information and produces a taxonomy of refinding tasks for email messages and web pages. In the second part, we propose a task-based evaluation methodology based on our findings and examine the feasibility of the approach using two different methods of task creation.
- R. Boardman, Improving tool support for personal information management, Ph.D. thesis, Imperial College London, 2004.Google Scholar
- P. Borlund, The iir evaluation model: A framework for evaluation of interactive information retrieval systems, Information Research 8 (2003), no. 3, paper no. 152.Google Scholar
- K. Byström and K. Järvelin, Task complexity affects information seeking and use, Information Processing and Management 31 (1995), no. 2, 191--213. Google ScholarDigital Library
- R. G. Capra and M. A. Perez-Quinones, Re-finding found things: An exploratory study of how users re-find information, Tech. report, Virginia Tech, 2003.Google Scholar
- R. G. Capra and M. A. Perez-Quinones, Using web search engines to find and refind information, Computer 38 (2005), no. 10, 36--42. Google ScholarDigital Library
- R. G. Capra and M. A. Perez-Quinones, Factors and evaluation of refinding behaviors., SIGIR 2006 Workshop on Personal Information Management, August 10-11, 2006, Seattle, Washington, 2006.Google Scholar
- E. Cutrell, D. Robbins, S. Dumais, and R. Sarin, Fast, flexible filtering with phlat, Proc. SIGCHI '06 (New York, NY, USA), ACM Press, 2006, pp. 261--270. Google ScholarDigital Library
- M. Czerwinski, E. Horvitz, and S. Wilhite, A diary study of task switching and interruptions, Proc. SIGCHI '04, 2004, pp. 175--182. Google ScholarDigital Library
- S. Dumais, E. Cutrell, J. Cadiz, G. Jancke, R. Sarin, and D. C. Robbins, Stuff i've seen: a system for personal information retrieval and re-use, Proc. SIGIR '03:, 2003, pp. 72--79. Google ScholarDigital Library
- D. Elsweiler and I. Ruthven, Memory and email re-finding, In preparation for ACM TOIS CFP special issue on Keeping, Re-finding, and Sharing Personal Information (2007).Google Scholar
- D. Elsweiler, I. Ruthven, and C. Jones, Dealing with fragmented recollection of context in information management, Context-Based Information Retrieval (CIR-05) Workshop in CONTEXT-05, 2005.Google Scholar
- D. Elsweiler, I. Ruthven, and C. Jones, Towards memory supporting personal information management tools, (to appear in) Journal of the American Society for Information Science and Technology (2007). Google ScholarDigital Library
- D. Harman, What we have learned, and not learned, from trec, Proc. ECIR 2000, 2000.Google Scholar
- P. Ingwersen, Information retrieval interaction, Taylor Graham, 1992. Google ScholarDigital Library
- D. Kelly, B. Bederson, M. Czerwinski, J. Gemmell, W. Pratt, and M. Skeels (eds.), Pim workshop report: Measurement and design, 2005.Google Scholar
- D. Kelly and J. Teevan, (to appear in) personal information management, ch. Understanding what works: Evaluating personal information management tools, Seattle: University of Washington Press., 2007.Google Scholar
- B. H. Kwasnik, How a personal document's intended use or purpose affects its classification in an office, SIGIR'89 23 (1989), no. SI, 207--210. Google ScholarDigital Library
- M. W. Lansdale, The psychology of personal information management., Appl Ergon 19 (1988), no. 1, 55--66.Google ScholarCross Ref
- L. Palen and M. Salzman, Voice-mail diary studies for naturalistic data capture under mobile conditions, CSCW '02: Proceedings of the 2002 ACM conference on Computer supported cooperative work, 2002. Google ScholarDigital Library
- M. Ringel, E. Cutrell, S. Dumais, and E. Horvitz, Milestones in time: The value of landmarks in retrieving information from personal stores., Proc. INTERACT 2003, 2003.Google Scholar
- G. Robertson, M. Czerwinski, K. Larson, D. C. Robbins, D. Thiel, and M. van Dantzich, Data mountain: using spatial memory for document management, Proc. UIST '98:, 1998. Google ScholarDigital Library
- K. Rodden, How do people organise their photographs, BCS IRSG 21st Annual Colloquium on Information Retrieval Research, Glasgow, Scotland, 1999. Google ScholarDigital Library
- D. C. Rubin and A. E. Wenzel, One hundred years of forgetting: A quantitative description of retention, Psychological Bulletin 103 (1996), 734--760.Google Scholar
- A. J. Sellen and R. H. R. Harper, The myth of the paperless office, MIT Press, Cambridge, MA, USA, 2003. Google ScholarDigital Library
- P. Vakkari, Task complexity, problem structure and information actions: Integrating studies in on information seeking and retrieval., Information Processing and Management 35 (1999), 819--837. Google ScholarDigital Library
- P. Vakkari, A theory of task-based information retrieval, Journal of Documentation 57 (2001), no. 1, 44--60.Google ScholarCross Ref
Index Terms
- Towards task-based personal information management evaluations
Recommendations
Personal information management
CHI EA '04: CHI '04 Extended Abstracts on Human Factors in Computing SystemsPersonal Information Management (PIM) is the management of information (e.g. files, emails, and bookmarks) by an individual in support of his/her roles and tasks. Although PIM is practiced daily by millions of people, a research community has never been ...
Factors in Personal Information Management Evaluation
Advances in Visual InformaticsAbstractPersonal Information Management (PIM) is the domain that involves methods and procedures to study how people keep, manage, maintain and re-find information. Related studies show that re-finding could be a difficult and time-consuming task due to ...
Exploring the design space for personal information management tools
CHI EA '01: CHI '01 Extended Abstracts on Human Factors in Computing SystemsThe storing and retrieval of personal and work-related information from large capacity storage devices has become tedious and haphazard especially for individuals that are not technologically or computer literate. There must be a better a way to help ...
Comments