ABSTRACT
People need to find, work with, and put together information. Diverse activities, such as scholarly research, comparison shopping, and entertainment involve collecting and connecting information resources. We need to represent collections in ways that promote understanding of individual information resources and also their relationships. Representing individual resources with images as well as text makes good use of human cognitive facilities. Composition, an alternative to lists, means putting representations of elements in a collection together using design principles to form a connected whole.We develop combinFormation, a mixed-initiative system for representing collections as compositions of image and text surrogates. The system provides a set of direct manipulation facilities for forming, editing, organizing, and distributing collections as compositions. Additionally, to assist users in sifting through the vast expanse of potentially relevant information resources, the system also includes a generative agent that can proactively engage in processes of collecting information resources and forming image and text surrogates. A generative temporal visual composition agent develops the collection and its visual representation over time, enabling users to see more possibilities. To keep the user in control, we develop interactive techniques that enable the user to direct the agent.For evaluation, we conducted a field study in an undergraduate general education course offered in the architecture department. Alternating groups of students used combinFormation as an aid in preparing one of two major assignments involving information discovery to support processes of invention. The students that used combinFormation were found to perform better.
- Amar, R., Stasko, J., A Knowledge Task-Based Framework for Design & Evaluation of Information Visualizations, Proc InfoVis 2004.]] Google ScholarDigital Library
- Baddeley, A.D., Is working memory working?, Quarterly Journal of Exp Psych, 44A, 1--31, 1992.]]Google ScholarCross Ref
- Belkin, N., ASK for Information Retrieval: Part I. Background and Theory, Journal of Documentation, Vol 38, Num 2, 1982.]]Google ScholarCross Ref
- Burke, M., Organization of Multimedia Resources, Hampshire, UK: Gower, 1999.]]Google Scholar
- Chang, M., Leggett, J.J., Furuta, R., Kerne, A., Williams, J.P., Burns, S.A., Bias, R.G., Collection Understanding, Proc JCDL 2004.]] Google ScholarDigital Library
- Diligenti, M., Coetzee, F., Lawrence, S., Giles, C.L., Gori, M., Focused Crawling using Context Graphs, Proc VLDB 2000.]] Google ScholarDigital Library
- Ding, W., Marchionini, G., Soergel, D., Multimodal Surrogates for Video Browsing, Proc DL 1999, 85--93.]] Google ScholarDigital Library
- Finke, R., Ward, T., Smith, S.M., Creative Cognition, Cambridge, MA, MIT Press, 1992.]]Google Scholar
- Gentner, D., Stevens, A.L., eds., Mental Models, Hillsdale, NJ: Erlbaum, 99--129, 1983.]]Google Scholar
- Glenberg, A.M., Langston, W.E., Comprehension of illustrated text: Pictures help to build mental models, Journal of Memory & Language, 31(2):129--151, April 1992.]]Google ScholarCross Ref
- Horvitz, E., Principles of Mixed-Initiative User Interfaces, Proc CHI 1999, pp. 159--166.]] Google ScholarDigital Library
- Jones, W., Dumais, S., Bruce, H., Once found, what then?: a study of 'keeping' behaviors in personal use of Web information. Proc ASIST 2002, November 18--21, 2002, 391--402.]]Google Scholar
- Interface Ecology Lab, combinFormation, http://ecologylab.cs.tamu.edu/combinFormation/]]Google Scholar
- Kerne, A., CollageMachine, A Model of Interface Ecology, NYU Ph.D. Dissertation, 2001.]] Google ScholarDigital Library
- Kerne, A., Khandelwal, M, Publishing Evolving Metadocuments on the Web, Proc Hypertext 2003, 104--105.]] Google ScholarDigital Library
- Kerne, A., Smith, S., The Information Discovery Framework, Proc DIS 2004, 357--360.]] Google ScholarDigital Library
- Kerne, A., Smith, S.M., Mistrot, J.M., Sundaram, V., Khandelwal, M., Mapping Interest and Design to Facilitate Creative Process During Mixed-Initiative Information Composition, Proc Interaction: Systems, Practice and Theory, Creativity & Cognition Symposium 2004, 1--25.]]Google Scholar
- Kerne, A., Smith, S.M., Choi, H., Graeber, R., Caruso, D., Evaluating Navigational Surrogate Formats with Divergent Browsing Tasks, Proc CHI 2005 Extended, 1537--40.]] Google ScholarDigital Library
- Kerne, A., Koh, E., Smith, S.M., Choi, H., Graeber, R., Caruso, D., Composition of Image and Text Surrogates Supports Expression During Information Discovery, submitted to DIS06.]]Google Scholar
- Marchionini, G., Information Seeking in Electronic Environments, Cambridge Univ Press, 1997.]] Google ScholarDigital Library
- Marshall, C.C., Shipman, F.M., VIKI: Spatial hypertext supporting emergent structure, Proc ECHT 1994, 13--23.]] Google ScholarDigital Library
- McNee, S.M. Lam, S. Konstan, J.A., Riedl, J. Interfaces for Eliciting New User Preferences in Recommender Systems. Proc User Modeling 2003, 178--188.]]Google Scholar
- Morrison, J.B., Pirolli, P., Card, S.K., A Taxonomic Analysis of What World Wide Web Activities Significantly Impact People's Decisions and Actions, Proc CHI 2001 Extended.]] Google ScholarDigital Library
- Oxford English Dictionary on Compact Disk, 2nd Edition. Oxford: Oxford University Press, 1992.]] Google ScholarDigital Library
- Pirolli, P., Card, S.K., Information Foraging, Psychological Review, 106:4, Oct 1999, 643--675.]]Google ScholarCross Ref
- Pirolli, P., Pitkow, J., Rao, R.. Silk from a Sow's Ear: Extracting Usable Structures from the Web, Proc CHI 1996.]] Google ScholarDigital Library
- Porter, M. F., An algorithm for suffix stripping, Program, 14(3), 1980, 130--137.]]Google ScholarCross Ref
- Rocchio, J., Relevance feedback in information retrieval, In The Smart Retrieval System-Experiments in Automatic Document Processing, Prentice-Hall, Englewood Cliffs, NJ, 313--323, 1971.]]Google Scholar
- Salton, G., McGill, M.J., Introduction to Modern Information Retrieval, New York, McGraw-Hill, 1983.]] Google ScholarDigital Library
- Shneiderman, B., Maes, P., Direct Manipulation vs. Interface Agents, ACM Interactions, 4:6, Nov 1997.]] Google ScholarDigital Library
- Shah, J. J., Smith, S. M., Vargas-Hernandez, N., Gerkens, R., & Wulan, M., Empirical studies of design ideation: Alignment of design experiments with laboratory experiments, Proc Am Soc Mechanical Engineering, 2003.]]Google ScholarCross Ref
- Tufte, E., Envisioning Information, :Cheshire, Connecticut: Graphics Press, 1990.]] Google ScholarDigital Library
- Woodruff, A. Rosenholtz R., Morrison, J., Faulring, A., Pirolli, P., A Comparison of the Use of Text Summaries, Plain Thumbnails, and Enhanced Thumbnails for Web Search Tasks, JASIST 53(2):172--185, 2002.]] Google ScholarDigital Library
Index Terms
- combinFormation: a mixed-initiative system for representing collections as compositions of image and text surrogates
Recommendations
combinFormation: Mixed-initiative composition of image and text surrogates promotes information discovery
combinFormation is a mixed-initiative creativity support tool for searching, browsing, organizing, and integrating information. Images and text are connected to represent surrogates (enhanced bookmarks), optimizing the use of human cognitive facilities. ...
Evaluating navigational surrogate formats with divergent browsing tasks
CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing SystemsNavigational surrogates are representations that stand for information resources within search engine result sets, e?commerce sites, and digital libraries. They also form the basis of personal collections of media, such as web pages. Our hypothesis is ...
Data structure aware garbage collector
ISMM '15Garbage collection may benefit greatly from knowledge about program behavior, but most managed languages do not provide means for the programmer to deliver such knowledge. In this work we propose a very simple interface that requires minor programmer ...
Comments