skip to main content
10.1145/1141753.1141756acmconferencesArticle/Chapter ViewAbstractPublication PagesjcdlConference Proceedingsconference-collections
Article

combinFormation: a mixed-initiative system for representing collections as compositions of image and text surrogates

Published: 11 June 2006 Publication History

Abstract

People need to find, work with, and put together information. Diverse activities, such as scholarly research, comparison shopping, and entertainment involve collecting and connecting information resources. We need to represent collections in ways that promote understanding of individual information resources and also their relationships. Representing individual resources with images as well as text makes good use of human cognitive facilities. Composition, an alternative to lists, means putting representations of elements in a collection together using design principles to form a connected whole.We develop combinFormation, a mixed-initiative system for representing collections as compositions of image and text surrogates. The system provides a set of direct manipulation facilities for forming, editing, organizing, and distributing collections as compositions. Additionally, to assist users in sifting through the vast expanse of potentially relevant information resources, the system also includes a generative agent that can proactively engage in processes of collecting information resources and forming image and text surrogates. A generative temporal visual composition agent develops the collection and its visual representation over time, enabling users to see more possibilities. To keep the user in control, we develop interactive techniques that enable the user to direct the agent.For evaluation, we conducted a field study in an undergraduate general education course offered in the architecture department. Alternating groups of students used combinFormation as an aid in preparing one of two major assignments involving information discovery to support processes of invention. The students that used combinFormation were found to perform better.

References

[1]
Amar, R., Stasko, J., A Knowledge Task-Based Framework for Design & Evaluation of Information Visualizations, Proc InfoVis 2004.]]
[2]
Baddeley, A.D., Is working memory working?, Quarterly Journal of Exp Psych, 44A, 1--31, 1992.]]
[3]
Belkin, N., ASK for Information Retrieval: Part I. Background and Theory, Journal of Documentation, Vol 38, Num 2, 1982.]]
[4]
Burke, M., Organization of Multimedia Resources, Hampshire, UK: Gower, 1999.]]
[5]
Chang, M., Leggett, J.J., Furuta, R., Kerne, A., Williams, J.P., Burns, S.A., Bias, R.G., Collection Understanding, Proc JCDL 2004.]]
[6]
Diligenti, M., Coetzee, F., Lawrence, S., Giles, C.L., Gori, M., Focused Crawling using Context Graphs, Proc VLDB 2000.]]
[7]
Ding, W., Marchionini, G., Soergel, D., Multimodal Surrogates for Video Browsing, Proc DL 1999, 85--93.]]
[8]
Finke, R., Ward, T., Smith, S.M., Creative Cognition, Cambridge, MA, MIT Press, 1992.]]
[9]
Gentner, D., Stevens, A.L., eds., Mental Models, Hillsdale, NJ: Erlbaum, 99--129, 1983.]]
[10]
Glenberg, A.M., Langston, W.E., Comprehension of illustrated text: Pictures help to build mental models, Journal of Memory & Language, 31(2):129--151, April 1992.]]
[11]
Horvitz, E., Principles of Mixed-Initiative User Interfaces, Proc CHI 1999, pp. 159--166.]]
[12]
Jones, W., Dumais, S., Bruce, H., Once found, what then?: a study of 'keeping' behaviors in personal use of Web information. Proc ASIST 2002, November 18--21, 2002, 391--402.]]
[13]
Interface Ecology Lab, combinFormation, http://ecologylab.cs.tamu.edu/combinFormation/]]
[14]
Kerne, A., CollageMachine, A Model of Interface Ecology, NYU Ph.D. Dissertation, 2001.]]
[15]
Kerne, A., Khandelwal, M, Publishing Evolving Metadocuments on the Web, Proc Hypertext 2003, 104--105.]]
[16]
Kerne, A., Smith, S., The Information Discovery Framework, Proc DIS 2004, 357--360.]]
[17]
Kerne, A., Smith, S.M., Mistrot, J.M., Sundaram, V., Khandelwal, M., Mapping Interest and Design to Facilitate Creative Process During Mixed-Initiative Information Composition, Proc Interaction: Systems, Practice and Theory, Creativity & Cognition Symposium 2004, 1--25.]]
[18]
Kerne, A., Smith, S.M., Choi, H., Graeber, R., Caruso, D., Evaluating Navigational Surrogate Formats with Divergent Browsing Tasks, Proc CHI 2005 Extended, 1537--40.]]
[19]
Kerne, A., Koh, E., Smith, S.M., Choi, H., Graeber, R., Caruso, D., Composition of Image and Text Surrogates Supports Expression During Information Discovery, submitted to DIS06.]]
[20]
Marchionini, G., Information Seeking in Electronic Environments, Cambridge Univ Press, 1997.]]
[21]
Marshall, C.C., Shipman, F.M., VIKI: Spatial hypertext supporting emergent structure, Proc ECHT 1994, 13--23.]]
[22]
McNee, S.M. Lam, S. Konstan, J.A., Riedl, J. Interfaces for Eliciting New User Preferences in Recommender Systems. Proc User Modeling 2003, 178--188.]]
[23]
Morrison, J.B., Pirolli, P., Card, S.K., A Taxonomic Analysis of What World Wide Web Activities Significantly Impact People's Decisions and Actions, Proc CHI 2001 Extended.]]
[24]
Oxford English Dictionary on Compact Disk, 2nd Edition. Oxford: Oxford University Press, 1992.]]
[25]
Pirolli, P., Card, S.K., Information Foraging, Psychological Review, 106:4, Oct 1999, 643--675.]]
[26]
Pirolli, P., Pitkow, J., Rao, R. Silk from a Sow's Ear: Extracting Usable Structures from the Web, Proc CHI 1996.]]
[27]
Porter, M. F., An algorithm for suffix stripping, Program, 14(3), 1980, 130--137.]]
[28]
Rocchio, J., Relevance feedback in information retrieval, In The Smart Retrieval System-Experiments in Automatic Document Processing, Prentice-Hall, Englewood Cliffs, NJ, 313--323, 1971.]]
[29]
Salton, G., McGill, M.J., Introduction to Modern Information Retrieval, New York, McGraw-Hill, 1983.]]
[30]
Shneiderman, B., Maes, P., Direct Manipulation vs. Interface Agents, ACM Interactions, 4:6, Nov 1997.]]
[31]
Shah, J. J., Smith, S. M., Vargas-Hernandez, N., Gerkens, R., & Wulan, M., Empirical studies of design ideation: Alignment of design experiments with laboratory experiments, Proc Am Soc Mechanical Engineering, 2003.]]
[32]
Tufte, E., Envisioning Information, :Cheshire, Connecticut: Graphics Press, 1990.]]
[33]
Woodruff, A. Rosenholtz R., Morrison, J., Faulring, A., Pirolli, P., A Comparison of the Use of Text Summaries, Plain Thumbnails, and Enhanced Thumbnails for Web Search Tasks, JASIST 53(2):172--185, 2002.]]

Cited By

View all
  • (2022)An Explanatory Study on User Behavior in Discovering Aggregated Multimedia Web ContentIEEE Access10.1109/ACCESS.2022.317759710(56316-56330)Online publication date: 2022
  • (2021)A Relational Aggregated Disjoint Multimedia Search Results Approach using Semantics2021 International Conference on Artificial Intelligence (ICAI)10.1109/ICAI52203.2021.9445229(62-67)Online publication date: 5-Apr-2021
  • (2018)PERIA-Framework: A Prediction Extension Revision Image Annotation FrameworkInformation Technology – New Generations10.1007/978-3-319-77028-4_5(25-31)Online publication date: 2018
  • Show More Cited By

Index Terms

  1. combinFormation: a mixed-initiative system for representing collections as compositions of image and text surrogates

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    JCDL '06: Proceedings of the 6th ACM/IEEE-CS joint conference on Digital libraries
    June 2006
    402 pages
    ISBN:1595933549
    DOI:10.1145/1141753
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 June 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. collections
    2. information discovery
    3. mixed-initiative systems

    Qualifiers

    • Article

    Conference

    JCDL06
    JCDL06: Joint Conference on Digital Libraries 2006
    June 11 - 15, 2006
    NC, Chapel Hill, USA

    Acceptance Rates

    Overall Acceptance Rate 415 of 1,482 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)8
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 09 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)An Explanatory Study on User Behavior in Discovering Aggregated Multimedia Web ContentIEEE Access10.1109/ACCESS.2022.317759710(56316-56330)Online publication date: 2022
    • (2021)A Relational Aggregated Disjoint Multimedia Search Results Approach using Semantics2021 International Conference on Artificial Intelligence (ICAI)10.1109/ICAI52203.2021.9445229(62-67)Online publication date: 5-Apr-2021
    • (2018)PERIA-Framework: A Prediction Extension Revision Image Annotation FrameworkInformation Technology – New Generations10.1007/978-3-319-77028-4_5(25-31)Online publication date: 2018
    • (2018)Multimodal query-level fusion for efficient multimedia information retrievalInternational Journal of Intelligent Systems10.1002/int.2192033:10(2019-2037)Online publication date: 31-May-2018
    • (2017)Visual Re-Ranking for Multi-Aspect Information RetrievalProceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval10.1145/3020165.3020174(57-66)Online publication date: 7-Mar-2017
    • (2015)Intelligent Systems to Support Large-Scale Collective Creative Idea GenerationProceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition10.1145/2757226.2764764(327-328)Online publication date: 22-Jun-2015
    • (2015)DADS SystemProceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social Computing10.1145/2685553.2702679(33-36)Online publication date: 28-Feb-2015
    • (2015)Efficient Multimedia Information Retrieval with Query Level FusionFlexible Query Answering Systems 201510.1007/978-3-319-26154-6_28(367-379)Online publication date: 21-Oct-2015
    • (2014)Digital Library Technologies: Complex Objects, Annotation, Ontologies, Classification, Extraction, and SecuritySynthesis Lectures on Information Concepts, Retrieval, and Services10.2200/S00566ED1V01Y201401ICR0336:1(1-205)Online publication date: 28-Mar-2014
    • (2014)Using Metrics of Curation to Evaluate Information-Based IdeationACM Transactions on Computer-Human Interaction10.1145/259167721:3(1-48)Online publication date: 30-Jun-2014
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media