research-article

Supporting video library exploratory search: when storyboards are not enough

Author:

Michael G. ChristelAuthors Info & Claims

CIVR '08: Proceedings of the 2008 international conference on Content-based image and video retrieval

Pages 447 - 456

https://doi.org/10.1145/1386352.1386410

Published: 07 July 2008 Publication History

Abstract

Storyboards, a grid layout of thumbnail images as surrogates representing video, have received much attention in video retrieval interfaces and published studies through the years, and work quite well as navigation aids and as facilitators for shot-based information retrieval. When the information need is tied less to shots and requires inspection of stories and across stories, other interfaces into the video data have been demonstrated to be quite useful. These interfaces include scatterplots for timelines, choropleth maps, dynamic query preview histograms, and named entity relation diagrams representing sets of hundreds or thousands of video stories. One challenge for interactive video search is to move beyond support for fact-finding and also address broader, longer term search activities of learning, analysis, synthesis, and discovery. Examples are shown for broadcast news and life oral histories, drawing from empirically collected data showing how such interfaces can promote improved exploratory search. This paper surveys and reflects on a body of Informedia interface work dealing with news, folding in for the first time an examination of exploratory transactions with an oral history corpus.

References

[1]

Proc. ACM Int'l Workshop on TRECVID Video Summarization (Augsburg, Germany, in conjunction with ACM Multimedia, Sept. 28, 2007), ISBN: 978-1-59593-780-3.

[2]

Ahlberg, C. and Shneiderman, B. Visual Information Seeking: Tight Coupling of Dynamic Query Filters with Starfield Displays. In Proc. ACM CHI (Boston, MA, April 1994), 313--322.

Digital Library

[3]

Christel, M., Hauptmann, A.G., Wactlar, H.D., and Ng, T.D. Collages as Dynamic Summaries for News Video. In Proc. ACM Multimedia (Juan-les-Pins, France, Dec. 2002), 561--569.

Digital Library

[4]

Christel, M., and Moraveji, N. Finding the Right Shots: Assessing Usability and Performance of a Digital Video Library Interface. In Proc. ACM Multimedia (New York, NY, Oct. 2004), 732--739.

Digital Library

[5]

Christel, M. Windowing Time in Digital Libraries. In Proc. ACM/IEEE Joint Conf. Digital Libraries (Chapel Hill, NC, June 2006), 190--191.

Digital Library

[6]

Christel, M., and Conescu, R. Mining Novice User Activity with TRECVID Interactive Retrieval Tasks. In LNCS 4071: Proc. Image and Video Retrieval (CIVR) (Tempe, AZ, July 2006), Springer, Berlin, 2006, 21--30.

Digital Library

[7]

Christel, M., and Yan, R. Merging Storyboard Strategies and Automatic Retrieval for Improving Interactive Video Search. In Proc. CIVR (Amsterdam, July 2007), 486--493.

Digital Library

[8]

Christel, M. Establishing the Utility of Non-Text Search for News Video Retrieval with Real World Users. In Proc. ACM Multimedia (Augsburg, Germany, Sept. 2007), 706--717.

Digital Library

[9]

Frøkjær, E., et al. Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In Proc. ACM CHI (The Hague, The Netherlands, April 2000), 345--352.

Digital Library

[10]

Gersh, J., Lewis, B., et al. Supporting Insight-Based Information Exploration in Intelligence Analysis. Comm. ACM 49(4), 2006, 63--68.

Digital Library

[11]

Hauptmann, A., and Christel, M. Successful Approaches in the TREC Video Retrieval Evaluations. In Proc. ACM Multimedia (New York, NY, October 2004), 668--675.

Digital Library

[12]

Hearst M.A. 1999. User Interfaces and Visualization. In Baeza-Yates R, Ribeiro-Neto, B (eds.), Modern Information Retrieval, Addison Wesley/ACM Press, New York.

[13]

Hearst, M.A., et al. Finding the flow in web site search. Comm. ACM 45(9), 2002, 42--49.

Digital Library

[14]

Hearst, M.A. Clustering vs. Faceted Categories for Information Exploration. Comm. ACM 49(4), 2006, 59--61.

Digital Library

[15]

Helft, M. YouTube's Traffic Continues to Snowball. NY Times (Jan. 17, 2008), bits.blogs.nytimes.com/2008/01/17/.

[16]

Hughes, A., et al. Text or pictures? An eyetracking study of how people view digital video surrogates. In Proc. Conf. Image and Video Retrieval (CIVR) (Urbana-Champaign, IL, 2003), 271--280.

Digital Library

[17]

Kobsa A. An Empirical Comparison of Three Commercial Information Visualization Systems. In Proc. IEEE InfoVis (San Diego, CA, Oct. 2001), 123--130.

Digital Library

[18]

Marchionini, G., and Geisler, G. The Open Video Digital Library. D-Lib Magazine 8(12), Dec. 2002, www.dlib.org.

[19]

Marchionini, G. Exploratory Search: From Finding to Understanding. Comm. ACM 49(4), 2006, 41--46.

Digital Library

[20]

Mills, M., et al. A Magnifier Tool for Video Data. In Proc. ACM CHI (Monterey, CA, May 1992), 93--98.

Digital Library

[21]

Naphade, M., et al. Large-Scale Concept Ontology for Multimedia. IEEE MultiMedia 13(3), 2006, 86--91.

Digital Library

[22]

Olsen, K.A., et al. Visualization of a Document Collection: The VIBE System. Info. Processing & Mgt 29 (1993), 69--81.

Digital Library

[23]

Plaisant, C. The Challenge of Information Visualization Evaluation. In Proc. ACM Advanced Visual Interfaces (Gallipoli, Italy, May 2004), 109--116.

Digital Library

[24]

Shneiderman, B. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. In Proc. IEEE Symposium on Visual Languages (Boulder, CO, Sept. 1996), 336--343.

Digital Library

[25]

Shneiderman, B., and Plaisant, C. Strategies for Evaluating Information Visualization Tools: Multi-dimensional In-depth Long-term Case Studies. In Proc. BELIV'06 Workshop, Advanced Visual Interfaces Conf. (Venice, May 2006), 1--7.

Digital Library

[26]

Snoek, C., Worring, M., Koelma, D., and Smeulders, A. A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval. IEEE Trans. Multimedia 9(2), Feb. 2007, 280--292.

Digital Library

[27]

White, R.W., et al. Supporting Exploratory Search, Introduction. Comm. ACM 49(4), 2006, 36--39.

Digital Library

[28]

Worring, M., Snoek, C., et al. Mediamill: Advanced Browsing in News Video Archives. In LNCS 4071: Proc. Image and Video Retrieval (CIVR) (Tempe, AZ, July 2006), Springer, Berlin, 2006, 533--536.

Digital Library

Cited By

Wolf KAbdelrahman YLandwehr MWard GSchmidt AHäkkila JOjala T(2016)How to browse through my large video dataProceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia10.1145/3012709.3012713(169-173)Online publication date: 12-Dec-2016
https://dl.acm.org/doi/10.1145/3012709.3012713
Wolf KLischke LSas CSchmidt AHäkkila JOjala T(2016)The value of information cues for lifelog video navigationProceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia10.1145/3012709.3012712(153-157)Online publication date: 12-Dec-2016
https://dl.acm.org/doi/10.1145/3012709.3012712
Albertson DJu B(2015)Design criteria for video digital librariesOnline Information Review10.1108/OIR-10-2014-025139:2(214-228)Online publication date: 13-Apr-2015
https://doi.org/10.1108/OIR-10-2014-0251
Show More Cited By

Index Terms

Supporting video library exploratory search: when storyboards are not enough
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision

Recommendations

Collaborative multi-paradigm exploratory search
WebScience '08: Proceedings of the hypertext 2008 workshop on Collaboration and collective intelligence

New challenges for advanced web search interfaces and visualization tools arise as user needs shift from traditional lookup tasks towards more open ended search activities collectively described as exploratory search. Exploratory search opens new ...
Is visualization usable for displaying web search results in an exploratory search context?
PROMISE'12: Proceedings of the 2012 international conference on Information Retrieval Meets Information Visualization

Information visualization is defined as an interactive and graphic amplifying cognition. Moreover, the field of information retrieval is the original scope of information visualization. Nevertheless, many problems remain. The exploratory research ...
Towards Understanding and Supporting Exploratory Searches
CHIIR '23: Proceedings of the 2023 Conference on Human Information Interaction and Retrieval

Exploratory search is an intuitive concept in interactive information retrieval. It is known that searchers use exploratory search strategies when learning and investigating a new domain. Many definitions for Exploratory Search have been proposed. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CIVR '08: Proceedings of the 2008 international conference on Content-based image and video retrieval

July 2008

674 pages

ISBN:9781605580708

DOI:10.1145/1386352

General Chairs:
Jiebo Luo
Kodak Research Laboratories
,
Ling Guan
Ryerson University
,
Program Chairs:
Alan Hanjalic
Delft University of Technology
,
Mohan Kankanhalli
National University of Singapore
,
Ivan Lee
University of South Australia

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CIVR08

Sponsor:

CIVR08: CIVR'08 - International Conference on Content-based Image and Video Retrieval

July 7 - 9, 2008

Niagara Falls, Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
555
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wolf KAbdelrahman YLandwehr MWard GSchmidt AHäkkila JOjala T(2016)How to browse through my large video dataProceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia10.1145/3012709.3012713(169-173)Online publication date: 12-Dec-2016
https://dl.acm.org/doi/10.1145/3012709.3012713
Wolf KLischke LSas CSchmidt AHäkkila JOjala T(2016)The value of information cues for lifelog video navigationProceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia10.1145/3012709.3012712(153-157)Online publication date: 12-Dec-2016
https://dl.acm.org/doi/10.1145/3012709.3012712
Albertson DJu B(2015)Design criteria for video digital librariesOnline Information Review10.1108/OIR-10-2014-025139:2(214-228)Online publication date: 13-Apr-2015
https://doi.org/10.1108/OIR-10-2014-0251
Albertson D(2015)Synthesizing visual digital library research to formulate a user-centered evaluation frameworkNew Library World10.1108/NLW-07-2014-0087116:3/4(122-135)Online publication date: 9-Mar-2015
https://doi.org/10.1108/NLW-07-2014-0087
Hoenkamp EBruza P(2015)How everyday language can and will boost effective information retrievalJournal of the Association for Information Science and Technology10.1002/asi.2327966:8(1546-1558)Online publication date: 1-Aug-2015
https://dl.acm.org/doi/10.1002/asi.23279
Albertson D(2015)Visual information seekingJournal of the Association for Information Science and Technology10.1002/asi.2324466:6(1091-1105)Online publication date: 1-Jun-2015
https://dl.acm.org/doi/10.1002/asi.23244
Ju BAlbertson DElsweiler DLudwig BAzzopardi LWilson M(2014)Users' criteria of video digital libraries from a public affairs contextProceedings of the 5th Information Interaction in Context Symposium10.1145/2637002.2637031(235-238)Online publication date: 26-Aug-2014
https://dl.acm.org/doi/10.1145/2637002.2637031
Jackson DNicholson JStoeckigt GWrobel RThieme AOlivier PIzadi SQuigley APoupyrev IIgarashi T(2013)PanopticonProceedings of the 26th annual ACM symposium on User interface software and technology10.1145/2501988.2502038(123-130)Online publication date: 8-Oct-2013
https://dl.acm.org/doi/10.1145/2501988.2502038
Albertson D(2013)An interaction and interface design framework for video digital librariesJournal of Documentation10.1108/JD-12-2011-005669:5(667-692)Online publication date: 2-Sep-2013
https://doi.org/10.1108/JD-12-2011-0056
Haesen MMeskens JLuyten KConinx KBecker JTuytelaars TPoulisse GPham PMoens M(2013)Finding a needle in a haystackMultimedia Tools and Applications10.1007/s11042-011-0809-y63:2(331-356)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1007/s11042-011-0809-y
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten