Article

Addressing the challenge of visual information access from digital image and video libraries

Authors:

Michael G. Christel,

Ronald M. ConescuAuthors Info & Claims

JCDL '05: Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries

Pages 69 - 78

https://doi.org/10.1145/1065385.1065402

Published: 07 June 2005 Publication History

Abstract

While it would seem that digital video libraries should benefit from access mechanisms directed to their visual contents, years of TREC Video Retrieval Evaluation (TRECVID) research have shown that text search against transcript narrative text provides almost all the retrieval capability, even with visually oriented generic topics. A within-subjects study involving 24 novice participants on TRECVID 2004 tasks again confirms this result. The study shows that satisfaction is greater and performance is significantly better on specific and generic information retrieval tasks from news broadcasts when transcripts are available for search. Additional runs with 7 expert users reveal different novice and expert interaction patterns with the video library interface, helping explain the novices' lack of success with image search and visual feature browsing for visual information needs. Analysis of TRECVID visual features well suited for particular tasks provides additional insights into the role of automated feature classification for digital image and video libraries.

References

[1]

Christel, M., and Moraveji, N. Finding the Right Shots: Assessing Usability and Performance of a Digital Video Library Interface. In Proc. ACM Multimedia (New York, October 2004), 732--739.

Digital Library

[2]

Enser, P.G.B. Pictorial information retrieval. Journal of Documentation, 51, 2 (1995), 126--170.

[3]

Enser, P.G.B. and Sandom, C.J. Retrieval of Archival Moving Imagery - CBIR Outside the Frame? In Image and Video Retrieval (CIVR 2002 Proceedings), 206--214.

Digital Library

[4]

French, J.C., Chapin, A.C., and Martin, W.N. An Application of Multiple Viewpoints to Content-Based Image Retrieval. In Proc. JCDL (Houston, May 2003), 128--130.

Digital Library

[5]

Graham, J. Search engine Google sets sights on video. USA Today, Jan. 25, 2005, www.usatoday.com/tech/news/2005-01-25-google-usat_x.htm http://www.usatoday.com/tech/news/2005-01-25-google-usat_x.htm.

[6]

Hauptmann, A., and Christel, M. Successful Approaches in the TREC Video Retrieval Evaluations. In Proc. ACM Multimedia (New York, October 2004), 668--675.

Digital Library

[7]

Jose, J.M., Furner, J., and Harper, D.J. Spatial querying for image retrieval: a user-oriented evaluation. In Proc. ACM SIGIR (1998), 232--240.

Digital Library

[8]

Kraaij, W., Smeaton, A.F., Over, P., and Arlandis, J. TRECVID 2004 - An Introduction. In TRECVID 2004 Proceedings, http://www-nlpir.nist.gov/projects/trecvid/.

[9]

Lee, H. and Smeaton, A.F. Designing the User Interface for the Físchlár Digital Video Library, J. Digital Info. 2(4), http://jodi.ecs.soton.ac.uk/Articles/v02/i04/Lee/, May 2002.

[10]

Markkula, M. and Sormunen, E. End-user searching challenges indexing practices in the digital newspaper photo archive. Information Retrieval, 1, 4 (2000), 259--285.

Digital Library

[11]

Moënne-Loccoz, N., Janvier, B., Marchand-Maillet, S., and Bruno, E. Managing Video Collections at Large. In ACM Proc. Workshop on Computer Vision meets Databases (Paris, June 2004), 59--66.

Digital Library

[12]

Nielsen, J. Heuristic Evaluation. In Nielsen, J., and Mack, R.L. (eds.), Usability Inspection Methods. John Wiley & Sons, New York, NY, 1994.

Digital Library

[13]

Rasmussen, E. Indexing images. Annual Review of Information Science and Technology, 32 (1997), 169-196.

[14]

Rodden, K. and Wood, K.R. How Do People Manage Their Digital Photographs? In Proc. CHI (Ft. Lauderdale, FL, April 2003), 409--416.

Digital Library

[15]

Shatford, S. Analyzing the Subject of a Picture: A Theoretical Approach. Cataloguing & Classification Quarterly, 6, 3 (Spring 1986), 39--62.

[16]

Shneiderman, B., Byrd, D., and Croft, W.B. Clarifying Search: A User-Interface Framework for Text Searches. D-Lib Magazine, 3, 1 (January 1997), <http://www.dlib.org>.

[17]

Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., and Jain, R. Content based image retrieval at the end of the early years. IEEE Trans. Pattern Analysis and Machine Intelligence, 22, 12 (2000), 1349--1380.

Digital Library

[18]

Soo, V.-W., Lee, C.-Y., Li, C.-C., Chen, S.L., and Chen, C. Automated Semantic Annotation and Retrieval Based on Sharable Ontology and Case-based Learning Techniques. In Proc. JCDL (Houston, May 2003), 61--72.

Digital Library

[19]

Urban, J., Jose, J.M., and van Rijgsbergen, C.J. An Adaptive Technique for Content-Based Image Retrieval. Multimedia Tools and Applications, 25 (2005).

Digital Library

[20]

Worring, M., Smeulders, A.W.M, and Santini, S. Interaction in content-based retrieval: an evaluation of the state-of-the-art. LNCS 1929, Springer-Verlag (2000), 26--36.

Digital Library

[21]

Yang, M., Wildemuth, B., and Marchionini, G. The relative effectiveness of concept-based versus content-based video retrieval. In Proc. ACM Multimedia (Oct. 2004), 368--371.

Digital Library

[22]

Yee, K.-P., Swearingen, K., Li, K., and Hearst, M. Faceted Metadata for Image Search and Browsing. In Proc. CHI (Ft. Lauderdale, FL, April 2003), 401--408.

Digital Library

[23]

Zhou, X.S., and Huang, T. Relevance Feedback in Image Retrieval: A Comprehensive Review. ACM Multimedia Systems Journal, 8, 6 (2003), 536--544.

Cited By

Geisler GWillard GOvalle C(2011)A crowdsourcing framework for the production and use of film and television dataThe New Review of Hypermedia and Multimedia10.1080/13614568.2011.55264517:1(73-97)Online publication date: 1-Apr-2011
https://dl.acm.org/doi/10.1080/13614568.2011.552645
Geisler GWillard GWhitworth E(2011)Crowdsourcing the indexing of film and television mediaProceedings of the American Society for Information Science and Technology10.1002/meet.1450470124447:1(1-10)Online publication date: 3-Feb-2011
https://doi.org/10.1002/meet.14504701244
Geisler GWillard GWhitworth EMarshall CToms EGrove A(2010)Crowdsourcing the indexing of film and television mediaProceedings of the 73rd ASIS&T Annual Meeting on Navigating Streams in an Information Ecosystem - Volume 4710.5555/1920331.1920448(1-10)Online publication date: 22-Oct-2010
https://dl.acm.org/doi/10.5555/1920331.1920448
Show More Cited By

Index Terms

Addressing the challenge of visual information access from digital image and video libraries
1. Applied computing
  1. Computers in other domains
    1. Digital libraries and archives
2. Information systems
  1. Information retrieval
  2. Information systems applications
    1. Digital libraries and archives

Recommendations

Carnegie Mellon University traditional informedia digital video retrieval system
CIVR '07: Proceedings of the 6th ACM international conference on Image and video retrieval

The Carnegie Mellon University Informedia group has enjoyed consistent success with TRECVID interactive search using traditional storyboard interfaces for shot-based retrieval. For TRECVID 2006 the output of automatic search was included for the first ...
Merging storyboard strategies and automatic retrieval for improving interactive video search
CIVR '07: Proceedings of the 6th ACM international conference on Image and video retrieval

The Carnegie Mellon University Informedia group has enjoyed consistent success with TRECVID interactive search using traditional storyboard interfaces for shot-based retrieval. For TRECVID 2006 the output of automatic search was included for the first ...
The evolution of visual information retrieval

This paper seeks to provide a brief overview of those developments which have taken the theory and practice of image and video retrieval into the digital age. Drawing on a voluminous literature, the context in which visual information retrieval takes ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

JCDL '05: Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries

June 2005

450 pages

ISBN:1581138768

DOI:10.1145/1065385

General Chair:
Mary Marlino
DLESE Program Center, University Corporation for Atmospheric Research (UCAR)
,
Program Chairs:
Tamara Sumner
University of Colorado at Boulder
,
Frank Shipman
Texas A & M University

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

JCDL05

Sponsor:

JCDL05: Joint Conference on Digital Libraries 2005

June 7 - 11, 2005

CO, Denver, USA

Acceptance Rates

Overall Acceptance Rate 415 of 1,482 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
1,003
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Geisler GWillard GOvalle C(2011)A crowdsourcing framework for the production and use of film and television dataThe New Review of Hypermedia and Multimedia10.1080/13614568.2011.55264517:1(73-97)Online publication date: 1-Apr-2011
https://dl.acm.org/doi/10.1080/13614568.2011.552645
Geisler GWillard GWhitworth E(2011)Crowdsourcing the indexing of film and television mediaProceedings of the American Society for Information Science and Technology10.1002/meet.1450470124447:1(1-10)Online publication date: 3-Feb-2011
https://doi.org/10.1002/meet.14504701244
Geisler GWillard GWhitworth EMarshall CToms EGrove A(2010)Crowdsourcing the indexing of film and television mediaProceedings of the 73rd ASIS&T Annual Meeting on Navigating Streams in an Information Ecosystem - Volume 4710.5555/1920331.1920448(1-10)Online publication date: 22-Oct-2010
https://dl.acm.org/doi/10.5555/1920331.1920448
Rode HTsikrika Tde Vries A(2010)Differences in video search behavior between novices and archivistsProceedings of the 8th international conference on Adaptive Multimedia Retrieval: context, exploration, and fusion10.1007/978-3-642-27169-4_7(89-102)Online publication date: 17-Aug-2010
https://dl.acm.org/doi/10.1007/978-3-642-27169-4_7
Christel M(2009)Automated Metadata in Multimedia Information Systems: Creation, Refinement, Use in Surrogates, and EvaluationSynthesis Lectures on Information Concepts, Retrieval, and Services10.2200/S00167ED1V01Y200812ICR0021:1(1-74)Online publication date: Jan-2009
https://doi.org/10.2200/S00167ED1V01Y200812ICR002
Rashid UNiaz IBhatti M(2009)Fusion of Multimedia Document Intra-Modality Relevancies using Linear Combination ModelAdvanced Techniques in Computing Sciences and Software Engineering10.1007/978-90-481-3660-5_98(575-580)Online publication date: 15-Dec-2009
https://doi.org/10.1007/978-90-481-3660-5_98
Hopfgartner FUrruty TVilla RJose J(2009)Facet-Based Browsing in Video RetrievalProceedings of the 15th International Multimedia Modeling Conference on Advances in Multimedia Modeling10.1007/978-3-540-92892-8_47(472-483)Online publication date: 6-Jan-2009
https://dl.acm.org/doi/10.1007/978-3-540-92892-8_47
Enser P(2009)Visual image retrievalAnnual Review of Information Science and Technology10.1002/aris.2008.144042010842:1(1-42)Online publication date: 5-Nov-2009
https://doi.org/10.1002/aris.2008.1440420108
Enser P(2008)The evolution of visual information retrievalJournal of Information Science10.1177/016555150809101334:4(531-546)Online publication date: 1-Aug-2008
https://dl.acm.org/doi/10.1177/0165551508091013
Christel MFrisch MLarsen RPaepcke ABorbinha JNaaman M(2008)Evaluating the contributions of video representation for a life oral history collectionProceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries10.1145/1378889.1378929(241-250)Online publication date: 16-Jun-2008
https://dl.acm.org/doi/10.1145/1378889.1378929
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten