skip to main content
10.1145/1385569.1385622acmconferencesArticle/Chapter ViewAbstractPublication PagesaviConference Proceedingsconference-collections
poster

VCode and VData: illustrating a new framework for supporting the video annotation workflow

Published: 28 May 2008 Publication History

Abstract

Digital tools for annotation of video have the promise to provide immense value to researchers in disciplines ranging from psychology to ethnography to computer science. With traditional methods for annotation being cumbersome, time-consuming, and frustrating, technological solutions are situated to aid in video annotation by increasing reliability, repeatability, and workflow optimizations. Three notable limitations of existing video annotation tools are lack of support for the annotation workflow, poor representation of data on a timeline, and poor interaction techniques with video, data, and annotations. This paper details a set of design requirements intended to enhance video annotation. Our framework is grounded in existing literature, interviews with experienced coders, and ongoing discussions with researchers in multiple disciplines. Our model is demonstrated in a new system called VCode and VData. The benefit of our system is that is directly addresses the workflow and needs of both researchers and video coders.

References

[1]
Annotations as multiple perspectives of video content, Juan-les-Pins, France, 2002. ACM.
[2]
The Family Video Archive: an annotation and browsing environment for home movies, Berkeley, CA, 2003. ACM.
[3]
Fluid interaction techniques for the control and annotation of digital video, Vancouver, Canada, 2003. ACM.
[4]
A Coding Tool for Multimodal Analysis of Meeting Video, Montreal, Quebec, Canada, 2004. IEEE.
[5]
Creating Multi-Modal, User-Centric Records of Meetings with the Carnegie Mellon Meeting Recorder Architecture, Montreal, Quebec, Canada, 2004. IEEE.
[6]
Work-in-progress: VACA: a tool for qualitative video analysis, Montreal, Quebec, Canada, 2006. ACM.
[7]
K. J. Berry and P. W. Mielke. A generalization of cohen's kappa agreement measure to interval measurement and multiple raters, 1988.
[8]
M. Bertini, A. Del Bimbo, R. Cucchiara, and A. Prati. Applications ii: Semantic video adaptation based on automatic annotation of sport videos. In Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval MIR, 2004.
[9]
S.-C. Chen, M.-L. Shyu, W. Liao, and C. Zhang. Scene change detection by audio and video clues. www.cs.fiu.edu/~chens/PDF/ICME02_Video.pdf.
[10]
J. Clifford and G. Marcus, editors. Writing Culture. University of California Press, Berkeley, California, 1986.
[11]
A. J. Conger. Kappa reliabilities for continuous behaviors and events, 1985.
[12]
S. B. Group. Studiocode business group - supplier of studiocode and stream video analysis and distribution software. http://www.studiocodegroup.com, 2007.
[13]
A. Johnson. About vprism video data analysis software. http://www.camse.org/andy/VP/vprism.htm, 2007.
[14]
M. Kipp. Anvil - the video annotation research tool. http://www.anvil-software.de, 2007.
[15]
B. J. Leadholm and J. F. Miller. Language Sample Analysis: The Wisconsin Guide. Wisconsin Department of Public Instruction, Madison, Wisconsin, 1995.
[16]
L. Lee. Developmental Sentence Analysis. Northwestern University Press, Evanston, IL, 1974.
[17]
S. S. LLC. Salt software. http://www.saltsoftware.com, 2007.
[18]
Noldus. The observer. http://www.noldus.com/site/doc200401012, 2007.
[19]
D. Ponceleon and S. Srinivasan. Automatic discovery of salient segments in imperfect speech transcripts. In CIKM '01: Proceedings of the tenth international conference on Information and knowledge management, pages 490--497, New York, NY, USA, 2001. ACM.
[20]
K. S. Retherford. Guide to Analysis of Language Transcripts. Thinking Publications, Eau Claire, Wisconsin, 1993.
[21]
K. L. Rosenblum, C. Zeanah, S. McDonough, and M. Muzik. Video-taped coding of working model of the child interviews: a viable and useful alternative to verbatim transcripts?, 2004.
[22]
S. Soft. Annotation. http://www.saysosoft.com/, 2006.

Cited By

View all
  • (2025)An exploratory characterization of speech- and fine-motor coordination in verbal children with Autism spectrum disorderComputer Speech and Language10.1016/j.csl.2024.10166589:COnline publication date: 1-Jan-2025
  • (2024)Somatotopic organization among parallel sensory pathways that promote a grooming sequence in DrosophilaeLife10.7554/eLife.87602.312Online publication date: 18-Apr-2024
  • (2024)Somatotopic organization among parallel sensory pathways that promote a grooming sequence in DrosophilaeLife10.7554/eLife.8760212Online publication date: 18-Apr-2024
  • Show More Cited By

Index Terms

  1. VCode and VData: illustrating a new framework for supporting the video annotation workflow

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      AVI '08: Proceedings of the working conference on Advanced visual interfaces
      May 2008
      483 pages
      ISBN:9781605581415
      DOI:10.1145/1385569
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 28 May 2008

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Graphical User Interfaces (GUI)
      2. annotation
      3. video

      Qualifiers

      • Poster

      Funding Sources

      Conference

      AVI '08
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 128 of 490 submissions, 26%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)32
      • Downloads (Last 6 weeks)3
      Reflects downloads up to 27 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)An exploratory characterization of speech- and fine-motor coordination in verbal children with Autism spectrum disorderComputer Speech and Language10.1016/j.csl.2024.10166589:COnline publication date: 1-Jan-2025
      • (2024)Somatotopic organization among parallel sensory pathways that promote a grooming sequence in DrosophilaeLife10.7554/eLife.87602.312Online publication date: 18-Apr-2024
      • (2024)Somatotopic organization among parallel sensory pathways that promote a grooming sequence in DrosophilaeLife10.7554/eLife.8760212Online publication date: 18-Apr-2024
      • (2024)CourtsightTV: An Interactive Visualization Software for Labeling Key Basketball MomentsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679230(5270-5274)Online publication date: 21-Oct-2024
      • (2023)User Preference and Performance using Tagging and Browsing for Image LabelingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580926(1-13)Online publication date: 19-Apr-2023
      • (2022)Cultures Crossing: The Power of Habit in Delaying GratificationPsychological Science10.1177/0956797622107465033:7(1172-1181)Online publication date: 24-Jun-2022
      • (2022)Mate Discrimination of Colocasiomyia xenalocasiae and C. alocasiae (Diptera: Drosophilidae) as a Possible Factor Contributing to their Co-Existence on the Same Host PlantJournal of Insect Behavior10.1007/s10905-022-09798-035:1-3(44-55)Online publication date: 12-Jun-2022
      • (2021)Current Trends and Future Directions of Large Scale Image and Video Annotation: Observations From Four Years of BIIGLE 2.0Frontiers in Marine Science10.3389/fmars.2021.7600368Online publication date: 30-Nov-2021
      • (2021)Socio-Spatial ComfortProceedings of the ACM on Human-Computer Interaction10.1145/34329374:CSCW3(1-33)Online publication date: 5-Jan-2021
      • (2021)Tags and tracks and annotations – research video as a new form of publication of embodied knowledgeInternational Journal of Performance Arts and Digital Media10.1080/14794713.2020.1866357(1-15)Online publication date: 7-Jan-2021
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media