skip to main content
10.1145/1101149.1101246acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Spatio-temporal quality assessment for home videos

Published: 06 November 2005 Publication History

Abstract

Compared with the video programs taken by professionals, home videos are always with low-quality content resulted from lack of professional capture skills. In this paper, we present a novel spatio-temporal quality assessment scheme in terms of low-level content features for home videos. In contrast to existing frame-level-based quality assessment approaches, a type of temporal segment of video, sub-shot, is selected as the basic unit for quality assessment. A set of spatio-temporal artifacts, regarded as the key factors affecting the overall perceived quality (i.e. unstableness, jerkiness, infidelity, blurring, brightness and orientation), are mined from each sub-shot based on the particular characteristics of home videos. The relationship between the overall quality metric and these factors are exploited by three different methods, including user study, factor fusion, and a learning-based scheme. To validate the proposed scheme, we present a scalable quality-based home video summarization system, aiming at achieving the best quality while simultaneously preserving the most informative content. A comparison user study between this system and the attention model based video skimming approach demonstrated the effectiveness of the proposed quality assessment scheme.

References

[1]
VQEG: The video quality experts group. http://www.vqeg.org.
[2]
A. Girgensohn, J. Boreczky, P. Chiu, J. Doherty, J. Foote, G. Golovchinsky, S. Uchihashi, and L. Wilcox. A semi-automatic approach to home video editing. In Proceedings of ACM Symposium on UIST, pages 81--89, 2000.
[3]
X.-S. Hua, L. Lu, and H.-J. Zhang. Optimization-based automated home video editing system. IEEE Trans. on Circuit and System for Video Technology, 14(5):572--583, May 2004.
[4]
J. G. Kim, H.-S. Chang, J. Kim, and H. M. Kim. Efficient camera motion characterization for mpeg video indexing. In Proceedings of IEEE International Conference on Multimedia & Expo, pages 1171--1174, 2000.
[5]
Y.-F. Ma, L. Lu, H.-J. Zhang, and M. Li. A user attention model for video summarization. In Proceedings of ACM Multimedia, pages 533--542, 2002.
[6]
H.-H. Tong, M. Li, H.-J. Zhang, and C. Zhang. Blur detection for digital images using wavelet transform. In Proceedings of IEEE International Conference on Multimedia & Expo, pages 17--20, 2004.
[7]
H.-H. Tong, M. Li, H.-J. Zhang, C. Zhang, J.-R. He, and W.-Y. Ma. Learning no-reference quality metric by examples. In Proceedings of International Multi-Media Modelling Conference, pages 247--254, 2005.
[8]
V. Vapnik. The Nature of Statistical Learning Theory. Springer-Verlag, New York, 1995.
[9]
Z. Wang, H. R. Sheikh, and A. C. Bovik. Objective video quality assessment. In The Handbook of Video Databases: Design and Applications, pages 1041--1078, 2003.
[10]
D. Whitley. A genetic algorithm tutorial. Statistics and Computing, 4:65--85, 1994.
[11]
W.-Q. Yan and M. S. Kankanhalli. Detection and removal of lighting & shaking artifacts in home videos. In Proceedings of ACM Multimedia, pages 107--116, 2002.
[12]
L. Zhang, M. Li, and H.-J. Zhang. Boosting image orientation detection with indoor vs. outdoor classification. In Proceedings of IEEE Workshop on Applications of Computer Vision, pages 95--99, 2002.

Cited By

View all
  • (2018)Generating an Album with the Best Media Using Computer VisionDesign, User Experience, and Usability: Designing Interactions10.1007/978-3-319-91803-7_25(338-352)Online publication date: 15-Jul-2018
  • (2011)Example-based video remixing support systemProceedings of the 19th ACM international conference on Multimedia10.1145/2072298.2072371(563-572)Online publication date: 28-Nov-2011
  • (2011)Example-based video remixing for home videosProceedings of the 2011 IEEE International Conference on Multimedia and Expo10.1109/ICME.2011.6012080(1-6)Online publication date: 11-Jul-2011
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MULTIMEDIA '05: Proceedings of the 13th annual ACM international conference on Multimedia
November 2005
1110 pages
ISBN:1595930442
DOI:10.1145/1101149
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. quality assessment
  2. video content analysis
  3. video summarization

Qualifiers

  • Article

Conference

MM05

Acceptance Rates

MULTIMEDIA '05 Paper Acceptance Rate 49 of 312 submissions, 16%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2018)Generating an Album with the Best Media Using Computer VisionDesign, User Experience, and Usability: Designing Interactions10.1007/978-3-319-91803-7_25(338-352)Online publication date: 15-Jul-2018
  • (2011)Example-based video remixing support systemProceedings of the 19th ACM international conference on Multimedia10.1145/2072298.2072371(563-572)Online publication date: 28-Nov-2011
  • (2011)Example-based video remixing for home videosProceedings of the 2011 IEEE International Conference on Multimedia and Expo10.1109/ICME.2011.6012080(1-6)Online publication date: 11-Jul-2011
  • (2010)Video Quality Analysis for Concert Video Mashup GenerationAdvanced Concepts for Intelligent Vision Systems10.1007/978-3-642-17691-3_1(1-12)Online publication date: 2010
  • (2009)An improved belief propagation method for dynamic collageThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-009-0346-025:5-7(431-439)Online publication date: 25-Apr-2009
  • (2008)Video summarisationJournal of Visual Communication and Image Representation10.1016/j.jvcir.2007.04.00219:2(121-143)Online publication date: 1-Feb-2008
  • (2008)Video collage: presenting a video sequence using a single imageThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-008-0282-425:1(39-51)Online publication date: 3-Dec-2008
  • (2007)Video collageProceedings of the 15th ACM international conference on Multimedia10.1145/1291233.1291341(461-462)Online publication date: 29-Sep-2007
  • (2007)Video abstractionACM Transactions on Multimedia Computing, Communications, and Applications10.1145/1198302.11983053:1(3-es)Online publication date: 1-Feb-2007
  • (2005)Personal media sharing and authoring on the webProceedings of the 13th annual ACM international conference on Multimedia10.1145/1101149.1101229(375-378)Online publication date: 6-Nov-2005

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media