Exploring the utility of fast-forward surrogates for bbc rushes

ABSTRACT

This paper discusses in detail our approaches for producing the video summaries submitted to the TRECVID 2008 BBC rushes summarization task, including the baseline method. Empirical work produced during and after the TRECVID 2007 rushes summarization task gave strong evidence that a simple 50x method (sampling every 50th frame) provides excellent coverage (text inclusion performance). Our submissions for TRECVID 2008 investigated the effects of junk frame removal, including a comprehensible audio track, and emphasizing pans and zooms when backfilling to reclaim the space removed with the noise shots from the original 50x set. Results show that 50x based methods provide excellent coverage as expected. There were limited effects for the other strategies to improve user satisfaction, with the discussion providing some insights for future video summary development and evaluation work.

References

1. Chen, F., Cooper, M., and Adcock, J. Video Summarization Preserving Dynamic Content. In Proc. ACM Workshop on TRECVID Video Summarization (Augsburg, Germany, Sept. 2007), 40--44.
2. Christel, M.G., Lin, W.-H., and Maher, B. Evaluating Audio Skimming and Frame Rate Acceleration for Summarizing BBC Rushes. In Proc. CIVR (Niagara Falls, July 2008).
3. Christel, M. G., Smith, M. A., Taylor, C. R, & Winkler, D. B. Evolving Video Skims into Useful Multimedia Abstractions. In Proc. ACM CHI '98 (Los Angeles, April 1998), 171--178.
4. Hauptmann, A. G., Christel, M. G., Lin, W.-H., Maher, B., Yang, J., Baron, R. V., and Xiang, G. Clever Clustering vs. Simple Speed-Up for Summarizing BBC Rushes. In Proc. ACM Workshop on TRECVID Video Summarization (Augsburg, Germany, Sept. 2007), 20--24.
5. Lowe, D. G. Object Recognition from Local Scale-Invariant Features. In Proc. International Conf. on Computer Vision (Kerkyra, Greece, Sept. 1999), 1150--1157.
6. Over, P., Smeaton, A. F., and Awad, G. The TRECVID 2008 BBC Rushes Summarization Evaluation. In TVS '08: Proc. ACM Workshop on TRECVID Video Summarization (Vancouver, BC, Canada, Oct. 2008), 1--20.
7. Over, P., Smeaton, A. F., and Kelly, P. The TRECVID 2007 BBC Rushes Summarization Evaluation Pilot. In Proc. ACM Workshop on TRECVID Video Summarization (Augsburg, Germany, Sept. 2007), 1--15.
8. Song, Y., and Marchionini, G. Effects of Audio and Visual Surrogates for Making Sense of Digital Video. In Proc. ACM CHI '07 (San Jose, CA, April-May 2007), 867--876.
9. Taskiran, C. M., Pizlo, Z., Amir, A., Ponceleon, D., and Delp, E. J. Automated Video Program Summarization Using Speech Transcripts. IEEE Transactions on Multimedia 8(4), 2006, 775--791.
10. Wildemuth, B. M., Marchionini, G., Yang, M., Geisler, G., Wilkens, T., Hughes, A., and Gruss, R. How Fast Is Too Fast? Evaluating Fast Forward Surrogates for Digital Video. In Proc. Joint Conf. Digital Libraries (Houston, TX, May 2003), 221--230.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Video segmentation

      • Computer vision tasks

        • Video summarization

      • Image and video acquisition