Automated production of TV program trailer using electronic program guide

ABSTRACT

This paper proposes two automated methods for producing TV program trailers (short video clips to advertise the program). Program trailers are useful as the representative video of a content retrieval system that operates in a large archive of program videos. The two methods employ introductory descriptions from electronic program guides. The first method is based on the sentence similarity between the closed caption and the introductory text of the target program. We extract closed caption sentences that have the highest similarity for each introductory sentence, and then connect the corresponding video segments to make the representative video. A Bayesian belief network is used to calculate the similarity. The second method extracts several sentences that have the same textual features as those of a general introductory text, and determines the corresponding video sections. The features are learned by using the AdaBoost algorithm. These methods were used to generate trailers for actual TV programs, by which their effectiveness was verified.

References

1. M. M. Yeung and B.-L.Yeo. Video visualization for compact presentation and fast browsing of pictorial content. IEEE Trans. IEEE Trans. Circuits and Systems for Video Tech., 7(5):771--785, 1997.
2. S. Uchihashi, J. Foote, A. Girgenson and J. Boreczky. Video manga: generating semantically meaningful video summaries. In Proc. ACM Multimedia, pages 383--392, 1999.
3. M. A. Smith and T. Kanade. Video skimming and characterization through the combination of image and language understanding techniques. In Proc. IEEE CVPR'97, pages 775--781, 1997.
4. R. Lienhart, S. Pfeiffer and W. Effelsberg. Video abstracting. Commun. ACM, 40(12):55--62, 1997.
5. L. Agnihotri, K. V. Devera, T. McGee and N. Dimitrove. Summarization of video programs based on closed captions. In Proc. SPIE'01, volume 4315, pages 599--607, 2001.
6. C. M. Taskiran, Z. Pizlo, A. Amir, D. Ponceleon and E. J. Delp. Automated video program summarization using speech transcripts. IEEE Trans. Multimedia, 8(4):775--791, 2006.
7. Y. Rui, A. Gupta and A. Acero. Automatically extracting highlights for TV baseball programs. In Proc. ACM Multimedia, pages 105--116, 2000.
8. N. Babaguchi, Y. Kawai, T. Ogura and T. Kitahashi. Personalized Abstraction of Broadcasted American Football Video by Highlight Selection. IEEE Trans. Multimedia, 6(4):575--586, 2004.
9. B. Li, H. Pan and I. Sezan. A general framework for sports video summarization with its application to soccer. In Proc. IEEE ASSP'03, pages 169--172, 2003.
10. A. F. Smeaton, B. Lehane, N. E. O'Connor, C. Brady and G. Craig. Automatically selecting shots for action movie trailers. In Proc. ACM int. workshop on Multimedia information retrieval, pages 231--238, 2006.
11. B. Ionescu, P. Lambert, D. Coquin, L. Ott and V. Buzuloiu. Animation movies trailer computation. In Proc. ACM Int. Conf. Multimedia, pages 631--634, 2006.
12. W. Buntine. A guide to the literature on learning probabilistic networks form data. IEEE Trans. Knowledge and Data Engineering, 8(2):195--210, 1996.
13. H. Turtle and W. B. Croft. Evaluation of an interface network-based retrieval model. ACM Trans. Information Systems, 9(3):187--222, 1991.
14. Y. Freund and R. E. Schapire. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Science, 55(1):119--139, 1996.
15. Information Retrieval and Extraction Exercise. NE rules and definition (version 990214). http://nlp.cs.nyu.edu/irex/NE/.
16. NAIST Computational Linguistics Lab. ChaSen. http://chasen.naist.jp/hiki/ChaSen/.
17. M. G. Christel, M. A. Smith, C. R. Taylor and D. B. Winkler. Evolving Video Skims into Useful Multimedia Abstractions. In Proc. ACM CHI, pages 171--178, 1998.

Index Terms

• Information systems

  • Information retrieval

  • Information storage systems