Highlight scene extraction in real time from baseball live video

ABSTRACT

This paper proposes a method to automatically extract highlight scenes from sports (baseball) live video in real time and to allow users to retrieve them. For this purpose, sophisticated speech recognition is employed to convert the speech signal into the text and to extract a group of keywords in real time. Image processing detects, also in real time, the pitcher scenes and ending at the successive pitcher scene. Highlight scenes are extracted as the pitching sections with the keywords such as home run, two-base hit and three-base hit extracted from speech signals.

REFERENCES

• 1: C. L. Leggetter and P. C. Woodland. Maximum likelihood linear regression for speaker adaptation of continuous density hidden markov models. Computer Speech and Language, 9:171--185, 1995.
• 2: A. Ito, M. Kohda, and M. Ostendorf. A new metric for stochastic language model evaluation. In Proceedings of Eurospeech99, pages 1591--1594. ISCA, 1999.
• 3: J. L. Gauvain and C. Lee. Maximum a posteriori estimation for multivariate gaussian mixture observations of markov chains. IEEE Trans. on Speech and Audio Processing, 2(2):291--298, 1994.
• 4: J. Ogata and Y. Ariki. An efficient lexical tree search for large vocabulary continuous speech recognition. In Proceedings of International Conference on Spoken Language Processing, pages 967--970, 2000.
• 5: T. Kawashima, K. Tateyama, T. Iijima, and Y. Aoki. Indexing of baseball telecast for content - based video retrieval. In Proceedings of International Conference on Image Processing, pages CD-ROM. IEEE, October 1998.
• 6: K. Maekawa, H. Koiso, S. Furui, and H. Isahara. Spontaneous speech corpus of japanese. In Proceedings of LREC2000, pages 947--952, 2000.
• 7: M. Kumano and Y. Ariki. Automatic useful shot extraction for a video editing support system. In Proceedings of MVA, pages 310--313, 2002.
• 8: N. Babaguchi. Towards abstracting sports video by highlights. In Proceedings of International Conference on Multimedia and Expo, pages 1519--1522. IEEE, 2000.
• 9: P. Chang, M. Han, and Y. Gong. Extract highlights from baseball game video with hidden markov models. In Proceedings of International Conference on Image Processing, pages 609--612. IEEE, 2002.
• 10: S. Ortmanns, H. Ney, and X. Aubert. A word graph algorithm for large vocabulary continuous speech recognition. volume 11, pages 43--72, 1997.
• 11: Integrated Image and Speech Analysis for Content-Based Video Indexing, Proceedings of the 1996 International Conference on Multimedia Computing and Systems (ICMCS '96), p.0306, June 17-23, 1996
• 12: Yong Rui , Anoop Gupta , Alex Acero, Automatically extracting highlights for TV Baseball programs, Proceedings of the eighth ACM international conference on Multimedia, p.105-115, October 2000, Marina del Rey, California, United States [doi>10.1145/354384.354443]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Signal processing

General Terms:
Experimentation

Keywords:
acoustic model adaptation, highlight scenes, language model adaptation, speech recognition, sports live video