Trajectory-based ball detection and tracking with applications to semantic analysis of broadcast soccer video

ABSTRACT

This paper first presents an improved trajectory-based algorithm for automatically detecting and tracking the ball in broadcast soccer video. Unlike the object-based algorithms, our algorithm does not evaluate whether a sole object is a ball. Instead, it evaluates whether a candidate trajectory, which is generated from the candidate feature image by a candidate verification procedure based on Kalman filter,, which is generated from the candidate feature image by a candidate verification procedure based on Kalman filter, is a ball trajectory. Secondly, a new approach for automatically analyzing broadcast soccer video is proposed, which is based on the ball trajectory. The algorithms in this approach not only improve play-break analysis and high-level semantic event detection, but also detect the basic actions and analyze team ball possession, which may not be analyzed based only on the low-level feature. Moreover, experimental results show that our ball detection and tracking algorithm can achieve above 96% accuracy for the video segments with the soccer field. Compared with the existing methods, a higher accuracy is achieved on goal detection and play-break segmentation. To the best of our knowledge, we present the first solution in detecting the basic actions such as touching and passing, and analyzing the team ball possession in broadcast soccer video.

REFERENCES

• 1: IEEE MultiMedia, The Holy Grail of Content-Based Media Analysis, IEEE MultiMedia, v.9 n.2, p.6-10, April 2002 [doi>10.1109/93.998041]
• 2: Corinna Cortes , Vladimir Vapnik, Support-Vector Networks, Machine Learning, v.20 n.3, p.273-297, Sept. 1995 [doi>10.1023/A:1022627411411]
• 3: T. D'Orazio , N. Ancona , G. Cicirelli , M. Nitti, A Ball Detection Algorithm for Real Soccer Image Sequences, Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 1, p.10210, August 11-15, 2002
• 4: A. Ekin, A. M. Tekalp. Robust dominant color region detection with applications to sports video, submitted to Comp. Vision & Image Understanding.
• 5: A. Ekin, A.M. Tekalp, and R. Mehrotra. Automatic Soccer Video Analysis and Summarization, IEEE Trans. on Image Processing, Vol. 12:7(2003), 796--807.
• 6: Chua Hock Chuan, Automatic Parsing of TV Soccer Programs, Proceedings of the International Conference on Multimedia Computing and Systems, p.167, May 15-18, 1995
• 7: Michael Isard , Andrew Blake, ICONDENSATION: Unifying Low-Level and High-Level Tracking in a Stochastic Framework, Proceedings of the 5th European Conference on Computer Vision-Volume I, p.893-908, June 02-06, 1998
• 8: Gerald Kühne , Stephan Richter , Markus Beier, Motion-based segmentation and contour-based classification of video objects, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500150]
• 9: David G. Lowe, Robust model-based motion tracking through the integration of search and estimation, International Journal of Computer Vision, v.8 n.2, p.113-122, Aug. 1992 [doi>10.1007/BF00127170]
• 10: C. Rasmussen , G. D. Hager, Joint Probabilistic Techniques for Tracking Multi-Part Objects, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.16, June 23-25, 1998
• 11: V. Tovinkere and R. J. Qian. Detecting semantic events in soccer games: Towards a complete solution, In Proc. ICME 2001, 1040--1043.
• 12: M. Xu, N. C. Maddage, C. Xu, M. Kankanhalli, and Q. Tian. Creating audio keywords for event detection in soccer video, In Proc. ICME 2003, Vol II, 281--284.
• 13: L. Xie, S. F. Chang, A. Divakaran, and H. Sun. Structure analysis of soccer video with hidden markov models, In Proc. ICASSP 2002.
• 14: P. Xu. L. Xie, S. F. Chang, A. Divakaran, and H. Sun. Algorithm and system for segmentation and structure analysis in soccer video, In Proc. ICME 2001.
• 15: D. Yow. B. L. Yeo, M. Yeung, and B. Liu. Analysis and presentation of soccer highlights from digital video, In proc. ACCV, 1995.
• 16: X. Yu, Q. Tian, and K. W. Wan. A novel ball detection framework for real soccer video, In Proc. ICME 2003, Vol II, 265--268.
• 17: X. Yu, C. Xu, Q. Tian, and H. W. Leong. A ball tracking framework for broadcast soccer video, In Proc. ICME 2003, Vol II, 273--276.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Color

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Video analysis
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Tracking; Shape

General Terms:
Algorithms, Experimentation, Performance

Keywords:
ball detection and tracking, event detection, semantic analysis, trajectory-based