Bagadus: An integrated real-time system for soccer analytics

Abstract

The importance of winning has increased the role of performance analysis in the sports industry, and this underscores how statistics and technology keep changing the way sports are played. Thus, this is a growing area of interest, both from a computer system view in managing the technical challenges and from a sport performance view in aiding the development of athletes. In this respect, Bagadus is a real-time prototype of a sports analytics application using soccer as a case study. Bagadus integrates a sensor system, a soccer analytics annotations system, and a video processing system using a video camera array. A prototype is currently installed at Alfheim Stadium in Norway, and in this article, we describe how the system can be used in real-time to playback events. The system supports both stitched panorama video and camera switching modes and creates video summaries based on queries to the sensor system. Moreover, we evaluate the system from a systems point of view, benchmarking different approaches, algorithms, and trade-offs, and show how the system runs in real time.

References

1. Mir Adnan Ali and Steve Mann. 2012. Comparametric image compositing: Computationally efficient high dynamic range imaging. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 913--916.
2. Horesh Ben Shitrit, Jerome Berclaz, Francois Fleuret, and Pascal Fua. 2011. Tracking multiple people under global appearance constraints. In Proceedings of the IEEE International Conference on Computer Vision (CCV). 137--144.
3. Jerome Berclaz, Francois Fleuret, Engin Turetken, and Pascal Fua. 2011. Multiple object tracking using k-shortest paths optimization. IEEE Trans. Pattern Anal. Mach. Intell. 33, 9, 1806--1819.
4. Matthew Brown and David G. Lowe. 2007. Automatic panoramic image stitching using invariant features. Int. J. Comput. Vision 74, 1, 59--73.
5. S. Brutzer, B. Hoferlin, and G. Heidemann. 2011. Evaluation of background subtraction techniques for video surveillance. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 1937--1944.
6. Cairos Technologies. 2013a. Goal Line Technology (GLT) system. http://www.cairos.com/unternehmen/gltsystem.php.
7. Cairos Technologies. 2013b. VIS.TRACK. http://www.cairos.com/unternehmen/vistrack.php.
8. Camargus. 2013. Premium Stadium Video Technology Inrastructure. http://www.camargus.com/.
9. Chao-Ho Chen, Tsong-Yi Chen, Je-Ching Lin, and Da-Jinn Wang. 2011. People tracking in the multi-camera surveillance system. In Proceedings of the 2nd International Conference on Innovations in Bio-inspired Computing and Applications (IBICA). 1--4.
10. Peter Dizikes. 2013. Sports analytics: A real game-changer. http://web.mit.edu/newsoffice/2013/sloan-sports-analytics-conference-2013-0304.html.
11. Christoph Fehn, Christian Weissig, Ingo Feldmann, Markus Muller, Peter Eisert, Peter Kauff, and Hans Bloss. 2006. Creation of high-resolution video panoramas of sport events. In Proceedings of the 8th IEEE International Symposium on Multimedia (ISM). 291--298.
12. Luis M. Fuentes and Sergio A. Velastin. 2006. People tracking in surveillance applications. Image Vision Comput. 24, 11, 1165--1171.
13. Benjamin Guthier, Stephan Kopf, and Wolfgang Effelsberg. 2012. Optimal shutter speed sequences for real-time HDR video. In Proceedings of the IEEE International Conference on Image Systems and Techniques (IST). 303--308.
14. Pål Halvorsen, Simen Sægrov, Asgeir Mortensen, David K. C. Kristensen, Alexander Eichhorn, Magnus Stenhaug, Stian Dahl, Håkon Kvale Stensland, Vamsidhar Reddy Gaddam, Carsten Griwodz, and Dag Johansen. 2013. Bagadus: An integrated system for arena sports analytics a soccer case study. In Proceedings of the 4th ACM Multimedia Systems Conference (MMSys). 48--59.
15. R. I. Hartley and A. Zisserman. 2004. Multiple View Geometry in Computer Vision 2nd Ed. Cambridge University Press.
16. Hawk-Eye. 2013. Football::Hawk-Eye. http://www.hawkeyeinnovations.co.uk/page/sports-officiating/football.
17. Interplay Sports. 2013. The ultimate video analysis and scouting software. http://www.interplay-sports.com/.
18. Sachiko Iwase and Hideo Saito. 2004. Parallel tracking of all soccer players by integrating detected positions in multiple view images. In Proceedings of the 7th International Conference on Pattern Recognition (ICPR). 751--754.
19. Hao Jiang, Sidney Fels, and James J. Little. 2007. A linear programming approach for multiple object tracking. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
20. Hailin Jin. 2008. A three-point minimal solution for panoramic stitching with lens distortion. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 1--8.
21. Dag Johansen, Håvard Johansen, Tjalve Aarflot, Joseph Hurley, Åge Kvalnes, Cathal Gurrin, Sorin Sav, Bjørn Olstad, Erik Aaberg, Tore Endestad, Haakon Riiser, Carsten Griwodz, and Pål Halvorsen. 2009. DAVVI: A prototype for the next generation multimedia entertainment platform. In Proceedings of the 17th ACM International Conference on Multimedia (MM). 989--990.
22. Dag Johansen, Magnus Stenhaug, Roger Bruun Asp Hansen, Agnar Christensen, and Per-Mathias Høgmo. 2012. Muithu: Smaller footprint, potentially larger imprint. In Proceedings of the 7th International Conference on Digital Information Management (ICDIM). 205--214.
23. P. Kaewtrakulpong and R. Bowden. 2001. An improved adaptive background mixture model for realtime tracking with shadow detection. In Proceedings of the Video-Based Surveillance Systems. 135--144.
24. Jinman Kang, Isaac Cohen, and Gerard Medioni. 2003. Soccer player tracking across uncalibrated camera streams. In Proceedings of the Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS). 172--179.
25. Wen-Chung Kao, Li-Wei Cheng, Chen-Yu Chien, and Wen-Kuo Lin. 2011. Robust brightness measurement and exposure control in real-time video recording. IEEE Trans. Instrument. Measur. 60, 4, 1206--1216.
26. Jubiao Li and Junping Du. 2010. Study on panoramic image stitching algorithm. In Proceedings of the 2nd Pacific-Asia Conference on Circuits, Communications and Systems (PACCS). 417--420.
27. Wen-Yan Lin, Siying Liu, Y. Matsushita, Tian-Tsong Ng, and Loong-Fah Cheong. 2011. Smoothly varying affine stitching. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 345--352.
28. Noel McKeegan. 2007. The Adidas intelligent football. http://www.gizmag.com/adidas-intelligent-football/8512/.
29. Tomohiro Ozawa, Kris M. Kitani, and Hideki Koike. 2012. Human-centric panoramic imaging stitching. In Proceedings of the Augmented Human International Conferences Series (AH). 20:1--20:6.
30. Prozone. 2013. Prozone Sports -- Introducing Prozone performance analysis products. http://www.prozonesports.com/products.html.
31. Simen Sægrov, Alexander Eichhorn, Jørgen Emerslund, Håkon Kvale Stensland, Carsten Griwodz, Dag Johansen, and Pål Halvorsen. 2012. Bagadus: An integrated system for soccer analysis (demo). In Proceedings of the 6th International Conference on Distributed Smart Cameras (ICDSC).
32. Valter Di Salvo, Adam Collins, Barry McNeill, and Marco Cardinale. 2006. Validation of Prozone: A new video-based performance analysis system. Int. J. Perform. Anal. Sport 6, 1, 108--119.
33. Nils T. Siebel and Stephen J. Maybank. 2002. Fusion of multiple tracking algorithms for robust people tracking. In Proceedings of the 7th European Conference on Computer Vision (ECCV). Lecture Notes in Computer Science, vol. 2353, Springer-Verlag, Berlin Heidelberg, 373--387.
34. Stats. 2013. STATS—SportVU—Football/Soccer. http://www.sportvu.com/football.asp.
35. Yingen Xiong and Kari Pulli. 2009. Color correction for mobile panorama imaging. In Proceedings of the 1st International Conference on Internet Multimedia Computing and Service (ICIMCS). 219--226.
36. Yingen Xiong and Kari Pulli. 2010. Fast panorama stitching for high-quality panoramic images on mobile phones. IEEE Trans. Consumer Electron. 56, 2.
37. Ming Xu, James Orwell, and Graetne Jones. 2004. Tracking football players with multiple cameras. In Proceedings of the International Conference on Image Processing (ICIP). 2909--2912.
38. Sunghoon Choi Yongduek, Sunghoon Choi, Yongduek Seo, Hyunwoo Kim, and Ki sang Hong. 1997. Where are the ball and players? Soccer game analysis with color-based tracking and image mosaick. In Proceedings of the 9th International Conference on Image Analysis and Processing (ICIAP). Lecture Notes in Computer Science, vol. 1311, Springer-Varlag, Berlin Heidelberg, 196--203.
39. Zhengyou Zhang. 1999. Flexible camera calibration by viewing a plane from unknown orientations. In Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV). 666--673.
40. Z. Zivkovic. 2004. Improved adaptive gaussian mixture model for background subtraction. In Proceedings of the 17th International Conference on Pattern Recognition (ICPR). 28--31. Vol. 2.
41. Zoran Zivkovic and Ferdinand van der Heijden. 2006. Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern Recog. Lett. 27, 7, 773--780.
42. ZXY. 2013. ZXY Sport Tracking. http://www.zxy.no/.

Index Terms

• Computer systems organization

  • Embedded and cyber-physical systems

  • Real-time systems

• Information systems

  • Information systems applications

    • Multimedia information systems