skip to main content
10.1145/2393347.2396399acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
poster

Dynamic camera calibration method for free-viewpoint experience in sport videos

Published: 29 October 2012 Publication History

Abstract

In this paper, we propose a dynamic camera calibration and object extraction method for sport videos captured with a moving pan-tilt-zoom camera. Such technology realizes an immersive free-viewpoint experience whereby audiences can see real sport scenes from any viewpoint. Camera calibration and object extraction are two of the most important processes for rendering free-viewpoint video, since a 3-dimensional model of each object needs to be reconstructed in every frame based on objects' textures and camera parameters. Most conventional rendering methods only use static cameras whose camera parameters and background models change little. However, since the cameras have to be set apart widely enough to capture the entire scene, the resolution of each object becomes low and is not sufficient for rendering high-quality free-viewpoint video. In order to obtain the texture of an object in high resolution from a moving pan-tilt-zoom camera, our proposed method estimates camera parameters by identifying reliable corresponding feature points between video frames, and also extracts the precise textures of objects using estimated camera parameters. Experimental results revealed that the proposed method successfully estimated precise camera parameters compared to the conventional method. Furthermore, by applying our proposed approach, the free-viewpoint video was rendered without visual defects.

References

[1]
Kanade, T., Rander, P. W., and Narayanan, P. J. 1997. Virtualized Reality: Constructing Virtual Worlds from Real Scenes. IEEE MULTIMEDIA, Vol. 4, No. 1. 34--47.
[2]
Ishikawa, A., Tehrani, M. P., Naito, S., Sakazawa, S., and Koike, A. 2008. Free Viewpoint Video Generation for Walk-through Experience using Image-based Rendering. In Proc. of the 16TH ACM Conference on Multimedia. 1007--1008.
[3]
Laurentini, A. 1997. How far 3d Shapes Can Be Understood From 2d Silhouettes. IEEE TRANSACTIONS ON PAMI, Vol. 17, No. 2. 188--195.
[4]
Sankoh, H., Ishikawa, A., Naito, S., and Sakazawa, S. 2010. Robust Background Subtraction Method based on 3d Model Projections with Likelihood. In Proc. of 12th IEEE International Workshop on MMSP. 171--176.
[5]
Seitz, S., M., and Dyer, C., R. 1997. View Morphing. In Proc. of ACM SIGGRAPH. 21--30.
[6]
Inamoto, N. and Saito, H. 2007. Virtual Viewpoint Replay for a Soccer Match by View Interpolation from Multiple Cameras. IEEE MULTIMEDIA, Vol. 9, No. 6. 1155--1166.
[7]
Koyama, T., Kitahara, I., and Ohta, Y. 2003. Live Mixed-reality 3d Video in Soccer Stadium. In Proc. of IEEE/ACM Conference on ISMAR. 178--187.
[8]
Hayashi, K. and Saito, H. 2006. Synthesizing Free-viewpoint Images from Multiple View Videos in Soccer Stadium. In Proc. of IEEE Conference on CGIV. 220--225.
[9]
Germann, M., Hornung, A., Keiser, R., Ziegler, R., Wurmlin, S., and Gross, M. 2010. Articulated Billboards for Video-based Rendering. In Proc. EUROGRAPHICS. 585--594.
[10]
Farin, D., Krabbe, S., With, P. H.N.D., and Effelsberg, W. 2004. Robust Camera Calibration for Sport Videos using Court Models. In Proc. of SPIE Stor. Retr. Meth. Appl. Mult. Vol. 5307, 80--91.
[11]
Breitenstein, M., Reichlin, F., Leibe, B., Koller-meier, E., and Gool, L., V., 2009. Robust Tracking-by-Detection using a Detector Confidence Particle Filter. In Proc. IEEE conference on ICCV, 1515--1522.
[12]
Bay, H., Tuytelaars, T., and Gool, L. V., 2006. SURF: Speeded Up Robust Features. In Proc. of ECCV, 404--417.

Cited By

View all
  • (2018)Robust Billboard-based, Free-viewpoint Video Synthesis Algorithm to Overcome Occlusions under Challenging Outdoor Sport ScenesProceedings of the 26th ACM international conference on Multimedia10.1145/3240508.3240514(1724-1732)Online publication date: 15-Oct-2018
  • (2017)Software defined media: Virtualization of audio-visual services2017 IEEE International Conference on Communications (ICC)10.1109/ICC.2017.7996610(1-7)Online publication date: May-2017
  • (2016)Automatic camera self-calibration for immersive navigation of free viewpoint sports video2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP.2016.7813399(1-6)Online publication date: Sep-2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '12: Proceedings of the 20th ACM international conference on Multimedia
October 2012
1584 pages
ISBN:9781450310895
DOI:10.1145/2393347
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. calibration
  2. camera parameter
  3. free-viewpoint video
  4. graph cut
  5. homography matrix
  6. object extraction

Qualifiers

  • Poster

Conference

MM '12
Sponsor:
MM '12: ACM Multimedia Conference
October 29 - November 2, 2012
Nara, Japan

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2018)Robust Billboard-based, Free-viewpoint Video Synthesis Algorithm to Overcome Occlusions under Challenging Outdoor Sport ScenesProceedings of the 26th ACM international conference on Multimedia10.1145/3240508.3240514(1724-1732)Online publication date: 15-Oct-2018
  • (2017)Software defined media: Virtualization of audio-visual services2017 IEEE International Conference on Communications (ICC)10.1109/ICC.2017.7996610(1-7)Online publication date: May-2017
  • (2016)Automatic camera self-calibration for immersive navigation of free viewpoint sports video2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP.2016.7813399(1-6)Online publication date: Sep-2016
  • (2016)Real-time camera motion tracking in planar view scenariosJournal of Real-Time Image Processing10.1007/s11554-013-0360-311:2(287-299)Online publication date: 1-Feb-2016
  • (2015)Recognizing Team Formation in American FootballComputer Vision in Sports10.1007/978-3-319-09396-3_13(271-291)Online publication date: 20-Jan-2015
  • (2014)FTV standardization in MPEG2014 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON)10.1109/3DTV.2014.6874767(1-4)Online publication date: Jul-2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media