skip to main content
10.1145/2787626.2792617acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
poster

Jigsaw: multi-modal big data management in digital film production

Published: 31 July 2015 Publication History

Abstract

Modern digital film production uses large quantities of data captured on-set, such as videos, digital photographs, LIDAR scans, spherical photography and many other sources to create the final film frames. The processing and management of this massive amount of heterogeneous data consumes enormous resources. We propose an integrated pipeline for 2D/3D data registration aimed at film production, based around the prototype application Jigsaw. It allows users to efficiently manage and process various data types from digital photographs to 3D point clouds. A key step in the use of multi-modal 2D/3D data for content production is the registration into a common coordinate frame (match moving). 3D geometric information is reconstructed from 2D data and registered to the reference 3D models using 3D feature matching [Kim and Hilton 2014]. We present several highly efficient and robust approaches to this problem. Additionally, we have developed and integrated a fast algorithm for incremental marginal covariance calculation [Ila et al. 2015]. This allows us to estimate and visualize the 3D reconstruction error directly on-set, where insufficient coverage or other problems can be addressed right away. We describe the fast hybrid multi-core and GPU accelerated techniques that let us run these algorithms on a laptop. Jigsaw has been used and evaluated in several major digital film productions and significantly reduced the time and work required to manage and process on-set data.

References

[1]
Ila, V., Polok, L., Solony, M., Zemcik, P., and Smrz, P. 2015. Fast Covariance Recovery in Incremental Nonlinear Least Squares Solvers. In Proc. ICRA 2015.
[2]
Kim, H., and Hilton, A. 2014. Hybrid 3D Feature Description and Matching for Multi-modal Data Registration. In Proc. ICIP 2014.

Cited By

View all
  • (2023)Jigsaw: Graphical Representation for Big Data Management in Digital Film ProductionACM SIGGRAPH 2023 Talks10.1145/3587421.3595444(1-2)Online publication date: 6-Aug-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH '15: ACM SIGGRAPH 2015 Posters
July 2015
95 pages
ISBN:9781450336321
DOI:10.1145/2787626
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 July 2015

Check for updates

Qualifiers

  • Poster

Conference

SIGGRAPH '15
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Jigsaw: Graphical Representation for Big Data Management in Digital Film ProductionACM SIGGRAPH 2023 Talks10.1145/3587421.3595444(1-2)Online publication date: 6-Aug-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media