skip to main content
10.1145/1275808.1276495acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
Article

Efficient gradient-domain compositing using quadtrees

Published: 29 July 2007 Publication History

Abstract

We describe a hierarchical approach to improving the efficiency of gradient-domain compositing, a technique that constructs seamless composites by combining the gradients of images into a vector field that is then integrated to form a composite. While gradient-domain compositing is powerful and widely used, it suffers from poor scalability. Computing an n pixel composite requires solving a linear system with n variables; solving such a large system quickly overwhelms the main memory of a standard computer when performed for multi-megapixel composites, which are common in practice. In this paper we show how to perform gradient-domain compositing approximately by solving an O(p) linear system, where p is the total length of the seams between image regions in the composite; for typical cases, p is O(√n). We achieve this reduction by transforming the problem into a space where much of the solution is smooth, and then utilize the pattern of this smoothness to adaptively subdivide the problem domain using quadtrees. We demonstrate the merits of our approach by performing panoramic stitching and image region copy-and-paste in significantly reduced time and memory while achieving visually identical results.

Supplementary Material

JPG File (pps093.jpg)
MP4 File (pps093.mp4)

References

[1]
Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Transactions on Graphics 23, 3 (Aug.), 294--302.
[2]
Agarwala, A., Zheng, K. C., Pal, C., Agrawala, M., Cohen, M., Curless, B., Salesin, D. H., and Szeliski, R. 2005. Panoramic video textures. ACM Transactions on Graphics 24, 3 (Aug.), 821--827.
[3]
Agarwala, A., Agrawala, M., Cohen, M., Salesin, D., and Szeliski, R. 2006. Photographing long scenes with multi-viewpoint panoramas. ACM Transactions on Graphics 25, 3 (July), 853--861.
[4]
Agrawal, A., Raskar, R., Nayar, S. K., and Li, Y. 2005. Removing photography artifacts using gradient projection and flash-exposure sampling. ACM Transactions on Graphics 24, 3 (Aug.), 828--835.
[5]
Bae, S., Paris, S., and Durand, F. 2006. Two-scale tone management for photographic look. ACM Transactions on Graphics 25, 3 (July), 637--645.
[6]
Bolz, J., Farmer, I., Grinspun, E., and Schröder, P. 2003. Sparse matrix solvers on the GPU: Conjugate gradients and multigrid. ACM Transactions on Graphics 22, 3 (July), 917--924.
[7]
Dyer, C. 1982. The space efficiency of quadtrees. Computer Graphics and Image Processing 19, 4 (Aug.), 335--348.
[8]
Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Transactions on Graphics 21, 3, 249--256.
[9]
Finlayson, G., and Drew, S. H. M. 2002. Removing shadows from images. In European Conference on Computer Vision (ECCV 02), 823--831.
[10]
Fuhrmann, D. R. 1988. Quadtree traversal algorithms for pointer-based and depth-first representations. IEEE Transactions on Pattern Analysis and Machine Intelligence 10, 6, 955--960.
[11]
Georgiev, T. 2004. Photoshop healing brush: a tool for seamless cloning. In Workshop on Applications of Computer Vision (ECCV 2004), 1--8.
[12]
Goldman, D. B., and Chen, J.-H. 2005. Vignette and exposure calibration and compensation. In International Conference on Computer Vision (ICCV 05), 899--906.
[13]
Hays, J., and Efros, A. 2007. Scene completion using millions of photographs. ACM Transactions on Graphics 26, 3, To appear.
[14]
Jia, J., Sun, J., Tang, C.-K., and Shum, H.-Y. 2006. Drag-and-drop pasting. ACM Transactions on Graphics 25, 3 (July), 631--637.
[15]
Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics 22, 3, 277--286.
[16]
Land, E. H. 1977. The retinex theory of color vision. Scientific American 237, 6, 108--128.
[17]
Levin, A., Zomet, A., Peleg, S., and Weiss, Y. 2004. Seamless image stitching in the gradient domain. In European Conference on Computer Vision (ECCV 04), 377--389.
[18]
Losasso, F., Gibou, F., and Fedkiw, R. 2004. Simulating water and smoke with an octree data structure. ACM Transactions on Graphics 23, 3 (Aug.), 457--462.
[19]
Moore, D. 1995. The cost of balancing generalized quadtrees. In Proceedings of the Third ACM Symposium on Solid Modeling and Applications, 305--312.
[20]
Palmer, S. E. 1999. Vision Science: Photons to Phenomenology. The MIT Press.
[21]
Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Transactions on Graphics 22, 3 (July), 313--318.
[22]
Saad, Y. 2003. Iterative methods for sparse linear systems, 2nd ed. Society for Industrial and Applied Mathematics (SIAM).
[23]
Samet, H. 1990. Applications for spatial data structures: computer graphics, image processing, and GIS. Addison-Wesley.
[24]
Shewchuk, J. R. 1994. An introduction to the conjugate gradient method without the agonizing pain. Tech. Rep. CS-94-125, Carnegie Mellon University.
[25]
Simchony, T., Chellappa, R., and Shao, M. 1990. Direct analytical methods for solving Poisson equations in computer vision problems. IEEE Transactions on Pattern Analysis and Machine Intelligence 12, 5, 435--446.
[26]
Sun, J., Jia, J., Tang, C.-K., and Shum, H.-Y. 2004. Poisson matting. ACM Transactions on Graphics 23, 3 (Aug.), 315--321.
[27]
Szeliski, R., and Shum, H.-Y. 1996. Motion estimation with quadtree splines. IEEE Transactions on Pattern Analysis and Machine Intelligence 18, 12, 1199--1210.
[28]
Szeliski, R. 1990. Fast surface interpolation using hierarchical basis functions. IEEE Transactions on Pattern Analysis and Machine Intelligence 12, 6, 513--528.
[29]
Szeliski, R. 2006. Locally adapted hierarchical basis preconditioning. ACM Transactions on Graphics 25, 3 (July), 1135--1143.
[30]
Toledo, S. 1999. A survey of out-of-core algorithms in numerical linear algebra. In External Memory Algorithms, DIMACS Series in Discrete Mathematics and Theoretical Computer Science. 161--180.
[31]
Wang, H., Raskar, R., and Ahuja, N. 2004. Seamless video editing. In Proceedings of the International Conference on Pattern Recognition (ICPR), 858--861.
[32]
Weiss, Y. 2001. Deriving intrinsic images from image sequences. In International Conference On Computer Vision (ICCV 01), 68--75.
[33]
Zomet, A., Levin, A., Peleg, S., and Weiss, Y. 2006. Seamless image stitching by minimizing false edges. IEEE Transactions on Image Processing 15, 4, 969--977.

Cited By

View all
  • (2022)Modified Poisson compositing technique on skewed gridAIMS Mathematics10.3934/math.20221247:2(2176-2194)Online publication date: 2022
  • (2022)SurfaceView: Seamless and Tile-Based Orthomosaics Using Millions of Street-Level Images From Vehicle-Mounted CamerasIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2020.303692823:4(3482-3497)Online publication date: Apr-2022
  • (2019)Automatic Cloud Removal from Multi-Temporal Landsat Collection 1 Data Using Poisson BlendingIGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium10.1109/IGARSS.2019.8899849(1661-1664)Online publication date: Jul-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH '07: ACM SIGGRAPH 2007 papers
August 2007
1019 pages
ISBN:9781450378369
DOI:10.1145/1275808
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2007

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Article

Conference

SIGGRAPH07
Sponsor:

Acceptance Rates

SIGGRAPH '07 Paper Acceptance Rate 108 of 455 submissions, 24%;
Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Modified Poisson compositing technique on skewed gridAIMS Mathematics10.3934/math.20221247:2(2176-2194)Online publication date: 2022
  • (2022)SurfaceView: Seamless and Tile-Based Orthomosaics Using Millions of Street-Level Images From Vehicle-Mounted CamerasIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2020.303692823:4(3482-3497)Online publication date: Apr-2022
  • (2019)Automatic Cloud Removal from Multi-Temporal Landsat Collection 1 Data Using Poisson BlendingIGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium10.1109/IGARSS.2019.8899849(1661-1664)Online publication date: Jul-2019
  • (2017)Interactive design space exploration and optimization for CAD modelsACM Transactions on Graphics10.1145/3072959.307368836:4(1-14)Online publication date: 20-Jul-2017
  • (2017)Efficient Gradient‐Domain Compositing Using an Approximate Curl‐free Wavelet ProjectionComputer Graphics Forum10.1111/cgf.1328636:7(207-215)Online publication date: 13-Oct-2017
  • (2017)Multi-band blending of aerial images using GPU acceleration2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI)10.1109/CISP-BMEI.2017.8302068(1-5)Online publication date: Oct-2017
  • (2016)Large-Scale Semantic 3D Reconstruction: An Adaptive Multi-resolution Model for Multi-class Volumetric Labeling2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2016.346(3176-3184)Online publication date: Jun-2016
  • (2015)Fast computation of seamless video loopsACM Transactions on Graphics10.1145/2816795.281806134:6(1-10)Online publication date: 2-Nov-2015
  • (2015)Panoramic Video Construction from Mobile Video StreamsMobile Cloud Visual Media Computing10.1007/978-3-319-24702-1_3(61-83)Online publication date: 24-Nov-2015
  • (2014)Image Edit by Boundary Difference PropagationProceedings of the 2014 5th International Conference on Digital Home10.1109/ICDH.2014.27(101-104)Online publication date: 28-Nov-2014
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media