skip to main content
research-article

Edge-based image coarsening

Published:15 December 2009Publication History
Skip Abstract Section

Abstract

This article presents a new dimensionally-reduced linear image space that allows a number of recent image manipulation techniques to be performed efficiently and robustly. The basis vectors spanning this space are constructed from a scale-adaptive image decomposition, based on kernels of the bilateral filter. Each of these vectors locally binds together pixels in smooth regions and leaves pixels across edges independent. Despite the drastic reduction in the number of degrees of freedom, this representation can be used to perform a number of recent gradient-based tonemapping techniques. In addition to reducing computation time, this space can prevent the bleeding artifacts which are common to Poisson-based integration methods. In addition, we show that this reduced representation is useful for energy-minimization methods in achieving efficient processing and providing better matrix conditioning at a minimal quality sacrifice.

References

  1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Trans. Graph. 23, 294--302. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bae, S., Paris, S., and Durand, F. 2006. Two-Scale tone management for photographic look. ACM Trans. Graph. 25, 637--645. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Trans. Patt. Anal. Mach. Intell. 23, 11, 1222--1239. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Burt, P. J. and Adelson, E. H. 1983. The Laplacian pyramid as a compact image code. IEEE Trans. Comm. 31, 4, 532--540.Google ScholarGoogle ScholarCross RefCross Ref
  5. Chen, J., Paris, S., and Durand, F. 2007. Real-Time edge-aware image processing with the bilateral grid. ACM Trans. Graph. 26, 103. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Chen, K. 2005. Matrix Preconditioning Techniques and Applications. Number 19. Cambridge University Press.Google ScholarGoogle Scholar
  7. Durand, F. and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 21, 257--266. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Efros, A. A. and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. In Proceedings of the International Conference on Computer Vision (ICCV'99). 1033--1038. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Eisemann, E. and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. ACM Trans. Graph. 23, 673--678. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Fattal, R., Agrawala, M., and Rusinkiewicz, S. 2007. Multiscale shape and detail enhancement from multi-light image collections. ACM Trans. Graph. 26, 51. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Trans. Graph. 21, 249--256. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Finlayson, G. D., Hordley, S. D., Drew, M. S., and Tj, E. N. 2002. Removing shadows from images. In Proceedings of the European Conference on Computer Vision (ECCV'02). 823--836. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Finlayson, G. D., Hordley, S. D., Lu, C., and Drew, M. S. 2006. On the removal of shadows from images. IEEE Trans. Patt. Anal. Mach. Intell. 28, 1, 59--68. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Grady, L., Tasdizen, T., and Whitaker, R. T. 2005. A geometric multigrid approach to solving the 2d inhomogeneous laplace equation with internal dirichlet boundary conditions. In Proceedings of the IEEE International Conference on Image Processing (ICIP'05). Vol. 2. 642--645.Google ScholarGoogle Scholar
  15. Hackbusch, W. 1994. Iterative Solution of Large Sparse Systems of Equations. Springer-Verlag, Berlin.Google ScholarGoogle Scholar
  16. Kopf, J., Cohen, M. F., Lischinski, D., and Uyttendaele, M. 2007. Joint bilateral upsampling. ACM Trans. Graph. 26, 96. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Levin, A., Fergus, R., Durand, F., and Freeman, W. T. 2007a. Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26, 3, 70. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Levin, A., Lischinski, D., and Weiss, Y. 2004a. Colorization using optimization. ACM Trans. Graph. 23, 689--694. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Levin, A., Lischinski, D., and Weiss, Y. 2006. A closed form solution to natural image matting. In Proceedings of the Computer Vision and Pattern Recognition (CVPR'06). IEEE Computer Society, 61--68. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Levin, A., Rav-Acha, A., and Lischinski, D. 2007b. Spectral matting. In Proceedings of the Computer Vision and Pattern Recognition (CVPR'07). 1--8.Google ScholarGoogle Scholar
  21. Levin, A., Zomat, A., Peleg, S., and Weiss, Y. 2004b. Seamless image stitching in the gradient domain. In Proceedings of the European Conference on Computer Vision (ECCV'04).Google ScholarGoogle Scholar
  22. Li, Y., Sun, J., Tang, C.-K., and Shum, H.-Y. 2004. Lazy snapping. ACM Trans. Graph. 23, 303--308. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Trans. Graph. 25, 646--653. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Mallat, S. G. 1989. A theory for multiresolution signal decomposition: The wavelet representation. IEEE Trans. Patt. Anal. Mach. Intell. 11, 7, 674--693. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. Graph. 22, 313--318. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Petschnigg, G., Agrawala, M., Hoppe, H., Szeliski, R., Cohen, M., and Toyama, K. 2004. Digital photography with flash and no-flash image pairs. ACM Trans. Graph. 23, 664--672. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Rudin, L. I., Osher, S., and Fatemi, E. 1992. Nonlinear total variation based noise removal algorithms. Phys. D 60, 1-4, 259--268. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Saad, Y. 2003. Iterative Methods for Sparse Linear Systems. Society for Industrial and Applied Mathematics. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Skalicky, T. 1995. Package for solving large sparse systems of linear equations. http://www.mgnet.org/mgnet/Codes/laspack/html/laspack.html.Google ScholarGoogle Scholar
  30. Strang, G. 2003. Introduction to Linear Algebra, 3rd ed. Wellesley, Cambridge, MA.Google ScholarGoogle Scholar
  31. Sun, J., Jia, J., Tang, C.-K., and Shum, H.-Y. 2004. Poisson matting. ACM Trans. Graph. 23, 315--321. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Szeliski, R. 2006. Locally adapted hierarchical basis preconditioning. ACM Trans. Graph. 25, 1135--1143. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Tappen, M. F., Russell, B. C., and Freeman, W. T. 2001. Exploiting the sparse derivative prior for super-resolution and image demosaicing. Proceedings of the 3rd International Workshop on Statistical and Computational Theories of Vision.Google ScholarGoogle Scholar
  34. Tomasi, C. and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proceedings of the International Conference on Computer Vision (ICCV'98). IEEE Computer Society, 839. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Tumblin, J. and Turk, G. 1999. Lcis: A boundary hierarchy for detail-preserving contrast reduction. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'99). ACM Press/Addison-Wesley, New York, 83--90. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Xu, L., Qi, F., and Jiang, R. 2006. Shadow removal from a single image. In Proceedings of the 6th International Conference on Intelligent Systems Design and Applications (ISDA'06). IEEE Computer Society, 1049--1054. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Zienkiewicz, O. and Taylor, R. 2000. The Finite Element Method. Butterworth-Heinemann.Google ScholarGoogle Scholar

Index Terms

  1. Edge-based image coarsening

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Graphics
        ACM Transactions on Graphics  Volume 29, Issue 1
        December 2009
        127 pages
        ISSN:0730-0301
        EISSN:1557-7368
        DOI:10.1145/1640443
        Issue’s Table of Contents

        Copyright © 2009 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 15 December 2009
        • Accepted: 1 August 2009
        • Revised: 1 July 2009
        • Received: 1 October 2008
        Published in tog Volume 29, Issue 1

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader