Stylized black and white images from photographs

ABSTRACT

Halftoning algorithms attempt to match the tone of an input image despite lower color resolution in the output. However, in some artistic media and styles, tone matching is not at all the goal; rather, details are either portrayed sharply or omitted entirely.

In this paper, we present an algorithm for abstracting arbitrary input images into black and white images. Our goal is to preserve details while as much as possible producing large regions of solid color in the output. We present two methods based on energy minimization, using loopy belief propagation and graph cuts, but it is difficult to devise a single energy term that both sufficiently promotes coherence and adequately preserves details. We next propose a third algorithm separating these two concerns. Our third algorithm involves composing a base layer, consisting of large flat-colored regions, with a detail layer, containing the small high-contrast details. The base layer is computed with energy minimization, while local adaptive thresholding gives the detail layer. The final labeling is tidied by removing small components, vectorizing, and smoothing the region boundaries. The output images satisfy our goal of high spatial coherence with detail preservation.

References

1. Bae, S., Paris, S., and Durand, F. 2006. Two-scale tone management for photographic look. ACM Trans. Graph. 25, 3, 637--645.
2. Boykov, Y., and Jolly, M.-P. 2001. Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images. In International Conference on Computer Vision, 105--112.
3. Boykov, Y., and Kolmogorov, V. 2004. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 26, 9, 1124--1137.
4. Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23, 11, 1222--1239.
5. Deussen, O., Hiller, S., van Overveld, C., and Strothotte, T. 2000. Floating points: A method for computing stipple drawings. Computer Graphics Forum 19, 3, 40--51.
6. Floyd, R. W., and Steinberg, R. 1977. An adaptive algorithm for spatial grey scale. Proceedings of the Society for Information Display 15, 75--77.
7. Gooch, B., Reinhard, E., and Gooch, A. 2004. Human facial illustrations: Creation and psychophysical evaluation. ACM Trans. Graph. 23, 1, 27--44.
8. Guptill, A. 1976. Rendering in Pen and Ink. Watson-Guptill Publications, New York.
9. Li, Y., Sun, J., Tang, C.-K., and Shum, H.-Y. 2004. Lazy snapping. In Proceedings of SIGGRAPH 2004, 303--308.
10. Lozner, R. 1990. Scratchboard for Illustration. Watson-Guptill Publications, New York.
11. Miller, F. 2005. The Hard Goodbye (Sin City, Book I). Dark Horse, Milwaukie, Oregon.
12. O'Rourke, J. 1990. Computational Geometry in C. Cambridge University Press, Cambridge.
13. Ostromoukhov, V. 1999. Digital facial engraving. Proceedings of SIGGRAPH 1999 (August), 417--424. ISBN 0-20148-560-5. Held in Los Angeles, California.
14. Rother, C., Kolmogorov, V., and Blake, A. 2004. "Grab-Cut" -- interactive foreground extraction using iterated graph cuts. In Proceedings of SIGGRAPH 2004, 309--314.
15. Salisbury, M. P., Anderson, S. E., Barzel, R., and Salesin, D. H. 1994. Interactive pen-and-ink illustration. In Proceedings of SIGGRAPH 1994, ACM Press, New York, NY, USA, 101--108.
16. Secord, A. 2002. Weighted Voronoi stippling. In NPAR '02: Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, 37--43.
17. Shapiro, L., and Stockman, G. 2001. Computer Vision. Prentice-Hall, Inc., Upper Saddle River.
18. Szeliski, R., Zabih, R., Scharstein, D., Veksler, O., Kolmogorov, V., Agarwala, A., Tappen, M. F., and Rother, C. 2006. A comparative study of energy minimization methods for Markov random fields. In Proceedings of the Ninth European Conference on Computer Vision, 16--29.
19. Veryovka, O., and Buchanan, J. 1999. Halftoning with image-based dither screens. In Proceedings of Graphics Interface '99, Canadian Human-Computer Communications Society, 167--174.
20. Weiss, Y., and Freeman, W. 2001. On the optimality of solutions of the max-product belief-propagation algorithm in arbitrary graphs. IEEETIT: IEEE Transactions on Information Theory 47.
21. Winkenbach, G., and Salesin, D. 1994. Computer-generated pen-and-ink illustration. In Proceedings of SIGGRAPH 1994, 163--170.
22. Winnemöller, H., Olsen, S. C., and Gooch, B. 2006. Realtime video abstraction. In Proceedings of SIGGRAPH 2006, ACM Press, 1221--1226.

Index Terms

• Applied computing

  • Arts and humanities

• Computing methodologies

  • Computer graphics

    • Image manipulation

    • Rendering