Mixed-order compositing for 3D paintings

Abstract

We present a method for rendering 3D paintings by compositing brush strokes embedded in space. The challenge in compositing 3D brush strokes is reconciling conflicts between their z-order in 3D and the order in which the strokes were painted, while maintaining temporal and spatial coherence. Our algorithm smoothly transitions between compositing closer strokes over those farther away and compositing strokes painted later over those painted earlier. It is efficient, running in O(n log n) time, and simple to implement. We demonstrate its effectiveness on a variety of 3D paintings.

References

1. Bruckner, S., Rautek, P., Viola, I., Roberts, M., Sousa, M. C., and Grller, M. E. 2010. Hybrid visibility compositing and masking for illustrative rendering. Computers and Graphics 34, 4, 361--369.
2. Daniels, E., Lappas, A., and Katanics, G. T. 2001. Method and apparatus for three-dimensional painting. US Patent 6268865.
3. Haeberli, P. E. 1990. Paint by numbers: Abstract image representations. In Computer Graphics (Proceedings of SIGGRAPH 90), 207--214.
4. Hertzmann, A. 1998. Painterly rendering with curved brush strokes of multiple sizes. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 453--460.
5. Kalnins, R. D., Markosian, L., Meier, B. J., Kowalski, M. A., Lee, J. C., Davidson, P. L., Webb, M., Hughes, J. F., and Finkelstein, A. 2002. WYSIWYG NPR: Drawing strokes directly on 3D models. ACM Transactions on Graphics 21, 3 (July), 755--762.
6. Katanics, G. T., and Lappas, A. 2003. Deep Canvas: Integrating 3D Painting and Painterly Rendering. In Theory and Practice of Non-Photorealistic Graphics: Algorithms, Methods, and Production Systems, ACM SIGGRAPH 2003 Course Notes.
7. Keefe, D. F., Feliz, D. A., Moscovich, T., Laidlaw, D. H., and LaViola, Jr., J. J. 2001. CavePainting: a fully immersive 3D artistic medium and interactive experience. In Proceedings of the 2001 symposium on Interactive 3D graphics, ACM, 85--93.
8. Litwinowicz, P. 1997. Processing images and video for an impressionist effect. In Proceedings of SIGGRAPH 97, Computer Graphics Proceedings, Annual Conference Series, 407--414.
9. Lu, J., Sander, P. V., and Finkelstein, A. 2010. Interactive painterly stylization of images, videos and 3D animations. In Proceedings of I3D 2010.
10. Luft, T., and Deussen, O. 2006. Real-time watercolor illustrations of plants using a blurred depth test. In NPAR 2006: Fourth International Symposium on Non Photorealistic Animation and Rendering, 11--20.
11. Mammen, A. 1989. Transparency and antialiasing algorithms implemented with the virtual pixel maps technique. IEEE Computer Graphics & Applications 9, 4 (July), 43--55.
12. McCann, J., and Pollard, N. 2009. Local layering. ACM Transactions on Graphics 28, 3 (July), 84:1--84:7.
13. Meier, B. J. 1996. Painterly rendering for animation. In Proceedings of SIGGRAPH 96, Computer Graphics Proceedings, Annual Conference Series, 477--484.
14. Porter, T., and Duff, T. 1984. Compositing digital images. In Computer Graphics (Proceedings of SIGGRAPH 84), 253--259.
15. Schmid, J., Senn, M. S., Gross, M., and Sumner, R. 2011. Overcoat: An implicit canvas for 3D painting. ACM Transactions on Graphics 30, 4 (July), 28:1--28:10.
16. Smith, A. R. 1995. Alpha and the history of digital compositing. In Microsoft Technical Memo #7.
17. Wallace, B. A. 1981. Merging and transformation of raster images for cartoon animation. In Computer Graphics (Proceedings of SIGGRAPH 81), 253--262.

Index Terms

• Computing methodologies

  • Computer graphics

    • Image manipulation

      • Texturing