Soft scissors: an interactive tool for realtime high quality matting

ABSTRACT

We present Soft Scissors, an interactive tool for extracting alpha mattes of foreground objects in realtime. We recently proposed a novel offline matting algorithm capable of extracting high-quality mattes for complex foreground objects such as furry animals [Wang and Cohen 2007]. In this paper we both improve the quality of our offline algorithm and give it the ability to incrementally update the matte in an online interactive setting. Our realtime system efficiently estimates foreground color thereby allowing both the matte and the final composite to be revealed instantly as the user roughly paints along the edge of the foreground object. In addition, our system can dynamically adjust the width and boundary conditions of the scissoring paint brush to approximately capture the boundary of the foreground object that lies ahead on the scissor's path. These advantages in both speed and accuracy create the first interactive tool for high quality image matting and compositing.

References

1. Chuang, Y.-Y., Curless, B., Salesin, D. H., and Szeliski, R. 2001. A bayesian approach to digital mating. In Proceedings of IEEE CVPR, 264--271.
2. CORPORATION, C. 2002. Knockout user guide.
3. Grady, L. 2006. Random walks for image segmentation. IEEE Trans. Pattern Analysis and Machine Intelligence.
4. INCORP., A. S. 2002. Adobe photoshop user guide.
5. Levin, A., Lischinski, D., and Weiss, Y. 2006. A closed from solution to natural image matting. In Proceedings of IEEE CVPR.
6. Li, Y., Sun, J., Tang, C.-K., and Shum, H.-Y. 2004. Lazy snapping. In Proceedings of ACM SIGGRAPH, 303--308.
7. Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. In Proceedings of ACM SIGGRAPH.
8. Mortensen, E., and Barrett, W. 1995. Intelligent scissors for image composition. In Proceedings of ACM SIGGRAPH.
9. Rother, C., Kolmogorov, V., and Blake, A. 2004. Grabcut -- interactive foreground extraction using iterated graph cut. In Proceedings of ACM SIGGRAPH, 309--314.
10. Sun, J., Jia, J., Tang, C.-K., and Shum, H.-Y. 2004. Poisson matting. In Proceedings of ACM SIGGRAPH, 315--321.
11. Wang, J., and Cohen, M. 2005. An iterative optimization approach for unified image segmentation and matting. In Proceedings of ICCV 2005, 936--943.
12. Wang, J., and Cohen, M. F. 2007. Optimized color sampling for robust matting. In Proceedings of IEEE CVPR.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Interest point and salient region detections

  • Computer graphics

    • Graphics systems and interfaces

    • Image manipulation

      • Texturing

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Graphics input devices

• Theory of computation

  • Design and analysis of algorithms