Artistic reality: fast brush stroke stylization for augmented reality

ABSTRACT

The goal of augmented reality is to provide the user with a view of the surroundings enriched by virtual objects. Practically all augmented reality systems rely on standard real-time rendering methods for displaying graphical objects. Although such conventional computer graphics algorithms are fast, they often fail to produce sufficiently realistic renderings. Therefore, virtual models can easily be distinguished from the real environment. We have recently proposed a novel approach for generating augmented reality images [4]. Our method is based on the idea of applying stylization techniques for adapting the visual realism of both the camera image and the virtual graphical objects. Since both the camera image and the virtual objects are stylized in a corresponding way, they appear very similar. Here, we present a new method for the stylization of augmented reality images. This approach generates a painterly brush stroke rendering. The resulting stylized augmented reality video frames look similar to paintings created in the pointillism style. We describe the implementation of the camera image filter and the non-photorealistic rendererfor virtual objects. These components have been newly designed or adapted for this purpose. They are fast enough for generating augmented reality images in near real-time (more than 14 frames per second).

REFERENCES

• 1: Kusuma Agusanto , Li Li , Zhu Chuangui , Ng Wan Sing, Photorealistic rendering for augmented reality using environment illumination, Proceedings of the The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, p.208, October 07-10, 2003
• 2: R. Azuma. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments, 6(4):355--385, 1997.
• 3: Jan Fischer , Dirk Bartz , Wolfgang Strasser, Reality Tooning: Fast Non-Photorealism for Augmented Video Streams, Proceedings of the Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality, p.186-187, October 05-08, 2005 [doi>10.1109/ISMAR.2005.50]
• 4: Jan Fischer , Dirk Bartz, Stylized Augmented Reality for Improved Immersion, Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality, p.195-202, 325, March 12-16, 2005 [doi>10.1109/VR.2005.71]
• 5: Paul Haeberli, Paint by numbers: abstract image representations, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.207-214, September 1990, Dallas, TX, USA
• 6: M. Haller, F. Landerl, and M. Billinghurst. More Sketchy, More AR, More Fun! In ACM SIGGRAPH Poster Session, 2005.
• 7: Barbara J. Meier, Painterly rendering for animation, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.477-484, August 1996 [doi>10.1145/237170.237288]
• 8: Thomas Strothotte , Stefan Schlechtweg, Non-photorealistic computer graphics: modeling, rendering, and animation, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2002

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Display algorithms

General Terms:
Algorithms, Human Factors

Keywords:
augmented reality, brush stroke style, non-photorealistic rendering, real-time stylization