Elastylus: flexible haptic painting stylus

ABSTRACT

Recently, the use of digital styluses is challenged by air painting applications such as Painter Freestyle [Sutton 2013], Ethereal for Photoshop (http://drivenpixels.com/ethereal), and Fantasia Painter (https://apps.leapmotion.com/apps/fantasia-painter/windows). By utilizing the hand tracking capability of Leap Motion controller, these applications show that painting in the air using hands movement is much more flexible in artistic improvisation due to high degrees of freedom (DoFs) to control virtual brushes. Nevertheless, air painting is still premature to eliminate styluses because it lacks of some important features of modern digitizers, including 1) the tight overlap of operating and displaying planes to achieve WYSIWYG, 2) the natural analogy of physical painting brush to lower the learning curve, and 3) the possibility of complex haptic feedbacks from the canvas for intuitive fine control of brush strokes. Moreover, without holding a stylus and touching the canvas, its difficult to control brush movement accurately and steadily, which may lead to unexpected stroke jittering.

References

1. Kamuro, S., Minamizawa, K., Kawakami, N., and Tachi, S. 2009. Pen de touch. In SIGGRAPH'09: Posters, ACM, 51.
2. Kohli, L., Whitton, M. C., and Brooks, F. P. 2012. Redirected touching: The effect of warping space on task performance. In 3D User Interfaces (3DUI), 2012 IEEE Symposium on, IEEE, 105--112.
3. Kohli, L. 2013. Warping virtual space for low-cost haptic feedback. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, ACM, 195--195.
4. Lee, J., and Ishii, H. 2010. Beyond: collapsible tools and gestures for computational design. In CHI'10 Extended Abstracts on Human Factors in Computing Systems, ACM, 3931--3936.
5. Long, B., Seah, S. A., Carter, T., and Subramanian, S. 2014. Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Transactions on Graphics (TOG) 33, 6, 181.
6. Monnai, Y., Hasegawa, K., Fujiwara, M., Yoshino, K., Inoue, S., and Shinoda, H. 2014. Haptomime: Mid-air haptic interaction with a floating virtual screen. In Proceedings of the 27th annual ACM symposium on User interface software and technology, ACM, 663--667.
7. Nagasaka, S., Uranishi, Y., Yoshimoto, S., Imura, M., and Oshiro, O. 2014. Haptylus: haptic stylus for interaction with virtual objects behind a touch screen. In SIGGRAPH Asia 2014 Emerging Technologies, ACM, 9.
8. Pfeiffer, M., Schneegass, S., Alt, F., and Rohs, M. 2014. Let me grab this: A comparison of ems and vibration for haptic feedback in free-hand interaction. In Proceedings of the 5th Augmented Human International Conference, ACM, 48.
9. Sodhi, R., Poupyrev, I., Glisson, M., and Israr, A. 2013. Aireal: interactive tactile experiences in free air. ACM Transactions on Graphics (TOG) 32, 4, 134.
10. Sutton, J. 2013. Air painting with corel painter freestyle and the leap motion controller: a revolutionary new way to paint! In ACM SIGGRAPH 2013 Studio Talks, ACM, 21.
11. Suzuki, Y., and Kobayashi, M. 2005. Air jet driven force feedback in virtual reality. Computer Graphics and Applications, IEEE 25, 1, 44--47.
12. Wilson, G., Carter, T., Subramanian, S., and Brewster, S. A. 2014. Perception of ultrasonic haptic feedback on the hand: Localisation and apparent motion. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems, ACM, 1133--1142.
13. Withana, A., Kondo, M., Makino, Y., Kakehi, G., Sugimoto, M., and Inami, M. 2010. Impact: Immersive haptic stylus to enable direct touch and manipulation for surface computing. Computers in Entertainment (CIE) 8, 2, 9.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Image and video acquisition

        • 3D imaging

  • Computer graphics

    • Animation

    • Graphics systems and interfaces

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Graphics input devices

      • Haptic devices