VR360HD: a VR360° player with enhanced haptic feedback

ABSTRACT

We present a VR360° video player with haptic feedback playback. The VR360HD application enhances VR viewing experience by triggering customized haptic effects associated with user's activities, biofeedback, network messages and customizable timeline triggers incorporated in the VR media. The app is developed in the Unity3D game engine and tested using a GearVR headset, therefore allowing users to add animations to VR gameplay and to the VR360° streams. A custom haptic plugin allows users to author and associate animated haptic effects to the triggers, and playback these effects on a custom haptic hardware, the Haptic Chair. We show that the VR360HD app creates rich tactile effects and can be easily adapted to other media types.

References

1. Begault, D. R., and Trejo, L. J. 2000. 3-D sound for virtual reality and multimedia. NASA Technical Report 20010044352.
2. Brewster, S. and Brown, L. 2004. Tactons: Structured tactile messages for non-visual information display. In Proc. of Australasian User Interfaces. 15--23.
3. Burdea, G. C. 1999. Haptic feedback for virtual reality. In Proc. of the Virtual Reality and Prototyping Workshop.
4. Cholewiak, R. W., & Collins, A. A. 2000. The generation of vibrotactile patterns on a linear array: Influences of body site, Cruz-Neira, C., Sandin, D. J., DeFanti, T. A., Kenyon, R. V. & Hart, J. C. 1992. The CAVE: Audio Visual Experience Automatic Virtual Environment, In Communications of the ACM, vol. 35(6), 1992, pp. 64--72.
5. Israr, A., & Poupyrev, I. 2011. Tactile brush: drawing on skin with a tactile grid display. In Proc. of CHI, ACM. 2019--2028.
6. Israr, A., Zhao, S., Schwalje, K., Klatzky, R., & Lehman, J. 2014. Feel effects: enriching storytelling with haptic feedback. ACM Transactions on Applied Perception. 11(3), 11. 17 pages.
7. Lindeman, R.W., Yanagida, Y., Noma, H. & Hosaka, K. 2006. Wearable vibrotactile systems for virtual contact and information display. Virtual Real. 9(2), 203--213.
8. MacLean, K. and Enriquez, M. 2003. Perceptual design of haptic icons. In Proc. of EuroHaptics, 351--363.
9. Melzer, J. E. 1997. Head-mounted displays: designing for the user. McGraw-Hill Professional.
10. Moon, T., and Kim, G. J. 2004. Design and evaluation of a wind display for virtual reality. In Proc. of VRST, ACM. 122--128.
11. Pausch, R., Snoddy, J., Taylor, R., Watson, S., & Haseltine, E. 1996. Disney's Aladdin: first steps toward storytelling in virtual reality. In Proc. of Computer graphics and interactive techniques, ACM. 193--203.
12. Schneider, O. S., Israr, A., & MacLean, K. E. 2015. Tactile Animation by Direct Manipulation of Grid Displays. In Proc. of UIST, ACM. 21--30.
13. Stone, R. J. 2001. Haptic feedback: a brief history from telepresence to virtual reality. In Haptic Human-Computer Interaction, Springer Berlin Heidelberg. S. Brewster and R. Murray-Smith, Eds. Lecture Notes in Computer Science, 1--16.
14. Sutherland, I. E. 1965. The ultimate display. In Proc. of International Fed. of Information Processing Congr., 506--508.
15. Tan, H. Z., Durlach, N. I., Reed, C. M., and Rabinowitz, W. M. 1999. Information transmission with a multifinger tactual display. Perception & Psychophysics, 61(6), 993--1008.
16. Yannier, N, Israr, A., Lehman, J. F., & Klatzky, R. L. 2015. FeelSleeve: Haptic feedback to enhance early reading. In Proc. of CHI, ACM. 1015--1024.

Index Terms

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Virtual reality

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Haptic devices