Haptically augmented remote speech communication: a study of user practices and experiences

ABSTRACT

Haptic technology provides a channel for interpersonal communication through the sense of touch. In the development of novel haptic communication devices, it is essential to explore people's use behaviors and perceptions of such a communication channel. To this end, we conducted a laboratory study on haptically augmented remote interpersonal communication. Participant pairs tested a communication system that allowed them to send squeezing and thermal feedback to each other's forearm during speech discussion. We explored the use practices and user experience of this setup and compared it to traditional speech-only communication. The findings indicate that squeezing was experienced as a more versatile and immediate type of feedback than thermal feedback. Warm and cold were on the other hand useful for communicating positive and negative meanings. Compared to speech-only communication, the added haptic modality allowed conveying emphases, emotions, and touches related to the discussion, and increased the feeling of closeness between the pairs.

References

1. AttrakDiff: A Service of User Interface Design GmbH, http://www.attrakdiff.de/en/Home/. Accessed on 14.2.2012.
2. Baumann, M. A., MacLean, K. E., Hazelton, T. W. and McKay, A. Emulating Human Attention-getting Practices with Wearable Haptics. In Haptics Symposium, 2010 IEEE, (2010), 149--156
3. Bonanni, L., Vaucelle, C., Lieberman, J. and Zuckerman, O. TapTap: A Haptic Wearable for Asynchronous Distributed Touch Therapy. In Proceedings of CHI EA '06. ACM, New York, NY, USA, (2006), 580--585
4. Brown, L. M., Brewster, S. A. and Purchase, H. C. A First Investigation into the Effectiveness of Tactons. In First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, (2005), 167--176.
5. Brown, L. M. and Williamson, J. Shake2Talk: Multimodal Messaging for Interpersonal Communication. In Proceedings of the 2nd international conference on Haptic and audio interaction design (HAID'07). Springer-Verlag, Berlin, Heidelberg, (2007), 44--55.
6. Chang, A., O'Modhrain, S., Jacob, R., Gunther, E. and Hiroshi, I. ComTouch: Design of a Vibrotactile Communication Device. In Proceedings of DIS 2002. ACM, NY, (2002)
7. Gooch, D. and Watts, L. Communicating Social Presence through Thermal Hugs. In Proceedings of First Workshop on Social Interaction in Spatially Separated Environments, SISSI2010. (2010)
8. Haans, A. and Ijsselstein, W. Mediated Social Touch: A Review of Current Research and Future Directions. Virtual Reality, Vol. 9, No. 2, (2006), 149--159
9. Hassenzahl, M. The Interplay of Beauty, Goodness and Usability in Interactive Products. Human Computer Interaction, Vol. 19, Iss. 4, (2004), 319--349
10. Hassenzahl, M., Burmester, M., & Koller, F. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualitäät. (J. Ziegler & G. Szwillus, Eds.) Mensch und Computer 2006: Mensch und Computer im Strukturwandel, B. G. Teubner, (2006), 187--196.
11. Heikkinen, J., Rantala, J., Olsson, T., Raisamo, R., Lylykangas, J., Raisamo, J., Surakka, V. and Ahmaniemi, T. Enhancing Personal Communication with Spatial Haptics: Two Scenario-based Experiments on Gestural Interaction. J. Vis. Lang. Comp. Vol. 20, Iss. 5, (2009), 287--304
12. Heikkinen, J., Rantala, J., Olsson, T., Raisamo, R. and Surakka, V. Exploring the Effects of Cumulative Contextual Cues on Interpreting Vibrotactile Messages. In Proceedings of MobileHCI 2011, ACM, New York, NY, USA, (2011)
13. ISO DIS 9241-210. Ergonomics of Human System Interaction - Part 210: Human-centred Design for Interactive Systems. International Standardization Organization (ISO) (2010)
14. Jones, L. A. and Berris, M. The Psychophysics of Temperature Perception and Thermal-Interface Design. In Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS '02). IEEE Computer Society, Washington, DC, USA, (2002), 137--142.
15. Lee, W. and Lim Y-K. Thermo-message: Exploring the Potential of Heat as a Modality of Peripheral Expression. In Proceedings of CHI EA 2010, ACM, (2010)
16. Puckette, M. Pure Data: Another Integrated Computer Music Environment. In Proceedings of Second Intercollege Computer Music Concerts, Tachikawa, Japan, (1996), 37--41.
17. Rantala, J., Raisamo, R., Lylykangas, J., Ahmaniemi, T., Raisamo, J., Rantala, J., Mäkelä, K., Salminen, K. and Surakka, V. The Role of Gesture Types and Spatial Feedback in Haptic Communication. In IEEE Transactions on Haptics (2011)
18. Salminen, K., Surakka, V., Lylykangas, J., Raisamo, J., Saarinen, R., Raisamo, R., Rantala, J., and Evreinov, G. Emotional and Behavioral Responses to Haptic Stimulation. In Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, ACM, New York, NY, USA, (2008), 1555--1562.
19. Salminen, K., Surakka, V., Raisamo, J., Lylykangas, J., Pystynen, J., Raisamo, R., Mäkelä, K., and Ahmaniemi, T. Emotional Responses to Thermal Stimuli. In Proceedings of ICMI 2011, ACM, New York, NY, USA, (2011)
20. Smith, J. and MacLean, K. Communicating Emotion through a Haptic Link: Design Space and Methodology. International Journal of Human-Computer Studies, Vol. 65, Iss. 4, (2007), 376--387
21. Suhonen, K., Väänänen-Vainio-Mattila, K. and Mäkelä, K. User Experiences and Expectations of Vibrotactile, Thermal and Squeeze Feedback in Interpersonal Communication. To appear in Proceedings of HCI 2012, (2012)
22. Tan, H., Reed, C. and Durlach, N. Optimum Information Transfer Rates for Communication through Haptic and Other Sensory Modalities. IEEE Transactions on Haptics, Vol. 3 No. 2, (2010), 98--108
23. Wang, R. and Quek, F. Touch & Talk: Contextualizing Remote Touch for Affective Interaction. In Proceedings of TEI 2010, ACM, (2010), 13--20
24. Wilson, G., Halvey, M., Brewster, S. A. and Hughes, S. A. Some Like It Hot: Thermal Feedback for Mobile Devices. In Proceedings of CHI '11. ACM, New York, NY, USA, (2011), 2555--2564.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Haptic devices

  • Interaction design

    • Interaction design process and methods

      • User centered design