Physiological indicators for the evaluation of co-located collaborative play

ABSTRACT

Emerging technologies offer new ways of using entertainment technology to foster interactions between players and connect people. Evaluating collaborative entertainment technology is challenging because success is not defined in terms of productivity and performance, but in terms of enjoyment and interaction. Current subjective methods are not sufficiently robust in this context. This paper describes an experiment designed to test the efficacy of physiological measures as evaluators of collaborative entertainment technologies. We found evidence that there is a different physiological response in the body when playing against a computer versus playing against a friend. These physiological results are mirrored in the subjective reports provided by the participants. We provide an initial step towards using physiological responses to objectively evaluate a user's experience with collaborative entertainment technology.

REFERENCES

• 1: Björk, S., Falk, J., Hansson, R., and Ljungstrand, P. (2001). Pirates! Using the Physical World as a Game Board. In Proceedings of Interact 2001. Tokyo, Japan.
• 2: Staffan Björk , Jussi Holopainen , Peter Ljungstrand , Regan Mandryk, Special Issue on Ubiquitous Games, Personal and Ubiquitous Computing, v.6 n.5-6, p.358-361, December 2002 [doi>10.1007/s007790200040]
• 3: Boucsein, W., (1992). Electrodermal Activity. The Plenum Series in Behavioral Psychophysiology and Medicine, ed. W.J. Ray New York: Plenum Press.
• 4: Cacioppo, J.T., Berntson, G.G., Larsen, J.T., Poehlmann, K.M., and Ito, T.A., (2000). The Psychophysiology of Emotion, in Handbook of Emotions, J.M. Haviland-Jones, Editor. The Guilford Press: New York.
• 5: Cacioppo, J.T. and Tassinary, L.G. (1990). Inferring Psychological Significance From Physiological Signals. American Psychologist, 45(1): p. 16--28.
• 6: Arman Danesh , Kori Inkpen , Felix Lau , Keith Shu , Kellogg Booth, GeneyTM: designing a collaborative activity for the palmTM handheld computer, Proceedings of the SIGCHI conference on Human factors in computing systems, p.388-395, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365303]
• 7: Ekman, P., (1999). Basic Emotions, in Handbook of Cognition and Emotion, T. Dalgleish and M. Power, Editors. John Wiley & Sons, Ltd.: Sussex.
• 8: Ekman, P., Levenson, R.W., and Friesen, W.V. (1983). Autonomic Nervous System Activity Distinguishes among Emotions. Science, 221(4616): p. 1208--1210.
• 9: Carolanne Fisher , Penelope Sanderson, Exploratory sequential data analysis: exploring continuous observational data, interactions, v.3 n.2, p.25-34, March 1996 [doi>10.1145/227181.227185]
• 10: Holmquist, L.E., Falk, J., and Wigström, J. (1999). Supporting Group Collaboration with Inter-Personal Awareness Devices. Journal of Personal Technologies, 3(1--2).
• 11: Kori Inkpen , Kellogg S. Booth , Maria Klawe , Rena Upitis, Playing together beats playing apart, especially for girls, The first international conference on Computer support for collaborative learning, p.177-181, October 1995, Indiana Univ., Bloomington, Indiana, United States
• 12: Lang, P.J. (1995). The Emotion Probe. American Psychologist, 50(5): p. 372--385.
• 13: Levenson, R.W. (1992). Autonomic Nervous System Differences Among Emotions. American Psychological Society, 3(1): p. 23--27.
• 14: Magerkurth, C., Stenzel, R., and Prante, T. (2003). STARS - A Ubiquitous Computing Platform for Computer Augmented Tabletop Games. In Proceedings of Video Track of Ubiquitous Computing (UBICOMP'03). Seattle, Washington, USA.
• 15: Regan L. Mandryk , Kori M. Inkpen , Mark Bilezikjian , Scott R. Klemmer , James A. Landay, Supporting children's collaboration across handheld computers, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634219]
• 16: Regan L. Mandryk , Diego S. Maranan, False prophets: exploring hybrid board/video games, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506523]
• 17: Marshall, C. and Rossman, G.B., (1999). Designing Qualitative Research. (3rd ed.) Thousand Oaks: Sage.
• 18: Jakob Nielsen, Evaluating the thinking-aloud technique for use by computer scientists, Advances in human-computer interaction (vol. 3), Ablex Publishing Corp., Norwood, NJ, 1993
• 19: Don Norman, Emotion & design: attractive things work better, interactions, v.9 n.4, p.36-42, July 2002 [doi>10.1145/543434.543435]
• 20: Papillo, J.F. and Shapiro, D., (1990). The Cardiovascular System, in Principles of Psychophysiology: Physical, Social, and Inferential Elements, L.G. Tassinary, Editor. Cambridge University Press: Cambridge. p. 456--512.
• 21: Partala, T. and Surakka, V. (2004). The effects of affective interventions in human-computer interaction. Interacting with Computers, 16: p. 295--309.
• 22: Rosalind W. Picard, Affective computing, MIT Press, Cambridge, MA, 1997
• 23: Pramila Rani , Jared Sims , Robert Brackin , Nilanjan Sarkar, Online stress detection using psychophysiological signals for implicit human-robot cooperation, Robotica, v.20 n.6, p.673-685, November 2002 [doi>10.1017/S0263574702004484]
• 24: Dennis W. Rowe , John Sibert , Don Irwin, Heart rate variability: indicator of user state as an aid to human-computer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.480-487, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274709]
• 25: Russell, J.A., Weiss, A., and Mendelsohn, G.A. (1989). Affect Grid: A Single-Item Scale of Pleasure and Arousal. Journal of Personality and Social Psychology, 57(3): p. 493--502.
• 26: Scheirer, J., Fernandez, R., Klein, J., and Picard, R. (2002). Frustrating the User on Purpose: A Step Toward Building an Affective Computer. Interacting with Computers, 14(2): p. 93--118.
• 27: Scott, S.D., Mandryk, R.L., and Inkpen, K.M. (2003). Understanding Children's Collaborative Interactions in Shared Environments. Journal of Computer Assisted Learning, 19(2): p. 220--228.
• 28: Stern, R.M., Ray, W.J., and Quigley, K.S., (2001). Psychophysiological Recording. (2nd ed.) New York: Oxford University Press.
• 29: Jonathan Sykes , Simon Brown, Affective gaming: measuring emotion through the gamepad, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.765957]
• 30: Kim J. Vicente , D. Craig Thornton , Neville Moray, Spectral analysis of sinus arrhythmia: a measure of mental effort, Human Factors, v.29 n.2, p.171-182, April 1987
• 31: R. D. Ward , P. H. Marsden, Physiological responses to different WEB page designs, International Journal of Human-Computer Studies, v.59 n.1-2, p.199-212, July 2003 [doi>10.1016/S1071-5819(03)00019-3]
• 32: Ward, R.D., Marsden, P.H., Cahill, B., and Johnson, C. (2002). Physiological Responses to Well-Designed and Poorly Designed Interfaces. In Proceedings of CHI 2002 Workshop on Physiological Computing. Minneapolis, MN, USA.
• 33: Wastell, D.G. and Newman, M. (1996). Stress, control and computer system design: a psychophysiological field study. Behaviour and Information Technology, 15(3): p. 183--192.
• 34: Gillian M. Wilson, Psychophysiological indicators of the impact of media quality on users, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634125]
• 35: Wilson, G.M. and Sasse, M.A. (2000). Do Users Always Know What's Good For Them? Utilizing Physiological Responses to Assess Media Quality. In Proceedings of HCI 2000: People and Computers XIV - Usability or Else! Sunderland, UK.: Springer. p. 327--339.
• 36: Wilson, G.M. and Sasse, M.A. (2000). Investigating the Impact of Audio Degradations on Users: Subjective vs. Objective Assessment Methods. In Proceedings of OZCHI 2000: Interfacing Reality in the New Millennium. Sydney, Australia. p. 135--142.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Collaborative computing; Evaluation/methodology

General Terms:
Experimentation, Human Factors

Keywords:
EMG, GSR, collaboration, fun, heart rate, physiology