Game Metrics for Evaluating Social In-game Behavior and Interaction in Multiplayer Games

ABSTRACT

This paper explores the potential and applicability of gameplay metrics to assess social behavior and interactions of players. As digital games are often played in social contexts, social phenomena and processes are an important part of game user research and supposed to have significant impact on the overall player experience. Gameplay metrics have been used as one method to measure player behavior, but have not been applied to detect social aspects of play yet. We present the conceptualization, application, and evaluation of three social gameplay metrics that aim at measuring social presence, cooperation, and leadership, respectively. A comparison of the metrics' data with scores of self-report measures addressing the same concepts shows high positive correlations, thus indicating reliability of the metrics.

References

1. Regina Bernhaupt (Ed.). 2010. Evaluating user experience in games: Concepts and methods. Springer, London and New York. DOI: http://dx.doi.org/10.1007/978-1-84882-963-3
2. Regina Bernhaupt. 2010. User Experience Evaluation in Entertainment. In Evaluating user experience in games, Regina Bernhaupt (Ed.). Springer, London and New York, 3--7.
3. F. Biocca, C. Harms, and J. Burgoon. 2003. Towards a More Robust Theory and Measure of Social Presence: Review and Suggested Criteria. Presence: Teleoperators and Virtual Environments 12, 5 (2003), 456--480.
4. Staffan Björk and Jussi Holopainen. 2005. Game Design Patterns for Social Interaction. In Patterns in game design, Staffan Bjork and Jussi Holopainen (Eds.). Charles River Media, Hingham, Mass.
5. Steve Bromley, Pejman Mirza-Babaei, Graham McAllister, and Jonathan Napier. 2014. Playing to win? Measuring the Correlation Between Biometric Responses and Social Interaction in Co-Located Social Gaming. In Multiplayer, Thorsten Quandt and Sonja Kröger (Eds.). Routledge studies in European communication research and education, Vol. 3. Routledge, London and New York, 172--182.
6. John Brooke. 1996. SUS: A quick and dirty usability scale. In Usability Evaluation in Industry, P. W. Jordan, B. Thomas, B. A. Weerdmeester, and A. L. McClelland (Eds.). Taylor and Francis, London.
7. John Brooke. 2013. SUS: A Retrospective. Journal of Usability Studies 8, 2 (2013), 29--40.
8. Florian Brühlmann and Gian-Marco Schmid. 2015. How to Measure the Game Experience?. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, New York, NY, 1181--1186. DOI: http://dx.doi.org/10.1145/2702613.2732831
9. Yvonne A. W. De Kort and Wijnand A. Ijsselsteijn. 2008. People, places, and play: Player Experience in a Socio-Spatial Context. Computers in Entertainment 6, 2 (2008), 1. DOI: http://dx.doi.org/10.1145/1371216.1371221
10. Yvonne A. W. De Kort, Wijnand A. Ijsselsteijn, and Karolien Poels. 2007. Digital games as social presence technology: development of the social presence in gaming questionnaire (SPGQ). In Proceedings of the 10th Annual International Workshop on Presence. 195--203.
11. Anders Drachen and Alessandro Canossa. 2011. Analyzing User Behavior in Digital Games. In Media in the Ubiquitous Era: Ambient, Social and Gaming Media, A. Lugmayr, H. Franssila, P. Näränen, O. Sotamaa, and J. Vanhala (Eds.). IGI global.
12. Anders Drachen, Magy Seif El-Nasr, and Alessandro Canossa. 2013. Game Analytics: The Basics. In Game analytics, Magy Seif El-Nasr, Anders Drachen, and Alessandro Canossa (Eds.). Springer, London and New York.
13. Nicolas Ducheneaut and Robert J. Moore. 2004. The social side of gaming. In CSCW '04 Proceedings of the 2004 ACM conference on Computer supported cooperative work, Jim Herbsleb and Gary Olson (Eds.). 360. DOI:http://dx.doi.org/10.1145/1031607.1031667
14. I. Ekman, G. Chanel, S. Jarvela, J. M. Kivikangas, M. Salminen, and N. Ravaja. 2012. Social Interaction in Games: Measuring Physiological Linkage and Social Presence. Simulation & Gaming 43, 3 (2012), 321--338. DOI:http://dx.doi.org/10.1177/1046878111422121
15. W. A. Ijsselsteijn, W. M. van Den Hoogen, C. Klimmt, Y.A.W. de Kort, C. Lindley, K. Mathiak, K. Poels, N. Ravaja, and M. Turpeinen. 2008. Measuring the experience of digital game enjoyment. In Proceedings of Measuring Behavior 2008, 6th International Conference on Methods and Techniques in Behavioral Research, A. J. Spink, M. R. Ballintijn, N. D. Bogers, F. Grieco, L.W.S. Loijens, L.P.J.J. Noldus, G. Smit, and P. H. Zimmerman (Eds.).
16. Katherine Isbister. 2010. Enabling Social Play: A Framework for Design and Evaluation. In Evaluating user experience in games, Regina Bernhaupt (Ed.). Springer, London and New York, 11--22.
17. J. Matias Kivikangas, Guillaume Chanel, Ben Cowley, Inger Ekman, Mikko Salminen, Simo Järvelä, and Niklas Ravaja. 2011. A review of the use of psychophysiological methods in game research. Journal of Gaming & Virtual Worlds 3, 3 (2011), 181--199. DOI: http://dx.doi.org/10.1386/jgvw.3.3.181{_}1
18. Petri Lankoski and Staffan Björk (Eds.). 2015. Game research methods: An overview. ETC Press, Pittsburgh.
19. Andreas Lieberoth and Andreas Roepstorff. 2015. Mixed methods in game research. In Game research methods, Petri Lankoski and Staffan Björk (Eds.). ETC Press, Pittsburgh.
20. Raphael Marczak and Gareth R. Schott. 2015. Audio visual analysis of player experience. In Game research methods, Petri Lankoski and Staffan Björk (Eds.). ETC Press, Pittsburgh.
21. Aaron May, Amber Choo, Carman Neustaedter, and Alissa Antle. 2013. A mixed-methods evaluation of nonverbal communication in collaborative video games. In Proceedings of the 2013 IEEE International Games Innovation Conference (IGIC). 169--174. DOI: http://dx.doi.org/10.1109/IGIC.2013.6659127
22. A. Imran Nordin, Alena Denisova, and Paul Cairns. 2014. Too Many Questionnaires: Measuring Player Experience Whilst Playing Digital Games. In Seventh York Doctoral Symposium on Computer Science & Electronics, Matt Luckcuck (Ed.). York, UK, 69--74.
23. Andrew K. Przybylski, C. Scott Rigby, and Richard M. Ryan. 2010. A motivational model of video game engagement. Review of General Psychology 14, 2 (2010), 154--166. DOI:http://dx.doi.org/10.1037/a0019440
24. Thorsten Quandt and Sonja Kröger (Eds.). 2014. Multiplayer: The social aspects of digital gaming. Routledge studies in European communication research and education, Vol. 3. Routledge, London and New York.
25. Niklas Ravaja, Timo Saari, Marko Turpeinen, Jari Laarni, Mikko Salminen, and Matias Kivikangas. 2006. Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play? Presence: Teleoperators and Virtual Environments 15, 4 (2006), 381--392. DOI:http://dx.doi.org/10.1162/pres.15.4.381
26. Byron Reeves and Thomas Malone. 2007. Leadership in Games and at Work: Implications for the Enterprise of Massively Multiplayer Online Role-playing Games. (2007).
27. Christian Reuter, Viktor Wendel, Stefan Göbel, and Ralf Steinmetz. 2014. Game Design Patterns for Collaborative Player Interactions. Proceedings of DiGRA 2014 (2014).
28. Richard M. Ryan, C. Scott Rigby, and Andrew Przybylski. 2006. The Motivational Pull of Video Games: A Self-Determination Theory Approach. Motivation and Emotion 30, 4 (2006), 344--360. DOI: http://dx.doi.org/10.1007/s11031-006-9051-8
29. Jari Takatalo, Jukka Häkkinen, Jyrki Kaistinen, and Göte Nyman. 2010. Presence, Involvement, and Flow in Digital Games. In Evaluating user experience in games, Regina Bernhaupt (Ed.). Springer, London and New York, 23--46. DOI:http://dx.doi.org/10.1007/978-1-84882-963-3{_}3
30. Amy Voida, Sheelagh Carpendale, and Saul Greenberg. 2010. The individual and the group in console gaming. In Proceedings of the 2010 ACM conference on Computer supported cooperative work, Kori Inkpen (Ed.). ACM, New York, NY, 371. DOI: http://dx.doi.org/10.1145/1718918.1718983
31. J. P. Zagal. 2006. Collaborative games: Lessons learned from board games. Simulation & Gaming 37, 1 (2006), 24--40. DOI:http://dx.doi.org/10.1177/1046878105282279

Index Terms

• Applied computing

  • Computers in other domains

    • Personal computers and PC applications

      • Computer games

• Information systems

  • Information systems applications

    • Multimedia information systems

      • Massively multiplayer online games

• Software and its engineering

  • Software organization and properties

    • Contextual software domains

      • Virtual worlds software

        • Interactive games