Heuristic evaluation for games: usability principles for video game design

ABSTRACT

Most video games require constant interaction, so game designers must pay careful attention to usability issues. However, there are few formal methods for evaluating the usability of game interfaces. In this paper, we introduce a new set of heuristics that can be used to carry out usability inspections of video games. The heuristics were developed to help identify usability problems in both early and functional game prototypes. We developed the heuristics by analyzing PC game reviews from a popular gaming website, and the review set covered 108 different games and included 18 from each of 6 major game genres. We analyzed the reviews and identified twelve common classes of usability problems seen in games. We developed ten usability heuristics based on the problem categories, and they describe how common game usability problems can be avoided. A preliminary evaluation of the heuristics suggests that they help identify game-specific usability problems that can easily be overlooked otherwise.

REFERENCES

• 1: Annett, J. and Duncan, K.D. Task analysis and training design. Occupational Psychology 12, (1967), 211--221.
• 2: Pippin Barr , James Noble , Robert Biddle, Video game values: Human-computer interaction and games, Interacting with Computers, v.19 n.2, p.180-195, March, 2007 [doi>10.1016/j.intcom.2006.08.008]
• 3: IEEE Software Staff, Interface-Walkthroughs: Efficient Collaborative Testing, IEEE Software, v.8 n.5, p.94-95, September 1991 [doi>10.1109/52.84220]
• 4: Randolph G. Bias, The pluralistic usability walkthrough: coordinated empathies, Usability inspection methods, John Wiley & Sons, Inc., New York, NY, 1994
• 5: Chuck Clanton, An interpreted demonstration of computer game design, CHI 98 conference summary on Human factors in computing systems, p.1-2, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286499]
• 6: Gilbert Cockton , Alan Woolrych, Sale must end: should discount methods be cleared off HCI's shelves?, interactions, v.9 n.5, September 2002 [doi>10.1145/566981.566990]
• 7: Heather Desurvire , Martin Caplan , Jozsef A. Toth, Using heuristics to evaluate the playability of games, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986102]
• 8: Dulin, R. Review of Druuna: Morbus Gravis, http://www.gamespot.com/pc/adventure/druunamorbusgravis/review.html, 2002.
• 9: Dyck, J., Pinelle, D., Brown, B., and Gutwin, C. Learning from Games: HCI Design Innovations in Entertainment Software. Proceedings of Graphics Interface 2003, pp. 237--246.
• 10: Dykstra, D.J. A Comparison of Heuristic Evaluation and Usability Testing: The Efficacy of a Domain-Specific Heuristic Checklist. Ph.D. dissertation, Department of Industrial Engineering, Texas A&M University, 1993.
• 11: Entertainment Software Association, Essential Facts about the Computer and Video Game Industry 2007, http://www.theesa.com/archives/2007/07/2007_essential.php.
• 12: Federoff, M. Heuristics and Usability Guidelines for the Creation and Evaluation of Fun in Video Games. Indiana University Master of Science Thesis, 2002.
• 13: Tracy Fullerton , Christopher Swain , Steven Hoffman, Game Design Workshop: Designing, Prototyping, and Playtesting Games, CMP Books, 2004
• 14: Goble, G. Review of Rugby 2004, http://www. gamespot.com/pc/sports/rugby2004/review.html, 2003.
• 15: Robin Jeffries , James R. Miller , Cathleen Wharton , Kathy Uyeda, User interface evaluation in the real world: a comparison of four techniques, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.119-124, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108862]
• 16: Johnson, C. G., and Jones, G. J. F., Effective Affective Communication in Virtual Environments. In Daniel Ballin (editor), Second Workshop on Intelligent Virtual Agents, (1999), 135--138.
• 17: Anker Helms Jørgensen, Marrying HCI/Usability and computer games: a preliminary look, Proceedings of the third Nordic conference on Human-computer interaction, p.393-396, October 23-27, 2004, Tampere, Finland [doi>10.1145/1028014.1028078]
• 18: Claire-Marie Karat , Robert Campbell , Tarra Fiegel, Comparison of empirical testing and walkthrough methods in user interface evaluation, Proceedings of the SIGCHI conference on Human factors in computing systems, p.397-404, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142873]
• 19: Clayton Lewis , Peter G. Polson , Cathleen Wharton , John Rieman, Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.235-242, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97279]
• 20: Thomas W. Malone, Heuristics for designing enjoyable user interfaces: Lessons from computer games, Proceedings of the 1982 conference on Human factors in computing systems, p.63-68, March 15-17, 1982, Gaithersburg, Maryland, United States [doi>10.1145/800049.801756]
• 21: Mueller, G. Review of Eragon, http://www.gamespot. com/pc/action/eragon/review.html, 2006.
• 22: Mueller, G. Review of Mage Knight Apocalypse, http://www.gamespot.com/pc/rpg/mageknightapocalypse/review.html, 2006.
• 23: Jakob Nielsen, Enhancing the explanatory power of usability heuristics, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.152-158, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191729]
• 24: Jakob Nielsen , Robert L. Mack, Usability inspection methods, John Wiley & Sons, Inc., New York, NY, 1994
• 25: Nielsen, J. How to Conduct a Heuristic Evaluation. www.useit.com/papers/heuristic/heuristic_evaluation.html, 2007.
• 26: Nielsen, J. Severity Ratings for Usability Problems. http://www.useit.com/papers/heuristic/severityrating.html, 2007.
• 27: Ocampo, J. Review of Vietcong 2, http://www. gamespot.com/pc/action/vietcong2/review.html, 2005.
• 28: Parker, S. Review of Pax Romana, http://www. gamespot.com/pc/strategy/paxromana/review.html, 2004.
• 29: Peter G. Polson , Clayton Lewis , John Rieman , Cathleen Wharton, Cognitive walkthroughs: a method for theory-based evaluation of user interfaces, International Journal of Man-Machine Studies, v.36 n.5, p.741-773, May 1992 [doi>10.1016/0020-7373(92)90039-N]
• 30: Shepherd, A. Analysis and training in information technology tasks. In Task Analysis for Human-Computer Interaction, Diaper, D., Ed. Ellis Horwood, Chichester, (1989), 15--55.
• 31: Todd, B. Review of Paradise Cracked, http://www. gamespot.com/pc/rpg/paradisecracked/ review.html, 2003.
• 32: Todd, B. Review of Total Extreme Wrestling 2004, http://www.gamespot.com/pc/sports/totalextremewarfare/review.html, 2004.
• 33: Todd, B. Review of DMZ: North Korea, http://www. gamespot.com/pc/action/dmznorthkorea/review.html, 2007.
• 34: Todd, B. Review of Genesis Rising: The Universal Crusade, http://www.gamespot.com/pc/strategy/ genesisrising/review.html, 2007.
• 35: Todd, B. Review of Secrets of the Ark: A Broken Sword Game, http://www.gamespot.com/pc/adventure/ brokensword4/review.html, 2007.
• 36: Wolpaw, E. Review of Soldner: Secret Wars, http://www.gamespot.com/pc/action/soldnersecretwars/review.html, 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

General Terms:
Design, Human Factors

Keywords:
heuristic evaluation, usability evaluation, video games