A comparison of tools for building GOMS models

ABSTRACT

We compare three tools for creating GOMS models, QGOMS [2), CATHCI (17) and GLEAN3 [12], along several dimensions. We examine the representation and available constructs in each tool, the qualitative and quantitative design information provided, the support for building cognitively plausible models, and pragmatics about using each tool (e.g., how easy it is to modify a model). While each tool has its strengths, they all leave something to be desired as a practical UI design tool.

REFERENCES

• 1: Anderson, J. R. (1993). Rules of the mind. Hillsdale, NJ: Lawrence Erlbaum Associates.Lawrence.
• 2: Beard, David V., Smith, Dana K. & Denelsbeck, Kevin M. (1996). "Quick and Dirty GOMS: A Case Study of Computed Tomography", Human-Computer Interaction, 11 (2), 157-180.
• 3: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 4: Scott E. Hudson , Bonnie E. John , Keith Knudsen , Michael D. Byrne, A tool for creating predictive performance models from user interface demonstrations, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.93-102, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322590]
• 5: Bonnie John, Why GOMS?, interactions, v.2 n.4, p.80-89, Oct. 1995 [doi>10.1145/225362.225374]
• 6: Bonnie E. John, Toward a deeper comparison of methods: a reaction to Nielsen & Phillips and new data, Conference companion on Human factors in computing systems, p.285-286, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/259963.260495]
• 7: Bonnie E. John , David E. Kieras, The GOMS family of user interface analysis techniques: comparison and contrast, ACM Transactions on Computer-Human Interaction (TOCHI), v.3 n.4, p.320-351, Dec. 1996 [doi>10.1145/235833.236054]
• 8: Bonnie E. John , David E. Kieras, Using GOMS for user interface design and evaluation: which technique?, ACM Transactions on Computer-Human Interaction (TOCHI), v.3 n.4, p.287-319, Dec. 1996 [doi>10.1145/235833.236050]
• 9: Virginia A. Peck , Bonnie E. John, Browser-Soar: a computational model of a highly interactive task, Proceedings of the SIGCHI conference on Human factors in computing systems, p.165-172, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142782]
• 10: Kieras, D. E. (1988). Towards a practical GOMS model methodology for user interface design. In M. Helander (Ed.), The handbook of human-computer interaction. (pp. 135-158). Amsterdam: North-Holland.
• 11: David E. Kieras , Scott D. Wood , David E. Meyer, Predictive engineering models based on the EPIC architecture for a multimodal high-performance human-computer interaction task, ACM Transactions on Computer-Human Interaction (TOCHI), v.4 n.3, p.230-275, Sept. 1997 [doi>10.1145/264645.264658]
• 12: David E. Kieras , Scott D. Wood , Kasem Abotel , Anthony Hornof, GLEAN: a computer-based tool for rapid GOMS model usability evaluation of user interface designs, Proceedings of the 8th annual ACM symposium on User interface and software technology, p.91-100, November 15-17, 1995, Pittsburgh, Pennsylvania, United States [doi>10.1145/215585.215700]
• 13: Kirwan, B., & Ainsworth, L. K. (1992). A Guide to Task Analysis. London: Taylor and Francis.
• 14: Thomas K. Landauer, The trouble with computers, MIT Press, Cambridge, MA, 1995
• 15: Lewis, C. & Rieman, J. (1994). Task-centered User Interface Design: A Practical lintroduction. Shareware book at ftp.cs.colorado.edu/pub/cs/distribs/clewis/HCI- Design-Book.
• 16: Pew, R. W., & Mavor, A. S. (1998)i Modeling human and organizational behavior: Application to military simulations. Washington, DC" National Academy Press.
• 17: Williams, K. E. (1993) Automating the cognitive task modeling process: An extension to GOMS for HCI. In Proceedings of the Fifth International Conference on Human-Computer Interaction Poster Sessions: Abridged Proceedings (vol 3. p. 182).

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES

  I. Computing Methodologies
  I.6 SIMULATION AND MODELING

General Terms:
Design, Human Factors, Management, Measurement, Performance, Theory

Keywords:
GOMS, tool support for evaluation