Bonnie E. John
Abstract
Since the seminal book, The Psychology of Human-Computer Interaction, the GOMS model has been one of the few widely known theoretical concepts in human-computer interaction. This concept has spawned much research to verify and extend the original work and has been used in real-world design and evaluation situations. This article synthesizes the previous work on GOMS to provide an integrated view of GOMS models and how they can be used in design. We briefly describe the major variants of GOMS that have matured sufficiently to be used in actual design. We then provide guidance to practitioners about which GOMS variant to use for different design situations. Finally, we present examples of the application of GOMS to practical design problems and then summarize the lessons learned.
- ATWOOD,M.E.,GRAY,W.D.,AND JOHN, B. E. 1996. Project Ernestine: Analytic and empirical methods applied to a real-world CHI problem. In Human-Computer Interface Design: Success Stories, Emerging Methods and Real-World Context, M. Rudisill, C. Lewis, P. B., Polson, and T. D. McKay, Eds. Morgan Kaufmann, San Mateo, Calif. Google Scholar
- BEARD,D.V.,SMITH,D.K.,AND DENELSBECK, K. M. 1996. Quick and dirty GOMS: A case study of computed tomography interpretation. Hum. Comput. Interact. 11, 2, 157-180. Google Scholar
- BYRNE,M.D.,WOOD,S.D.,SUKAVIRIYA, P., FOLEY,J.D.,AND KIERAS, D. E. 1994. Auto-mating interface evaluation. In Human Factors in Computer Systems, CHI '94. ACM, New York, 232-237. Google Scholar
- CARD,S.AND MORAN, T. 1988. User technology: From pointing to pondering. In A History of Personal Workstations, A. Goldberg, Ed. ACM, New York, 489-522. Google Scholar
- CARD,S.K.,MORAN,T.P.,AND NEWELL, A. 1980. The keystroke-level model for user performance time with interactive systems. Commun. ACM 23, 7 (July), 396-410. Google Scholar
- CARD,S.K.,MORAN,T.P.,AND NEWELL, A. 1983. The Psychology of Human-Computer Interaction. Lawrence Erlbaum, Hillsdale, N.J. Google Scholar
- CARLEY,K.M.AND PRIETULA, M. J. 1994. Computational Organization Theory. Lawrence Erlbaum, Hillsdale, N.J. Google Scholar
- CHUAH,M.C.,JOHN,B.E.,AND PANE, J. 1994. Analyzing graphic and textual layouts with GOMS: Results of a preliminary analysis. In Proceedings Companion of CHI '94. ACM, New York, 323-324. Google Scholar
- DIAPER, D., Ed. 1989. Task Analysis for Human-Computer Interaction. Ellis Horwood, Chichester, U.K. Google Scholar
- DILLON, A., SWEENEY, M., AND MAGUIRE, M. 1993. A survey of usability engineering within the European IT industry:Current practice and needs. In People and Computers, Proceed-ings of HCI 93, J. L. Alty, D. Diaper, and S. Guest Eds. Cambridge University Press, Cambridge, Mass., 81-94.Google Scholar
- ELKERTON, J. 1993. Using GOMS models to design documentation and user interfaces: An uneasy courtship. In Proceedings of INTERCHI'93. Position paper for workshop on human-computer interaction advances derived from real world experiences. ACM, New York.Google Scholar
- ELKERTON,J.AND PALMITER, S. L. 1991. Designing help using a GOMS model: An informa-tion retrieval evaluation. Hum. Factors 33, 2, 185-204. Google Scholar
- ENDESTAD,T.AND MEYER, P. 1993. GOMS analysis as an evaluation tool in process control: An evaluation of the ISACS-1 prototype and the COPMA system. Tech. Rep. HWR-349, OECD Halden Reactor Project, Inst. for Energiteknikk, Halden, Norway.Google Scholar
- GILBRETH,F.B.AND GILBRETH, L. M. 1917. Applied Motion Study. The MacMillan Company, New York.Google Scholar
- GONG, R. 1993. Validating and refining the GOMS model methodology for software user interface design and evaluation. Ph.D. dissertation, Univ. of Michigan, Ann Arbor, Mich. Google Scholar
- GONG,R.AND ELKERTON, J. 1990. Designing minimal documentation using a GOMS model: A usability evaluation of an engineering approach. In Human Factors in Computer Systems, CHI '90. ACM, New York, 99-106. Google Scholar
- GONG,R.AND KIERAS, D. 1994. A validation of the GOMS model methodology in the development of a specialized, commercial software application. In Human Factors in Computer Systems, CHI '94. ACM, New York, 351-357. Google Scholar
- GOTT, S. P. 1988. Apprenticeship instruction for real-world tasks: The coordination of procedures, mental models, and strategies. In Review of Research in Education, Ernst Z. Rothkopf, Ed. AERA, Washington, D. C.Google Scholar
- GRAY,W.D.AND SALZMAN, M. C. 1996. Damaged merchandise? A review of experiments that compare usability evaluation methods. Unpublished report, Dept. of Psychology, George Mason Univ., Fairfax, Va. Google Scholar
- GRAY,W.D.,JOHN,B.E.,AND ATWOOD, M. E. 1993. Project Ernestine: A validation of GOMS for prediction and explanation of real-world task performance. Hum. Comput. Interact. 8, 3, 237-209.Google Scholar
- JOHN, B. E. 1990. Extensions of GOMS analyses to expert performance requiring perception of dynamic visual and auditory information. In Human Factors in Computer Systems, CHI '90. ACM, New York, 107-115. Google Scholar
- JOHN, B. E. 1994. Toward a deeper comparison of methods: A reaction to Nielsen and Phillips and new data. In the Proceedings Companion of CHI '94. ACM, New York, 285-286. Google Scholar
- JOHN, B. E. 1995. Why GOMS? interactions 2, 4, 80-89. Google Scholar
- JOHN,B.E.AND GRAY, W. D. 1995. GOMS analyses for parallel activities. In Human Factors in Computer Systems, CHI '95. ACM, New York. Google Scholar
- JOHN,B.E.AND KIERAS, D. E. 1996. The GOMS family of analysis techniques: Comparison and contrast. ACM Trans. Comput. Hum. Interact. 3, 4 (Dec.), 320-351. This issue. Google Scholar
- JOHN,B.E.AND VERA, A. H. 1992. A GOMS analysis for a graphic, machine-paced, highly interactive task. In Human Factors in Computer Systems, CHI '92. ACM, New York, 251-258. Google Scholar
- JOHN,B.E.,VERA,A.H.,AND NEWELL, A. 1994. Toward real-time GOMS: A model of expert behavior in a highly interactive task. Behav. Inf. Tech. 13, 4, 255-267.Google Scholar
- JONG, H.-S. 1991. The subgoal structure as a cognitive control mechanism in a human-computer interaction framework. Ph.D. dissertation, The Univ. of Michigan, Ann Arbor, Mich. Google Scholar
- KARAT,J.AND BENNETT, J. 1991. Modeling the user interaction methods imposed by designs. In Mental Models and Human-Computer Interaction, M. Tauber and D. Ackermann Eds. Vol. 2. Elsevier, Amsterdam.Google Scholar
- KARAT, J., BOYES, L., WEISGERBER, S., AND SCHAFER, C. 1986. Transfer between word processing systems. In Human Factors in Computer Systems, CHI '86. ACM, New York, 67-71. Google Scholar
- KIERAS, D. E. 1988. Towards a practical GOMS model methodology for user interface design. In The Handbook of Human-Computer Interaction, M. Helander, Ed. North-Holland, Amsterdam, 135-158.Google Scholar
- KIERAS, D. E. 1994. GOMS modeling of user interfaces using NGOMSL. In Human Factors in Computer Systems, CHI '94. ACM, New York. Google Scholar
- KIERAS, D. E. 1996a. Guide to GOMS model usability evaluation using NGOMSL. In The Handbook of Human-Computer Interaction, M. Helander and T. Landauer Eds. 2nd ed. North-Holland, Amsterdam.Google Scholar
- KIERAS, D. E. 1996b. Task analysis and the design of functionality. In Handbook of Computer Science and Engineering, T. Allen, Ed. CRC Press, Boca Raton, Fla.Google Scholar
- KIERAS,D.E.AND POLSON, P. G. 1985. An approach to the formal analysis of user complexity. Int. J. Man-Machine Stud. 22, 365-394.Google Scholar
- KIERAS,D.E.,WOOD,S.D.,ABOTEL,K.AND HORNOF, A. 1995. GLEAN: A computer-based tool for rapid GOMS model usability evaluation of user interface designs. In UIST'95 Proceedings. ACM, New York. Google Scholar
- KIRWAN,B.AND AINSWORTH, L. K. 1992. A Guide to Task Analysis. Taylor and Francis, London.Google Scholar
- LANDAUER, T. K. 1995. The Trouble with Computers: Usefulness, Usability, and Productiv-ity. MIT Press, Cambridge, Mass. Google Scholar
- LEE,A.Y.,POLSON,P.G.,AND BAILEY, W. A. 1989. Learning and transfer of measurement tasks. In Human Factors in Computer Systems, CHI '89. ACM, New York, 115-120. Google Scholar
- LERCH,F.J.,MANTEI,M.M.,AND OLSON, J. R. 1989. Translating ideas into action: Cognitive analysis of errors in spreadsheet formulas. In Human Factors in Computer Systems, CHI '89. ACM, New York, 121-126. Google Scholar
- LEWIS,C.AND RIEMAN, J. 1994. Task-Centered User Interface Design: A Practical Introduc-tion. Shareware book available at ftp.cs.colorado.edu/pub/cs/distribs/clewis/HCI-Design-Book.Google Scholar
- LOHSE, G. L. 1993. A cognitive model for understanding graphical perception. Hum. Com-put. Interact. 8, 4, 353-388.Google Scholar
- MONKIEWICZ, J. 1992. CAD's next-generation user interface. Comput. Aided Eng. (Nov.), 55-56.Google Scholar
- NESBITT, K., GORTON, D., AND RANTANEN, J. 1994. A case study of GOMS analysis: Extension of user interfaces. Tech. Rep. BHPR/ETR/R/94/048, BHP Research-Newcastle Laboratories, Australia.Google Scholar
- NEWELL,A.AND SIMON, H. A. 1972. Human Problem Solving. Prentice-Hall, Englewood Cliffs, N.J. Google Scholar
- NIELSEN,J.AND MACK, R. L., Eds. 1994. Usability Inspection Methods. John Wiley and Sons, New York. Google Scholar
- NIELSEN,J.AND PHILLIPS, V. L. 1993. Estimating the relative usability of two interfaces: Heuristic, formal, and empirical methods compared. In Proceedings of INTERCHI '93. ACM, New York, 214-221. Google Scholar
- NILSEN, E., JONG, H., OLSON,J.S.,AND POLSON, P. G. 1992. Method engineering: From data to model to practice. In Human Factors in Computer Systems, CHI '92. ACM, New York, 313-319. Google Scholar
- NORMAN, D. A. 1983. Design rules based on analyses of human error. Commun. ACM 26, 4 (Apr.), 254-258. Google Scholar
- OBERG, E., JONES,F.D.,AND HORTON, H. L. 1978. Machinery's Handbook: A Reference Book for the Mechanical Engineer, Draftsman, Toolmaker and Machinist. 20th ed. Industrial Press, New York.Google Scholar
- OLSON,J.S.AND MORAN, T. P. 1996. Mapping the method muddle: Guidance in using methods for user interface design. In Human-Computer Interface Design: Success Stories, Emerging Methods and Real-World Context, M. Rudisill, C. Lewis, P. B., Polson, and T. D. McKay, Eds. Morgan Kaufmann, San Mateo, Calif. Google Scholar
- OLSON,J.R.AND OLSON, G. M. 1990. The growth of cognitive modeling in human-computer interaction since GOMS. Hum. Comput. Interact. 5, 221-265.Google Scholar
- PECK,V.A.AND JOHN, B. E. 1992. Browser-Soar: A cognitive model of a highly interactive task. In Human Factors in Computer Systems, CHI '92. ACM, New York, 165-172. Google Scholar
- REASON, J. 1990. Human Error. Cambridge University Press, Cambridge, Mass.Google Scholar
- RIEMAN, J., LEWIS, C., YOUNG,R.M.,AND POLSON, P. G. 1994. "Why is a Raven like a writing desk?" Lessons in interface consistency and analogical reasoning from two cognitive archi-tectures. In Human Factors in Computer Systems, CHI '94. ACM, New York, 438-444. Google Scholar
- SMELCER, J. B. 1989. Understanding user errors in database query. Ph.D. dissertation, The Univ. of Michigan, Ann Arbor, Mich. Google Scholar
- STEINBERG,L.S.AND GITOMER, D. H. 1993. Cognitive task analysis, interface design, and technical troubleshooting. In Proceedings of the 1993 International Workshop on Intelligent User Interfaces, W. D. Gray, W. E. Hefley, and D. Murray, Eds. ACM, New York, 185-191. Google Scholar
- VAN COTT,H.P.AND KINKADE, R. G. 1972. Human Engineering Guide to Equipment Design, Rev. ed. American Institutes for Research, Washington, D.C.Google Scholar
- VERA,A.H.AND ROSENBLATT, J. K. 1995. Developing user model-based intelligent agents. In Proceedings of the 17th Annual Conference of the Cognitive Science Society, J. D. Moore and J. F. Lehman, Eds. Lawrence Erlbaum, Hillsdale, N.J., 500-505.Google Scholar
- WHARTON, C., RIEMAN, J., LEWIS, C., AND POLSON, P. 1994. The Cognitive Walkthrough Method: A practitioner's guide. In Usability Inspection Methods, J. Nielsen and R. L. Mack, Eds. John Wiley and Sons, New York. Google Scholar
- WOOD, S. 1993. Issues in the Implementation of a GOMS-Model Design Tool. Unpublished report, Univ. of Michigan, Ann Arbor, Mich.Google Scholar
Index Terms
- Using GOMS for user interface design and evaluation: which technique?
Recommendations
The GOMS family of user interface analysis techniques: comparison and contrast
Sine the publication of The Psychology of Human-Computer Interaction, the GOMS model has been one of the most widely known theoretical concepts in HCI. This concept has produced severval GOMS analysis techniques that differ in appearance and form, ...
The GOMS SIG: troubleshooting, lessons learned, novel applications, teaching techniques & future research
CHI EA '00: CHI '00 Extended Abstracts on Human Factors in Computing SystemsGOMS is many things to many people, It is the only validated analytic usability evaluation method (UEM) in the field of human-computer interaction. It is being used by practitioners at some of the world's largest and some of the smallest software ...
The GOMS SIG: troubleshooting, lessons learned, novel applications, teaching techniques, & future research
CHI EA '99: CHI '99 Extended Abstracts on Human Factors in Computing SystemsGOMS is many things to many people. It is the only validated analytic usability evaluation method (UEM) in the field of human-computer interaction. It is being used by practitioners at some of the world's largest and some of the smallest software ...
Reviews
Jaroslav Pokorny
In this paper, the well-known goals, operations, methods, and selection rules (GOMS ) model [1] is considered. The authors try to use HCI cognitive modeling in real-world design and evaluation tasks and provide guidance to practitioners on how to select a GOMS variant for these purposes. In the introduction, the role of engineering models of HCI is explained. The authors emphasize that GOMS models are usefully approximate, make a priori predictions, cover a range of behavior involved in many HCI tasks, and have been proven to be learnable and usable for computer system designers. The rest of the introduction is devoted to an overview of the GOMS concept. GOMS is a way to analyze the knowledge of how to perform a task in terms of goals, operators, methods, and selection rules. Section 2 focuses on applying GOMS techniques to a design. The authors discuss GOMS methods in detail, considering the type of task the user will be engaged in and the types of information gained by applying the method. Then they examine a few of the common uses of the information provided by GOMS models, such as the time to learn and use GOMS, profiling, comparing alternative designs, sensitivity and parametric analysis, and documentation and online help systems. Section 3 provides a number of example applications of GOMS analysis in real-world system design. These cases illustrate the wide applicability of GOMS models for the design and evaluation of interfaces for different kinds of systems. In their summary and conclusions, the authors formulate hypotheses about the usefulness of GOMS techniques to designers. The paper offers an interesting alternative approach to a design area where a particular task was solved, usually in an intuitive way. The paper is clear and understandable. It provides guidance for the use of GOMS in practice.
Access critical reviews of Computing literature here
Become a reviewer for Computing Reviews.
Comments