ABSTRACT
Although engineering models of user behavior have enjoyed a rich history in HCI, they have yet to have a widespread impact due to the complexities of the modeling process. In this paper we describe a development system in which designers generate predictive cognitive models of user behavior simply by demonstrating tasks on HTML mock-ups of new interfaces. Keystroke-Level Models are produced automatically using new rules for placing mental operators, then implemented in the ACT-R cognitive architecture. They interact with the mock-up through integrated perceptual and motor modules, generating behavior that is automatically quantified and easily examined. Using a query-entry user interface as an example [19], we demonstrate that this new system enables more rapid development of predictive models, with more accurate results, than previously published models of these tasks.
- Anderson, J. R., and Lebiere, C. The Atomic Components of Thought. Lawrence Erlbaum Associates, Hillsdale, NJ, USA, 1998.Google Scholar
- Baumeister, L., John, B. E. and Byrne, M. A Comparison of Tools for Building GOMS Models. CHI 2000, ACM Conference on Human Factors in Computing Systems, CHI Letters 2(1), 502--509. Google ScholarDigital Library
- Beard, David V., Smith, Dana K. and Denelsbeck, Kevin M. Quick and Dirty GOMS: A Case Study of Computed Tomography, Human-Computer Interaction 11, 2 (1996), 157--180. Google ScholarDigital Library
- Byrne, M. D. ACT-R/PM and menu selection: Applying a cognitive architecture to HCI. International Journal of Human-Computer Studies, 55 (2001), 41--84.Google ScholarDigital Library
- Byrne, M. D., Wood, S. D., Sukaviriya, P. N., Foley, J. D. and Kieras, D. Automating Interface Evaluation, Proceedings of CHI 1994, ACM Press (1994), 232--237. Google ScholarDigital Library
- Card, S. K., Moran, T.P. and Newell, A. The keystroke-level model for user performance time with interactive systems. Communications of the ACM 23, 7 (1980), 396--410. Google ScholarDigital Library
- Card, S. K., Moran, T.P. and Newell, A. The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates, Hillsdale, NJ, USA (1983). Google ScholarDigital Library
- Dix, A., Finlay, J., Abowd, G., and Beale, R. Human-Computer Interaction (2nd ed.) Prentice Hall Europe, London, UK, 1998. Google ScholarDigital Library
- Gray, W. D., John, B. E., and Atwood, M. E. Project Ernestine: A validation of GOMS for prediction and explanation of real-world task performance. Human-Computer Interaction, 8 (1993), 237--309.Google ScholarDigital Library
- Hudson, S. E., John, B. E., Knudsen, K., and Byrne, M. D. A tool for creating predictive performance models from user interface demonstrations. UIST'99: Proceedings of the ACM Symposium on User Interface Software and Technology, CHI Letters 1(1), 93--102. Google ScholarDigital Library
- Hudson, S., and Stasko, J. Animation Support in User Interface Toolkits: Flexible, Robust, and Reusable Abstractions. Proceedings of the ACM Symposium on User Interface Software and Technology, ACM Press (1995), 57--67. Google ScholarDigital Library
- John, B. E. Toward a deeper comparison of methods: A reaction to Nielsen and Phillips and new data. Proceedings Companion of CHI 1994, ACM Press (1994), 285--286. Google ScholarDigital Library
- John, B. E. TYPIST: A Theory of Performance In Skilled Typing. Human-Computer Interaction 11, 4 (1996), 321--355. Google ScholarDigital Library
- John, B. E., and Kieras, D. E. Using GOMS for user interface design and evaluation: Which technique? ACM Transactions on Computer-Human Interaction 3, 4 (1996), 287--319. Google ScholarDigital Library
- John, B., Vera, A., Matessa, M., Freed, M., and Remington, R. Automating CPM-GOMS. CHI 2002, ACM Conference on Human Factors in Computing Systems, CHI Letters 4(1), 147--154. Google ScholarDigital Library
- Kieras, D. E., Wood, S. D., Abotel, K., and Hornof, A. GLEAN: A Computer-Based Tool for Rapid GOMS Model Usability Evaluation of User Interface. Proceedings of the ACM Symposium on User Interface Software and Technology, ACM Press (1995), 91--100 Google ScholarDigital Library
- Koedinger, K. R., Aleven, V., and Heffernan, N. Toward a rapid development environment for Cognitive Tutors. Artificial Intelligence in Education: Shaping the Future of Learning through Intelligent Technologies, Proceedings of AI-ED 2003, IOS Press (2003), 455--457.Google Scholar
- Lane, D. M., Napier, H. A., Batsell, R. R. and Naman, J. Predicting the skilled use of hierarchical menus with the keystroke-level model. Human-Computer Interaction 8, 2 (1993), 185--192.Google ScholarDigital Library
- Nielsen, J., and Phillips, V. A. Estimating the relative usability of two interfaces: heuristic, formal, and empirical methods compared. Proceedings of CHI 1993, ACM Press (1993), 214--221. Google ScholarDigital Library
- Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S., and Carey, T. Human-Computer Interaction. Addison Wesley, Wonkingham, UK, 1994. Google ScholarDigital Library
- Raskin, J. The Humane Interface. Addison Wesley, Boston, MA, USA, 2000Google Scholar
- Salvucci, D. D., and Lee, F. J. Simple cognitive modeling in a complex cognitive architecture. CHI 2003, ACM Conference on Human Factors in Computing Systems, CHI Letters 5(1), 265--272. Google ScholarDigital Library
- Shneiderman, B. Designing the User Interface (3rd ed.). Addison Wesley, Reading, MA, USA, 1998. Google ScholarDigital Library
- Williams, K. E. Automating the cognitive task modeling process: An extension to GOMS for HCI. Proceedings of the Fifth International Conference on Human-Computer Interaction Poster Sessions: Abridged Proceedings, 3 (1993), 182.Google Scholar
Index Terms
Predictive human performance modeling made easy
Recommendations
The GOMS family of user interface analysis techniques: comparison and contrast
Sine the publication of The Psychology of Human-Computer Interaction, the GOMS model has been one of the most widely known theoretical concepts in HCI. This concept has produced severval GOMS analysis techniques that differ in appearance and form, ...
Using GOMS for user interface design and evaluation: which technique?
Since the seminal book, The Psychology of Human-Computer Interaction, the GOMS model has been one of the few widely known theoretical concepts in human-computer interaction. This concept has spawned much research to verify and extend the original work ...
Toward Cognitive Modeling for Predicting Usability
Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New TrendsHistorically, predictive human performance modeling has been successful at predicting the task execution time of skilled users on a desktop computer. More recent work has predicted novice behavior in web searches. This paper reports on a collaborative ...
Comments