skip to main content
10.1145/985692.985750acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Article

Predictive human performance modeling made easy

Published:25 April 2004Publication History

ABSTRACT

Although engineering models of user behavior have enjoyed a rich history in HCI, they have yet to have a widespread impact due to the complexities of the modeling process. In this paper we describe a development system in which designers generate predictive cognitive models of user behavior simply by demonstrating tasks on HTML mock-ups of new interfaces. Keystroke-Level Models are produced automatically using new rules for placing mental operators, then implemented in the ACT-R cognitive architecture. They interact with the mock-up through integrated perceptual and motor modules, generating behavior that is automatically quantified and easily examined. Using a query-entry user interface as an example [19], we demonstrate that this new system enables more rapid development of predictive models, with more accurate results, than previously published models of these tasks.

References

  1. Anderson, J. R., and Lebiere, C. The Atomic Components of Thought. Lawrence Erlbaum Associates, Hillsdale, NJ, USA, 1998.Google ScholarGoogle Scholar
  2. Baumeister, L., John, B. E. and Byrne, M. A Comparison of Tools for Building GOMS Models. CHI 2000, ACM Conference on Human Factors in Computing Systems, CHI Letters 2(1), 502--509. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Beard, David V., Smith, Dana K. and Denelsbeck, Kevin M. Quick and Dirty GOMS: A Case Study of Computed Tomography, Human-Computer Interaction 11, 2 (1996), 157--180. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Byrne, M. D. ACT-R/PM and menu selection: Applying a cognitive architecture to HCI. International Journal of Human-Computer Studies, 55 (2001), 41--84.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Byrne, M. D., Wood, S. D., Sukaviriya, P. N., Foley, J. D. and Kieras, D. Automating Interface Evaluation, Proceedings of CHI 1994, ACM Press (1994), 232--237. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Card, S. K., Moran, T.P. and Newell, A. The keystroke-level model for user performance time with interactive systems. Communications of the ACM 23, 7 (1980), 396--410. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Card, S. K., Moran, T.P. and Newell, A. The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates, Hillsdale, NJ, USA (1983). Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Dix, A., Finlay, J., Abowd, G., and Beale, R. Human-Computer Interaction (2nd ed.) Prentice Hall Europe, London, UK, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Gray, W. D., John, B. E., and Atwood, M. E. Project Ernestine: A validation of GOMS for prediction and explanation of real-world task performance. Human-Computer Interaction, 8 (1993), 237--309.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Hudson, S. E., John, B. E., Knudsen, K., and Byrne, M. D. A tool for creating predictive performance models from user interface demonstrations. UIST'99: Proceedings of the ACM Symposium on User Interface Software and Technology, CHI Letters 1(1), 93--102. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Hudson, S., and Stasko, J. Animation Support in User Interface Toolkits: Flexible, Robust, and Reusable Abstractions. Proceedings of the ACM Symposium on User Interface Software and Technology, ACM Press (1995), 57--67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. John, B. E. Toward a deeper comparison of methods: A reaction to Nielsen and Phillips and new data. Proceedings Companion of CHI 1994, ACM Press (1994), 285--286. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. John, B. E. TYPIST: A Theory of Performance In Skilled Typing. Human-Computer Interaction 11, 4 (1996), 321--355. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. John, B. E., and Kieras, D. E. Using GOMS for user interface design and evaluation: Which technique? ACM Transactions on Computer-Human Interaction 3, 4 (1996), 287--319. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. John, B., Vera, A., Matessa, M., Freed, M., and Remington, R. Automating CPM-GOMS. CHI 2002, ACM Conference on Human Factors in Computing Systems, CHI Letters 4(1), 147--154. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Kieras, D. E., Wood, S. D., Abotel, K., and Hornof, A. GLEAN: A Computer-Based Tool for Rapid GOMS Model Usability Evaluation of User Interface. Proceedings of the ACM Symposium on User Interface Software and Technology, ACM Press (1995), 91--100 Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Koedinger, K. R., Aleven, V., and Heffernan, N. Toward a rapid development environment for Cognitive Tutors. Artificial Intelligence in Education: Shaping the Future of Learning through Intelligent Technologies, Proceedings of AI-ED 2003, IOS Press (2003), 455--457.Google ScholarGoogle Scholar
  18. Lane, D. M., Napier, H. A., Batsell, R. R. and Naman, J. Predicting the skilled use of hierarchical menus with the keystroke-level model. Human-Computer Interaction 8, 2 (1993), 185--192.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Nielsen, J., and Phillips, V. A. Estimating the relative usability of two interfaces: heuristic, formal, and empirical methods compared. Proceedings of CHI 1993, ACM Press (1993), 214--221. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S., and Carey, T. Human-Computer Interaction. Addison Wesley, Wonkingham, UK, 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Raskin, J. The Humane Interface. Addison Wesley, Boston, MA, USA, 2000Google ScholarGoogle Scholar
  22. Salvucci, D. D., and Lee, F. J. Simple cognitive modeling in a complex cognitive architecture. CHI 2003, ACM Conference on Human Factors in Computing Systems, CHI Letters 5(1), 265--272. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Shneiderman, B. Designing the User Interface (3rd ed.). Addison Wesley, Reading, MA, USA, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Williams, K. E. Automating the cognitive task modeling process: An extension to GOMS for HCI. Proceedings of the Fifth International Conference on Human-Computer Interaction Poster Sessions: Abridged Proceedings, 3 (1993), 182.Google ScholarGoogle Scholar

Index Terms

  1. Predictive human performance modeling made easy

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
      April 2004
      742 pages
      ISBN:1581137028
      DOI:10.1145/985692

      Copyright © 2004 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 25 April 2004

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • Article

      Acceptance Rates

      Overall Acceptance Rate6,199of26,314submissions,24%

      Upcoming Conference

      CHI '24
      CHI Conference on Human Factors in Computing Systems
      May 11 - 16, 2024
      Honolulu , HI , USA

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader