skip to main content
10.1145/1124772.1124866acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Article

Generating automated predictions of behavior strategically adapted to specific performance objectives

Published: 22 April 2006 Publication History

Abstract

It has been well established in Cognitive Psychology that humans are able to strategically adapt performance, even highly skilled performance, to meet explicit task goals such as being accurate (rather than fast). This paper describes a new capability for generating multiple human performance predictions from a single task specification as a function of different performance objective functions. As a demonstration of this capability, the Cognitive Constraint Modeling approach was used to develop models for several tasks across two interfaces from the aviation domain. Performance objectives are explicitly declared as part of the model, and the CORE (Constraint-based Optimal Reasoning Engine) architecture itself formally derives the detailed strategies that are maximally adapted to these objectives. The models are analyzed for emergent strategic variation, comparing those optimized for task time with those optimized for working memory load. The approach has potential application in user interface and procedure design.

References

[1]
Anderson, J.R. The Adaptive Character of Thought. Lawrence Erlbaum Associates, Hillsdale, NJ, USA (1990).
[2]
Anderson, J.R., Bothell, D., Byrne, M.D., Douglass, S., Lebiere, C., & Qin, Y . An integrated theory of the mind. Psychological Review 111, 4 (2004), 1036--1060.
[3]
Byrne, M.D. and Bovair, S. A working memory model of a common procedural error. Cognitive Science 21, 1 (1997), 31--61.
[4]
Card, S. K., Moran, T.P. and Newell, A. The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates, Hillsdale, NJ, USA (1983).
[5]
Engle, R.W. Working memory capacity as executive attention. Current Directions in Psychological Science 11, 1 (2002), 19 -- 23.
[6]
Gray, W.D. and Boehm-Davis, D. A. (2000). Milliseconds matter: An introduction to microstrategies and to their use in describing and predicting interactive behavior. Journal of Experimental Psychology: Applied, 6 (4), 322--335.
[7]
Gray, W.D., John, B.E., and Atwood, M.E. Project Ernestine: Validating GOMS for predicting and explaining real-world task performance. Human Computer Interaction 8, 3 (1993), 237--309.
[8]
Howes, A., Lewis, R.L, Vera, A.H., and Richardson, J. Information-Requirements Grammar: A theory of the structure of competence for interaction. In Proc. Of CogSci 2005, Lawrence Erlbaum Associates (2005).
[9]
Howes, A., Vera, A., Lewis, R.L., and McCurdy, M. Cognitive constraint modeling: A formal approach to reasoning about behavior. In Proc. of CogSci 2004, Lawrence Erlbaum Associates (2004).
[10]
John, B.E. and Kieras, D.E. (1996) The GOMS family of user interface analysis techniques: Comparison and Contrast. ACM Transactions on Computer-Human Interaction., 3 (4), pp. 320--351.
[11]
John, B.E., Prevas, K., Salvucci, D.D., and Koedinger, K. Predictive Human Performance Modeling Made Easy. In Proc. of CHI 2004, ACM Press (2004).
[12]
John, B.E., Vera, A.H., and Newell, A. Toward real-time GOMS: A model of expert behavior in a highly interactive task. Behavior and Information Technology 13, 4 (1994).
[13]
Kane, M.J. and Engle, R.W. Working-memory capacity and the control of attention: The contributions of goal neglect, response competition, and task set to Stroop interference. Journal of Experimental Psychology 132, 1 (2003), 47--70.
[14]
Kieras, D.E. and Meyer, D.E. Predicting human performance on dual-task tracking and decision making with computational models using the EPIC architecture. International Symposium on Command and Control Research and Technology. National Defense University, Washington D.C. (1995).
[15]
Kieras, D.E. and Meyer, D.E. A computational theory of executive cognitive processes and multiple-task performance. Psychological Review 104, 1 (1997), 3--65.
[16]
Lewis, R.L., Newell, A., and Polk, T. Toward a Soar theory of taking instructions for immediate reasoning tasks. In Proc. of CogSci 1989, 514--521.
[17]
Lewis, R.L., Vera, A.H., and Howes, A. A constraint-based approach to understanding the composition of skill. In Proc. of ICCM 2004.
[18]
Models of Working Memory: Mechanisms of Active Maintenance and Executive Control. Akira Miyake and Priti Shah (eds). Cambridge University Press, New York, NY, USA, 1999.
[19]
Newell, A. (1990). Unified Theories of Cognition. Harvard University Press. Cambridge, Massachusetts
[20]
Ritter, F.E., Van Rooy, D., and St. Amant, R.A. User modeling design tool based on a cognitive architecture for comparing interfaces. In Proc. of the International Conference on Computer-Aided Design of User Interfaces 2002, 111--118.
[21]
Schumacher, E.H. Seymour, T.L., Glass, J.M., Fencsik, D.E., Lauber, E.J., Kieras, D.E., and Meyer, D.E. Virtually perfect time sharing in dual-task performance: Uncorking the central cognitive bottleneck. Psychological Science 12, 2 (2001), 101--108.
[22]
Simon, H.A., & Hayes, J.R. (1976). Understanding complex task instructions. In D. Klahr (Ed.), Cognition and instruction (Chap. 14). Hillsdale, NJ: Erlbaum.
[23]
Taatgen, N.A. Modeling parallelization and flexibility improvements in skill acquisition: from dual tasks to complex dynamic skills. Cognitive Science (2005), 421--455.
[24]
Tollinger, I., Lewis, R., McCurdy, M., Tollinger, P. Vera, A., Howes, A., Pelton, L. Supporting efficient development of cognitive models at multiple skill levels: Exploring recent advances in constraint-based modeling. In Proc. of CHI 2005, ACM Press (2005).
[25]
Vera, A.H., Howes, A., McCurdy, M., and Lewis, R.L. A constraint satisfaction approach to predicting skilled interactive cognition. In Proc. of CHI 2004, ACM Press (2004).
[26]
Vera, A.H., Tollinger, I., Eng, K., Lewis, R., and Howes, A. Architectural building blocks as the locus of adaptive behavior. In Proc. Of CogSci 2005, Lawrence Erlbaum Associates (2005).
[27]
Wickens, C. D., Seidler, K. S. Information access in a dual-task context: testing a model of optimal strategy selection. Jounal of Experimental Psychology: Applied 3, 3 (1997), 196--215.

Cited By

View all

Index Terms

  1. Generating automated predictions of behavior strategically adapted to specific performance objectives

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
    April 2006
    1353 pages
    ISBN:1595933727
    DOI:10.1145/1124772
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 April 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. interface evaluation
    2. user modeling

    Qualifiers

    • Article

    Conference

    CHI06
    Sponsor:
    CHI06: CHI 2006 Conference on Human Factors in Computing Systems
    April 22 - 27, 2006
    Québec, Montréal, Canada

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)10
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 19 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2017)Games for Psychological ScienceTopics in Cognitive Science10.1111/tops.122669:2(533-536)Online publication date: 28-Apr-2017
    • (2017)User ModelingThe Wiley Handbook of Human Computer Interaction10.1002/9781118976005.ch8(143-169)Online publication date: 28-Dec-2017
    • (2016)Towards standardisation of user models for simulation and adaptation purposesUniversal Access in the Information Society10.1007/s10209-014-0371-215:1(21-48)Online publication date: 1-Mar-2016
    • (2015)The adaptation of visual search to utility, ecology and designInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2015.03.00580:C(45-55)Online publication date: 1-Aug-2015
    • (2014)A Brief Survey on User Modelling in Human Computer InteractionAssistive Technologies10.4018/978-1-4666-4422-9.ch006(102-119)Online publication date: 2014
    • (2013)Adaptive Interaction: A Utility Maximization Approach to Understanding Human Interaction with TechnologySynthesis Lectures on Human-Centered Informatics10.2200/S00479ED1V01Y201302HCI0166:1(1-111)Online publication date: 15-Mar-2013
    • (2013)Linking context to evaluation in the design of safety critical interfacesProceedings of the 15th international conference on Human-Computer Interaction: human-centred design approaches, methods, tools, and environments - Volume Part I10.1007/978-3-642-39232-0_22(193-202)Online publication date: 21-Jul-2013
    • (2013)An Interoperable and Inclusive User Modeling Concept for Simulation and AdaptationA Multimodal End-2-End Approach to Accessible Computing10.1007/978-1-4471-5082-4_10(195-236)Online publication date: 27-Mar-2013
    • (2012)A Brief Survey on User Modelling in Human Computer InteractionSpeech, Image, and Language Processing for Human Computer Interaction10.4018/978-1-4666-0954-9.ch001(1-19)Online publication date: 2012
    • (2012)Designing Inclusive Interfaces Through User Modeling and SimulationInternational Journal of Human-Computer Interaction10.1080/10447318.2011.56571828:1(1-33)Online publication date: Jan-2012
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media