End-user training methods: what we know, need to know

ABSTRACT

End-User Training (EUT) has enjoyed a rich tradition of research in Information Systems. However, with the growing pace of change in technology and the dynamic nature of business, organizations are spending an increasing amount of money on end-user training. Training methods are also changing with little research to support new approaches. Thus, extensive research is required in the future. To be credible, end-user training research should preserve and build upon the significant literature that exists, both in IS and Education. This paper provides a review of EUT literature focusing on training methods. It summarizes the findings, while pointing out key future research issues.

REFERENCES

• 1: Maryam Alavi , Dorothy E. Leidner, Research Commentary: Technology-Mediated Learning--A Call for Greater Depth and Breadth of Research, Information Systems Research, v.12 n.1, p.1-10, March 2001 [doi>10.1287/isre.12.1.1.9720]
• 2: Maryam Alavi , Bradley C. Wheeler , Joseph S. Valacich, Using IT to reengineer business education: an exploratory investigation of collaborative telelearning, MIS Quarterly, v.19 n.3, p.293-312, Sept. 1995 [doi>10.2307/249597]
• 3: Anderson, J.R. Cognitive psychology and its implications. W.H. Freeman, New York, 1990.
• 4: Anderson, L.W. and Sosniak, L.A. Bloom's taxonomy : a forty-year retrospective. NSSE : Distributed by the University of Chicago Press, Chicago, 1994.
• 5: Arthur, W., Bennett, W., Edens, P.S. and Bell, S.T. Effectiveness of Training in Organizations: A Meta-Analysis of Design and Evaluation Features. Journal of Applied Psychology, 88 (2). 234--245.
• 6: Ausubel, D.P. Educational psychology; a cognitive view. Holt Rinehart and Winston, New York, 1968.
• 7: Bandura, A. Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review (84). pp. 191--215.
• 8: Bandura, A. SOCIAL COGNITIVE THEORY: An Agentic Perspective. Annual Review of Psychology, 52 (1). 1--26.
• 9: Bandura, A. Social foundations of thought and action : a social cognitive theory. Prentice-Hall, Englewood Cliffs, N.J., 1986.
• 10: Bloom, B.S. Taxonomy of educational objectives : the classification of educational goals. Longman, New York, 1984.
• 11: George A. Bohlen , Thomas W. Ferratt, End user training: an experimental comparison of lecture versus computer-based training, Journal of End User Computing, v.9 n.3, p.14-27, summer 1997
• 12: Bolt, M.A., Killough, L.N. and Koh, H.C. Testing the interaction effects of task complexity in computer training using the social cognitive model. Decision Sciences, 32 (1). 1--20.
• 13: Bostrom, R.P. and Heinen, J.S. MIS Problems and Failures: A Socio-Technical Perspective. Part 1: The Causes. MIS Quarterly, 1 (3). 17--32.
• 14: Robert P. Bostrom , Lorne Olfman , Maung K. Sein, The importance of learning style in end-user training, MIS Quarterly, v.14 n.1, p.101-119, March 1990 [doi>10.2307/249313]
• 15: Bowman, B.J., Grupe, F.H. and Simkin, M.G. Teaching end-user applications with computer-based training: Theory and an empirical investigation. Journal of End User Computing, 7 (2). 12--18.
• 16: Brown, H.G., Poole, M.S. and Rodgers, T.L. Interpersonal Traits, Complementarity, and Trust in Virtual Collaboration. Journal of Management Information Systems, 20 (4). 115--138.
• 17: Carroll, J.M. Toward minimalist training: Supporting the sense-making activities of computer users. in Quiänones, M.A. and Ehrenstein, A. eds. Training for a rapidly changing workplace: applications of psychological research, American Psychological Association, Washington, DC, 1997.
• 18: Chi, M.T.H., Leeuw, N.D., Chiu, M.-H. and Lavancher, C. Eliciting self-explanations improves understanding. Cognitive Science, 18 (3). 439--477.
• 19: Compeau, D., Gravill, J., Haggerty, N. and Kelley, H. Computer self-efficacy: A review. in Galletta, D. and Zhang, P. eds. Human-Computer Interaction in Management Information Systems, M. E. Sharpe, Inc, 2005, 1--87.
• 20: Compeau, D.R. and Higgins, C.A. Application of Social Cognitive Theory to Training for Computer Skills. Information Systems Research, 6 (2). 118--143.
• 21: Deborah Compeau , Lorne Olfman , Maung Sei , Jane Webster, End-user training and learning, Communications of the ACM, v.38 n.7, p.24-26, July 1995 [doi>10.1145/213859.214791]
• 22: Tony Coulson , Conrad Shayo , Lorne Olfman , C. E. Tapie Rohm, ERP training strategies: conceptual training and the formation of accurate mental models, Proceedings of the 2003 SIGMIS conference on Computer personnel research: Freedom in Philadelphia--leveraging differences and diversity in the IT workforce, April 10-12, 2003, Philadelphia, Pennsylvania [doi>10.1145/761849.761864]
• 23: Davis, F.D. and Yi, M.Y. Improving Computer Skill Training: Behavior Modeling, Symbolic Mental Rehearsal, and the Role of Knowledge Structures. Journal of Applied Psychology, 89 (3). 509--523.
• 24: Davis, S.A. and Bostrom, R.P. The effects of an intrinsically motivating instructional environment on software learning and acceptance. Information Systems Journal, 4 (3). 3--26.
• 25: Davis, S.A. and Bostrom, R.P. Training end users: An experimental investigation of the roles of the computer interface and training methods. MIS Quarterly, 17 (1). 61--85.
• 26: Desai, M.S. A Field Experiment: Instructor-Based Training vs. Computer-Based Training. Journal of Instructional Psychology, 27 (4). 239--244.
• 27: DeSanctis, G. and Poole, M.S. Capturing the Complexity in Advanced Technology Use - Adaptive Structuration Theory. Organization Science, 5 (2). 121--147.
• 28: DeSousa, R.M.D. and Goodhue, D.L., Understanding exploratory use of ERP systems. in Americas Conference on Information Systems, (Tampa, FL, 2003).
• 29: Dossett, D.L. and Hulvershorn, P. Increasing technical training efficiency: Peer training via computer assisted instruction. Journal of Applied Psychology, 68. 552--558.
• 30: Fjermestad, J., Hiltz, S.R. and Zhang, Y. Effectiveness for Students: Comparisons of "In-Seat" and ALN Cources. in Hiltz, S.R. and Goldman, R. eds. Learning together online : research on asynchronous learning networks, Lawrence Erlbaum Associates, Mahwah, N.J., 2005, 39--80.
• 31: Fulk, J. Social construction of communication technology. Academy of Management Journal, 36 (5). 921--950.
• 32: Gartner. Predicts 2005: Support Improves for Knowledge Workers, Gartner, 2004, 7.
• 33: Garud, R. On the distinction between know-how, know-why and know-what in technological systems. in Walsh, J.P. and Huff, A.S. eds. Advances in Strategic Management, JAI Press, Greenwich, Conn, 1997, 81--101.
• 34: Gist, M.E. The influence of training method and trainee age on acquisition of computer skills. Personnel Psychology, 41 (2). 255--265.
• 35: Gist, M.E., Schwoerer, C. and Rosen, B. Effects of Alternative Training Methods on Self-Efficacy and Performance in Computer Software Training. Journal of Applied Psychology, 74 (6). 884--891.
• 36: Gupta, S. Longitudinal Investigation of Collaborative e-Learning in an End User Training Context MIS department, University of Georgia, Athens, GA, 2006.
• 37: Gupta, S. and Bostrom, R.P. Collaborative E-Learning: An Integrative Research Model. Information Systems Research, Under review.
• 38: Gupta, S. and Bostrom, R.P., Collaborative e-learning: Information systems research directions. in Americas Conference on Information Systems, (New York, NY, 2004), 3031--3039.
• 39: Igbaria, M., Guimaraes, T. and Davis, G.B. Testing the determinants of microcomputer usage via a structural equation model. Journal of Management Information Systems, 11 (4). 87.
• 40: Johnson, D.W. and Johnson, R.T. Learning together and alone: cooperation, competition, and individualization. Prentice-Hall, Englewood Cliffs, N.J., 1975.
• 41: Johnson, D.W., Johnson, R.T. and Smith, K.A. Cooperative learning: increasing college faculty instructional productivity. School of Education and Human Development The George Washington University, Washington, D.C., 1991.
• 42: Richard D. Johnson , George M. Marakas, Research Report: The Role of Behavioral Modeling in Computer Skills Acquisition: Toward Refinement of the Model, Information Systems Research, v.11 n.4, p.402-417, December 2000 [doi>10.1287/isre.11.4.402.11869]
• 43: Jonassen, D.H. and Reeves, T.C. Learning with Technology: Using Computers as Cognitive Tools. in Jonassen, D.H. ed. Handbook of research for educational communications and technology: a project of the Association for Educational Communications and Technology, L. Erlbaum Associates, Mahwah, N.J., 2001, 693--719.
• 44: Kang, D. and Santhanam, R. A longitudinal field study of training practices in a collaborative application environment. Journal of Management Information Systems, 20 (3). 257--281.
• 45: Keeler, C. and Anson, R. An assessment of cooperative learning used for basic computer skills instruction in the college classroom. Journal of Educational Computing Research, 12 (4). 379--393.
• 46: Ann Kovalchick , Kara Dawson, Education And Technology: An Encyclopedia, ABC-CLIO, 2003
• 47: Kulik, J.A. and Kulik, C.L.C. An Analysis of the Research on Ability Grouping: Historical and Contemporary Perspectives. National Research Center on the Gifted and Talented, Storrs, CT, 1991.
• 48: Kulik, J.A. and Kulik, C.L.C. Effects of ability grouping on student achievement. Equity & Excellence in Education, 23. 22--30.
• 49: LaFasto, F.M.J. and Larson, C.E. When teams work best: 6,000 team members and leaders tell what it takes to succeed. Sage Publications, Thousand Oaks, Calif., 2001.
• 50: Lehtinen, E., Hakkarainen, K., Lipponen, L., Rahikainen, M. and Muukkonen, H. Computer supported collaborative learning: A review, 2003.
• 51: Longmire, W. A Primer on Learning Objects Learning Circuits, 2000.
• 52: Lou, Y., Abrami, P.C. and d'Apollonia, S. Small group and individual learning with technology: A meta-analysis. Review of Educational Research, 71 (3). 449--521.
• 53: Lou, Y., Abrami, P.C., Spence, J.C., Poulsen, C., Chanbers, B. and d'Apollonia, S. Within-class grouping: A meta-analysis. Review of Educational Research, 66 (4). 423--458.
• 54: Mao, J.-Y. and Brown, B.R. The Effectiveness of Online Task Support vs. Instructor-Led Training. Journal of Organizational and End User Computing, 17 (3). 27--46.
• 55: Martocchio, J.J. and Webster, J. Effects of feedback and cognitive playfulness on performance in microcomputer software training. Personnel Psychology, 45 (3). 553--578.
• 56: Masie, E. TechLearn 2004, 2004.
• 57: Mayer, R.E. Can Advance Organizers Influence Meaningful Learning. Review of Educational Research, 49 (2). 371--383.
• 58: Richard E. Mayer, The Psychology of How Novices Learn Computer Programming, ACM Computing Surveys (CSUR), v.13 n.1, p.121-141, March 1981 [doi>10.1145/356835.356841]
• 59: Maynard, D.C. and Hakel, M.D. Effects of objective and subjective task complexity on performance. Human Performance, 10 (4). 303--330.
• 60: Malcolm C. Munro , Sid L. Huff , Barbara L. Marcolin , Deborah R. Compeau, Understanding and measuring user competence, Information and Management, v.33 n.1, p.45-57, Nov. 7, 1997 [doi>10.1016/S0378-7206(97)00035-9 ]
• 61: Satish Nambisan , Ritu Agarwal , Mohan Tanniru, Organizational mechanisms for enhancing user innovation in information technology, MIS Quarterly, v.23 n.3, p.365-395, Sept. 1999 [doi>10.2307/249468]
• 62: Ocker, R.J. and Yaverbaum, G.J. Asynchronous Computer-mediated Communication versus Face-to-face Collaboration: Results on Student Learning, Quality and Satisfaction. Group Decision and Negotiation, 8 (5). 427--440.
• 63: Okada, T. and Simon, H.A. Collaborative discovery in a scientific domain. Cognitive Science, 21 (2). 109--146.
• 64: Olfman, L. and Bostrom, R.P. End-user software training: An experimental comparison of methods to enhance motivation. Journal of Information Systems, 1. 249--266.
• 65: Lorne Olfman , Robert P. Bostrom , Maung K. Sein, A best-practice based model for information technology learning strategy formulation, Proceedings of the 2003 SIGMIS conference on Computer personnel research: Freedom in Philadelphia--leveraging differences and diversity in the IT workforce, April 10-12, 2003, Philadelphia, Pennsylvania [doi>10.1145/761849.761863]
• 66: Olfman, L., Bostrom, R.P. and Sein, M.K. Developing training strategies with an HCI perspective. in Galletta, D.F. and Zhang, P. eds. Human-Computer Interaction in Management Information Systems,, M. E. Sharpe, Inc, 2005.
• 67: Lorne Olfman , Munir Mandviwalla, Conceptual versus procedural software training for graphical user interfaces: a longitudinal field experiment, MIS Quarterly, v.18 n.4, p.405-426, Dec. 1994 [doi>10.2307/249522]
• 68: Olfman, L. and Pitsatron, P. End-user training research: Status and models for the future. in Zmud, R.W. ed. Framing the domains of IT management : projecting the future-- through the past, Pinnaflex Education Resources Inc., Cincinnati, Ohio, 2000, 129--146.
• 69: Orlikowski, W.J. The Duality of Technology: Rethinking the Concept of Technology in Organizations. Organization Science, 3 (3). 398--427.
• 70: Piccoli, G., Ahmad, R. and Ives, B. Web-based Virtual learning environments: A research framework and a Preliminary assessment of effectiveness of basic IT skills training. MIS Quarterly, 25 (4). 401--426.
• 71: Rohrbeck, C.A., Ginsburg-Block, M.D., Fantuzzo, J.W. and Miller, T.R. Peer-Assisted Learning Interventions With Elementary School Students: A Meta-Analytic Review. Journal of Educational Psychology, 95 (2). 240--257.
• 72: Ross, S.M. Increasing the Meaningfulness of Quantitative Material by Adapting Context to Student Background. Journal of Educational Psychology, 75 (4). 519--529.
• 73: Salomon, G., Perkins, D.N. and Globerson, T. Partners in Cognition: Extending Human Intelligence with Intelligent Technologies. Educational Researcher, 20 (3). 2--9.
• 74: Sanchez, R. Managing articulated knowledge in competence-based competition. in Sanchez, R. and Heene, A. eds. Strategic learning and knowledge management, Wiley, New York, 1997, 163--187.
• 75: Santhanam, R. and Sein, M.K. Improving End-user Proficiency: Effects of Conceptual Training and Nature of Interaction. Information Systems Research, 5 (4). 378--399.
• 76: Sasidharan, S. and Santhanam, R. Technology-Based Training: Toward A Learner Centric Research Agenda. in Zang, P. and Galletta, D.F. eds. Human-Computer Interaction and Management Information Systems, M. E. Sharpe, 2006.
• 77: Schunk, D.H. Learning theories: an educational perspective. Pearson/Merrill/Prentice Hall, Upper Saddle River, N.J., 2004.
• 78: Sein, M.K. and Bostrom, R.P. Individual differences and conceptual models in training novice users. Human Computer Interaction, 4 (3). 197--229.
• 79: Maung K. Sein , Robert P. Bostrom , Lorne Olfman, Rethinking end-user training strategy: applying a hierarchical knowledge-level model, Journal of End User Computing, v.11 n.1, p.32-39, Jan./March 1999
• 80: Maung K. Sein , Radhika Santhanam, Research Report. Learning From Goal-Directed Error Recovery Strategy, Information Systems Research, v.10 n.3, p.276-285, March 1999
• 81: Shayo, C. and Olfman, L. The Learning Objects Economy: What Remains to be Done? in Zang, P. and Galletta, D.F. eds. Human-Computer Interaction and Management Information Systems: Applications, M. E. Sharpe, 2006.
• 82: Conrad Shayo , Lorne Olfman, The role of training in preparing end users to learn related software, Journal of End User Computing, v.12 n.1, p.3-14, Jan.1.2000
• 83: Simon, S.J. and Werner, J.M. Computer Training Through Behavior Modeling, Self-Paced, and Instructional Approaches:: A Field Experiment. Journal of Applied Psychology, 81 (6). 648--659.
• 84: Sketch, E. Ford's Drive Toward Quality Education Chief Learning Officer, 2003.
• 85: Skinner, B.F. Science and human behavior. Macmillan, New York,, 1953.
• 86: Slavin, R.E. Cooperative learning : student teams. National Education Asso., Washington, D.C., 1987.
• 87: Jan-Willem Strijbos , Paul A. Kirschner , Rob L. Martens , Pierre Dillenbourg, What we know about CSCL and implementing it in higher education, Kluwer Academic Publishers, Norwell, MA, 2004
• 88: Sun, H. and Zang, P. The Role of Affect in Information Systems Research: A Critical Survey and A Research Model. in Galletta, D.F. and Zhang, P. eds. Human-Computer Interaction in Management Information Systems,, M. E. Sharpe, Inc, 2005.
• 89: Training-magazine. Industry report, 2004, 20--36.
• 90: Webb, N.M. Peer interaction and learning in cooperative small groups. Journal of Educational Psychology, 74. 642--655.
• 91: Mun Y. Yi , Fred D. Davis, Developing and Validating an Observational Learning Model of Computer Software Training and Skill Acquisition, Information Systems Research, v.14 n.2, p.146-169, June 2003 [doi>10.1287/isre.14.2.146.16016]
• 92: Yi, M.Y. and Davis, F.D. Improving computer training effectiveness for decision technologies: Behavior modeling and retention enhancement. Decision Sciences, 32 (3). 521--544.
• 93: Dongsong Zhang , J. Leon Zhao , Lina Zhou , Jay F. Nunamaker, Jr., Can e-learning replace classroom learning?, Communications of the ACM, v.47 n.5, p.75-79, May 2004 [doi>10.1145/986213.986216]

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.1 ADMINISTRATIVE DATA PROCESSING

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.1 Office Automation
      H.4.3 Communications Applications
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

  J. Computer Applications
  J.4 SOCIAL AND BEHAVIORAL SCIENCES

General Terms:
Design, Experimentation, Human Factors, Management, Standardization, Theory

Keywords:
collaborative learning, e-learning, end-user training, future research, individual differences, learning-from-computers, learning-with-computers, research framework, review