How robust is the UTAUT instrument?: a multigroup invariance analysis in the context of acceptance and use of online community weblog systems

ABSTRACT

The recent Unified Theory of Acceptance and Use of Technology (UTAUT) model developed by Venkatesh et al. (Venkatesh, et al., 2003) as an integration of the various technology acceptance and use models is an important model in IS literature. However, the UTAUT instrument has not been tested in many different settings and contexts yet. If the scales for the UTAUT constructs are not robust and stable across settings, they are most likely to effect the interpretation of research results. It is, therefore, essential to assess whether these scales are perceived in the same way by individuals in different subgroups. In this paper, acceptance of online community Weblog systems is chosen as the context and data collected from 265 business school undergraduate students are analyzed using multiple group invariance analysis to assess the equivalence of the UTAUT scales across different subgroups based on gender, general computing knowledge, Weblog-specific knowledge, experience with Weblogs, and frequency of using Weblogs. Results indicate that scales for the four constructs in UTAUT including performance expectancy, effort expectancy, social influence, and facilitating conditions have invariant true scores across most but not all subgroups. Researchers and practitioners, therefore, need to apply caution when interpreting the results from the UTAUT instrument.

REFERENCES

• 1: Dennis A. Adams , R. Ryan Nelson , Peter A. Todd, Perceived usefulness, ease of use, and usage of information technology: a replication, MIS Quarterly, v.16 n.2, p.227-247, June 1992 [doi>10.2307/249577]
• 2: Bentler, P.M., and Bonnet, D.G. "Significance tests and goodness-of-fit in the analysis of covariance structure," Psychological Bulletin (88:3), 1980, pp. 588--606.
• 3: Bollen, K.A. "Structural equations with latent variables," New York: John Wiley), 1989.
• 4: Cole, D.A., and Maxwell, S.E. "Multitrait-multimethod comparisons across populations: a confirmatory factor analytic approach," Multivariate Behavioral Research:20), 1985, pp. 389--417.
• 5: Cronbach, L.J. "Four psychological bulletin articles in perspective," Psychological Bulletin (112), 1992, pp. 389--392.
• 6: Cronbach, L.J., and Furby, L. "How should we measure "change": or should we?" Psychological Bulletin (74), 1970, pp. 68--80.
• 7: Dambrot, F., Watkins-Malek, M., Silling, S., Marshall, R., and Garver, J. "Correlates of sex differences in attitudes towards and involvement with computers," Journal of Vocational Behavior (27:1), 1985, pp. 71--86.
• 8: Doll, W.J., Hendrickson, A., and Deng, X. "Using Davis's perceived usefulness and ease-of-use instruments for decision making: a confirmatory and multigroup invariance analysis," Decision Sciences (29:4), 1998, pp. 839--869.
• 9: Hair, J.F., Anderson, R.E., Tatham, R.L., and Black, W.C. "Multivariate data analysis," Prentice-Hall: NJ, Saddle River), 1998.
• 10: Allison W. Harrison , R. Kelly Rainer, Jr., The influence of individual differences on skill in end-user computing, Journal of Management Information Systems, v.9 n.1, p.93-111, Summer 1992
• 11: Igbaria, M., Guimaraes, T., and Davis, G. "Testing the determinants of micro-computer usage via a structured equation model," Journal of Management Information Systems (11:4), 1995, pp. 87--114.
• 12: Will Wai-kit Ma , Pu Li , Theodore H. K. Clark, Examining the Cognitive Style Effects on the Acceptance of Online Community Weblog Systems, Proceedings of the 39th Annual Hawaii International Conference on System Sciences, p.135.1, January 04-07, 2006 [doi>10.1109/HICSS.2006.167]
• 13: Marcsh, H.W. "Confirmatory factor analysis models of factorial invariance: a multifaceted approach," Structural Equation Modeling (1:1), 1994, pp. 5--34.
• 14: Marsh, H.W. "The factorial invariance of responses by males and females to a multidimensional self-concept instrument: substantive and methodological issues," Multivariate Behavioral Research (22), 1987, pp. 457--480.
• 15: Venkatesh, V., Morris, M.G., Davis, G.B., and Davis, F.D. "User acceptance of information technology: toward a unified view," MIS Quarterly (27:3), 2003, pp. 425--478.
• 16: Wilder, G., Mackie, D., and Cooper, J. "Gender and computers: two surveys of computer-related attitudes," Sex Roles (13:3-4), 1985, pp. 215--228.

INDEX TERMS

Primary Classification:
  H. Information Systems

Additional Classification:
  H. Information Systems
  H.0 GENERAL

General Terms:
Measurement, Reliability, Theory

Keywords:
UTAUT model, effort expectancy, facilitating conditions, factorial invariance, invariance analysis, performance expectancy, social influence, weblogs