Marilyn Hughes Blackmon
Muneo Kitajima
ABSTRACT
This paper proposes a transformation of the Cognitive Walkthrough (CW), a theory-based usability inspection method that has proven useful in designing applications that support use by exploration. The new Cognitive Walkthrough for the Web (CWW) is superior for evaluating how well websites support users' navigation and information search tasks. The CWW uses Latent Semantic Analysis to objectively estimate the degree of semantic similarity (information scent) between representative user goal statements (100-200 words) and heading/link texts on each web page. Using an actual website, the paper shows how the CWW identifies three types of problems in web page designs. Three experiments test CWW predictions of users' success rates in accomplishing goals, verifying the value of CWW for identifying these usability problems
- Accrue Insight. http://www.accrue.com.Google Scholar
- Anderson, J. R., & Lebiere, C. The Atomic Components of Thought. Lawrence Erlbaum Associates, 1998.Google Scholar
- Berland, G.K. at al. Health information on the Internet: Accessibility, quality, and readability in English and Spanish. Journal of the American Medical Association, 285, 2612--2621, 2001.Google ScholarCross Ref
- Byrne, M. D., John, B. E., Wehrle, N. S., & Crow, D. C. The tangled Web we wove: A taskonomy of WWW use. In Proceedings of CH'99, ACM Press, 544--551, 1999. Google ScholarDigital Library
- Chi, E., Pirolli, P., & Pitkow, J. The scent of a site: A system for analyzing and predicting information scent, usage, and usability of a web site. In Proceedings of CHI 2000, 161--168, ACM Press, 2000. Google ScholarDigital Library
- Chi, E., Pirolli, P., Chen, K., & Pitkow, J. Using information scent to model user information needs and actions and the Web. In Proceedings of CHI 2000, ACM Press, 490--497, 2001. Google ScholarDigital Library
- Cooper, M. Evaluating accessibility and usability of web pages. In Proceedings of 2nd Int. Conference on Computer-Aided Design of User Interfaces, Kluwer Academics, 33--42, 1999. Google ScholarDigital Library
- Cooper, A. The Inmates are Running the Asylum: Why High Tech Products Drive Us Crazy and How To Restore the Sanity. Macmillan Publishing Co., 2000. Google ScholarDigital Library
- E-marketing.Com: http://www.e-marketing.com.au/ documents/useabilityintro.htmGoogle Scholar
- Furnas, G. W. Effective view navigation. In Proceedings of CHI'97, ACM Press, 367--374, 1997. Google ScholarDigital Library
- Gamble, P. E. Does Link Label Length and Content Affect Web User Performance? Unpublished Senior Honor's Thesis, Department of Psychology, University of Colorado at Boulder, 2001.Google Scholar
- Huberman, B. A., Pirolli, P., Pitkow, J., & Lukose, R. Strong regularities in World Wide Web surfing. Science, 280, 95--97, 1998.Google ScholarCross Ref
- Instone, K. STRESS-TEST your favorite, or least favorite website. Michigan Ohio Computer-Human Interaction Meetings (March 14, 2001); find Navigation Stress Test also at http://keith.instone.org/navstress/.Google Scholar
- Kintsch, W. Comprehension: A Paradigm for Cognition, Cambridge University Press, 1998.Google Scholar
- Kitajima, M. & Polson, P. G. A comprehension-based model of exploration, Human-Computer Interaction, 12, 345--389, 1997. Google ScholarDigital Library
- Kitajima, M., Blackmon, M. H., & Polson, P. G. A Comprehension-based model of Web navigation and its application to Web usability analysis. In People and Computers XIV, Springer, 357--373, 2000.Google Scholar
- Landauer, T. K. & Dumais, S. T. A solution to Plato's problem: The Latent Semantic Analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104, 211--240, 1997.Google ScholarCross Ref
- Larson, K., & Czerwinski, M. Web page design: Implications of memory, structure and scent for information retrieval. In Proceedings of CHI'98, ACM Press, 25--32, 1998. Google ScholarDigital Library
- Lewis, C., Polson, P., Wharton, C., & Rieman, J. Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces. In Proceedings of CHI'90, ACM Press, 235--241, 1990. Google ScholarDigital Library
- Morrison, J. B., Pirolli, P., & Card, S. K. A taxonomic analysis of what World Wide Web activates significantly impact people's decisions and actions. UIR Technical Report UIR-R-2000-17, Xerox PARC, 2000.Google Scholar
- Newell, A. & Card, S. K. The prospects for psychological science in human-computer interaction. Human-Computer Interaction, 1, 209--242, 1985.Google ScholarDigital Library
- Nielsen, J. Designing Web Usability, Indianapolis: New Riders Publishing, 2000.Google Scholar
- Nielsen, J. http://www.useit.com/alertbox/991212.html, 1999.Google Scholar
- Nielsen, J. & Mack, R. L. Usability Inspection Methods, New York: John Wiley & Sons, Inc., 1994. Google ScholarDigital Library
- Pirolli, P. Computational models of information scent-following in a very large browsable text collection. In Proceedings of CHI'97, ACM Press, 3--10, 1997. Google ScholarDigital Library
- Pirolli, P. & Card, S. Information foraging. Psychological Review, 106, 643--675, 1999.Google ScholarCross Ref
- Pitkow, J. & Pirolli, P. Mining longest repeated subsequences to predict World Wide Web surfing. In Proceedings of the USENIX Conference on Internet, 1999. Google ScholarDigital Library
- Polson, P. G., Lewis, C., Rieman, J., & Wharton, C. Cognitive walkthroughs: A method for theory-based evaluation of user interfaces. International Journal of Man-Machine Studies, 36, 741--773, 1992. Google ScholarDigital Library
- Rieman, J., Young, R. M., & Howes, A. A dual-space model of iteratively deepening exploratory learning. International Journal of Human-Computer Studies, 44, 743--775, 1996. Google ScholarDigital Library
- Tauscher, L. & Greenberg, S. How people revisit web pages: Empirical findings and implication for the design of history systems. International Journal of Human-Computer Studies, 47, 97--137, 1997. Google ScholarDigital Library
- WebCriteria SiteProfile. http://www.webcriteria.com.Google Scholar
- Wharton, C., Rieman, J., Lewis, C., & Polson, P. The cognitive walkthrough method: A practitioner's guide. In J. Nielsen & R. L. Mack (Eds.), Usability Inspection Methods, New York: John Wiley & Sons Inc., 105--140, 1994. Google ScholarDigital Library
- Wolfe, M. B., Schreiner, M. E., Rehder, B., Laham, D., Foltz, P. W., Kintsch, W., & Landauer, T. K. (1998). Learning from text: Matching readers and text by Latent Semantic Analysis. Discourse Processes, 25, 309--336.Google Scholar
Index Terms
- Cognitive walkthrough for the web
Recommendations
Repairing usability problems identified by the cognitive walkthrough for the web
CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsMethods for identifying usability problems in web page designs should ideally also provide practical methods for repairing the problems found. Blackmon et al. [2] proved the usefulness of the Cognitive Walkthrough for the Web (CWW) for identifying three ...
Collective web usability analysis: cognitive and activity walkthroughs
This paper reviews two walkthrough methods for the web design practitioner to assess their web-based systems. Their relative advantages and weaknesses, and suggestions for web evaluation are offered, with a brief website example. Based on these analyses,...
Design and Evaluation of Intelligent Menu Interface through Cognitive Walkthrough Procedure and Automated Logging for Management Information System
Computer Supported Cooperative Work in Design IVOne of the critcal issues in Managment Information System (MIS) is the information overload from complicated hierachical menu. Novice users easily get lost when an important and frequently used menu item is rooted and hidden in a deeper level of a ...
Comments