Cognitive Walkthrough pour l'évaluation des IHM: synthèse des extensions et évolutions conceptuelles, méthodologiques et technologiques

ABSTRACT

This synthesis paper concerns the evaluation of interactive systems using usability inspection methods, especially the Cognitive Walkthrough (CW) method. The background principles of CW followed by its evolution and variants are described. A synthesis from conceptual, methodological and technological points of views is proposed.

References

1. Bastien, J. M. C. L'inspection ergonomique des logiciels interactifs: intérêts et limites. In Psychologie ergonomique: tendances actuelles, Collection Le Travail Humain, Hoc J. M. & Darses F (Eds.), Paris, 2004.
2. Beck, A., Janssen, C., Weisbecker, A., Ziegler, J. Integrating Object-Oriented and Graphical User Interface Design. In Proc. of the SE/HCI Workshop, Sorrento, Italy, 1994.
3. Bertelsen, O. W. The activity walkthrough: an expert review method based on activity theory. In Proc. NordiCHI, Tampere, Finland, 2004.
4. Blackmon, M. H., Polson, P., Kitajima, M., Lewis, C. Cognitive Walkthrough for the Web. In Proc. ACM CHI, 2002, pp. 463--470.
5. Card, S. K., Moran, T. P., Newell, A. The Psychology of human-computer interaction. Hillsdale, NJ: Erlbaun, 1983.
6. Desurvire, H. W., Kondziela, J. M., Atwood, M. E., What is gained and lost when using evaluation methods other than empirical testing. In People and Computers VII, A. Monk, D. Diaper & M. D. Harrison (Eds.), 1992, pp. 89--102.
7. Granollers, T., Lorés, J. Cognitive Walkthrough With Users: an alternative dimension for usability methods. In Proc. HCI International, Las Vegas, 2005.
8. Gray, W. D., Salzman, M. C., Damaged Merchandise? A review of experiments that compare usability evaluation methods. Hum.-Comp. Interaction, 11, 1998, pp. 203--261.
9. Gutwin, C., Greenberg, S. The mechanics of collaboration: developping low cost usability evaluation methods for shared workspaces. Proc. IEEE Wetice, 2000, pp. 92--103.
10. Huart, J., Kolski, C., Sagar, M. Evaluation of multimedia applications using inspection methods: The CW case. Interacting with Computers, 16, 2004, pp. 183--215.
11. Hutchins, E. L., Hollan, J. D., Norman, D. A. Direct manipulation Interface. Hum.-Comp. Inter., 1, 1985, pp. 311--388.
12. ISO 9241, Ergonomic requirements for office work with visual display terminals (VDTs)- Part 10, 1994.
13. Jeffries, R., Miller, J. R., Wharton, C., Uyeda, K. M. User interface evaluation in the real world: a comparison of four techniques. Proc. of the ACM CHI'91 Conf. on Human Factors in Computing Systems, pp. 119--124, ACM Press.
14. Kaptelinin, V. Computer-Mediated Activity: Functional Organs in Social and Developmental Contexts". In Nardi B. (ed.), Context and Consciousness: Activity Theory and Human-Computer Interaction, MIT Press, 1996, pp. 45--68.
15. Karat, C. M., Cambell, R., Fiegel, T. Comparison of empirical testing and walkthrough methods in user interface evaluation. Proc. ACM CHI, 1992, pp. 397--404.
16. Kato, T., Hori, M. Articulating the cognitive walkthrough based on an extended model of HCI. Proc. HCI International, Las Vegas, 2005.
17. Kato, T., Hiro, M. Beyond Perceivability: Critical Requirements for Universal Design of Information. 8th Annual ACM Conf. on Assistive Technologies, 2006, pp. 287--288.
18. Kieras, D. An approach to the formal analysis of user complexity. IJHCI, 22, 1985, pp. 365--394.
19. Kintsch, W. The role of knowledge in discourse comprehension: A construction-Integration model. Psychological Review, 95, 2, 1988, pp. 163--182.
20. Kitajima, M, Polson, PG. A comprehension based model of comprehension. HCI, 12, 1997, pp. 345--389.
21. Kitajjma, M., Blackmon, M. H., Polson, P. A Comprehension-based model of Web navigation and its application to Web usability analysis. In People and Computer XIV, 2000, pp. 357--373.
22. Landauer, T. K., Dumas, S. T. A solution to Plato's problem: The Latent Semantic Analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104, 1997, pp. 211--240.
23. Lavery, D., Cockton, G. Cognitive Walkthrough - Usability Evaluation Materials. Technical Report TR-1997-20, Dep. of Computing Science, University of Glasgow, 1997.
24. Lewis, C., Polson, P., Wharton, C., Rieman, J. Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces. Proc. ACM CHI, 1990, pp. 235--242.
25. Lewis, C. Why and How to learn why: analysis-based generalization of procedure. Cognitive Science, 12, 1988, pp. 211--225.
26. Lewis, C., A model of Mental Model Construction. In Proc. ACM CHI, 1986, pp. 306--313.
27. Lewis, C., Wharton, C. Cognitive Walkthrough. In Handbook of Human-Computer Interaction, M. Helander, T. K. Landaeur, P. Prabhu (eds.), Elsevier, 1997, pp. 717--732.
28. Mariage, C. Metro Web: logiciel de support à l'évaluation de la qualité ergonomique des sites web. Thèse de Doctorat, UCL, Louvain-la-Neuve, 2005.
29. Monk, A. A Cyclic Interaction: a unitary approach to interaction, action and environment. Cognition, 68 (2), 1998, pp. 95--110.
30. Nardi, B. A. Context and Consciousness: Activity Theory and Human-Computer Interaction. M.I.T. Press, 1996.
31. Nielsen, J. Finding Usability Problems Through Heuristic Evaluation. In Proc. ACM CHI, 1992, pp. 373--380.
32. Nielsen, J., Mack, R. Usability Inspection Methods. John Wiley & Sons, New York, 1994.
33. Nielsen, J., Molich, R. Heuristic Evaluation of User Interfaces. In Proc. ACM CHI, 1990, pp. 249--256.
34. Norman, D. A. Cognitive engineering. In D. A. Norman & S. W. Draper (Eds.), User centered systems design: New perspectives in human-computer interaction, Lawrence Erlbaum Associates, Hillsdale, 1986, pp. 31--61.
35. Pinelle, D., Gutwin, C. Groupware walkthrough: Adding context to groupware usability. In Proc. ACM CHI, 2002, pp. 455--462.
36. Polson, P. G., Lewis, C., Rieman, J., Wharton, C. Cognitive walkthroughs: A method for theory-based evaluation of user interfaces. IJMMS, 36 (5), 1992, pp. 741--773.
37. Polson, P. G., Lewis, C. H. Theory-based design for easily learned interfaces. Human-Computer Interaction, 5(5), 1990, pp. 191--220.
38. Rieman, J., Davies, S., Hair, D. C., Esemplare, M., Polson, P., Lewis, C. An Automated Walkthrough: Description and Evaluation. In Proc. ACM CHI, 1991, pp. 427--428.
39. Riihiaho, S. Experiences with usability evaluation methods. Licentiates thesis, Laboratory of information processing science, Helsinki Univ. of Tech., May, 2000.
40. Rizzo, A., Mandrigiani, E., Andreadis, A., The AVANTI Project: Prototyping and Evaluation with a Cognitive Walkthrough Based on the Norman's Model of Action. In Proc. DIS'97: Designing Interactive Systems: Processes, Practices, Methods, & Techniques, 1997, pp. 305--309.
41. Ryu, H. Collective Web Usability analysis. International Journal of Web Engineering and Technology, in press.
42. Ryu, H., Monk, A. Analysing interaction problems with cyclic interaction theory: Low-level Interaction Walkthrough. Psychology Jour., 2(3), 2004, pp. 304--330.
43. Sears, A. Heuristics Walkthroughs: Finding the problems without the noise. IJHCI, Vol. 9, 1997, pp. 213--234.
44. Spencer, R. The Streamlined Cognitive Walkthrough method, working around social constraints encountered in a software development company. In Proc. ACM CHI, 2000, pp. 353--359.
45. Van der Veer, G. C., Lenting, B. F., Bergevoet, B. A. J., GTA: Groupware Task Analysis - Modeling Complexity. Acta Psychologica, 91, 1996, pp. 297--322.
46. Ziegler, J., Burmester, M. Structured Human Interface Validation Technique - SHIVA. In Symbiosis of Human and Artefact, Y. Anzai, K. Ogawa, H. Mori (Eds.), Elsevier Science B.V., pp. 899--90.

Index Terms

• Computing methodologies

  • Computer graphics

• Human-centered computing

  • Human computer interaction (HCI)