Tasks and scenario-based evaluation of information visualization techniques

ABSTRACT

Usability evaluation of an information visualization technique can only be done by the joint evaluation of both the visual representation and the interaction techniques. This work proposes task models as a key element for carrying out such evaluations in a structured way. We base our work on a taxonomy abstracting from rendering functions supported by information visualization techniques. CTTE is used to model these abstract visual tasks as well as to generate scenarios from this model for evaluation purposes. We conclude that the use of task models allows generating test scenarios which are more effective than informal and unstructured evaluations.

References

1. Byrne, M.; John, B. E.; Wehrle, N. S.; Crow, D. C. The Tangled Web We Wove: A Tasknomy of WWW Use. In: Proc. of CHI'99, ACM Press (1999), 544--551.
2. Card, S. K., Mackinlay, J. D. and Shneiderman, B. Readings in Information Visualization - Using Visualization to Think. San Francisco, Morgan Kaufmann, 1999.
3. Chen, C.; Czerwinski, M. Empirical studies of information visualization: A meta-analysis. International Journal of Human-Computer Studies, 53, 5(2000), 851--866.
4. Cockton, G., Woolrych, A., Hall, L. and Hindmarch, M. Changing Analysts' Tunes: The Surprising Impact of a New Instrument for Usability Inspection Method Assessment, Springer-Verlag, 2003.
5. Cugini, J., Laskowski, S. and Sebrechts, M. Design of 3D visualization of search results: evolution and evaluation. http://www.itl.nist.gov/iaui/vvrg/cugini/irlib/ paper-may2000.html. (2000)
6. Freitas, C. M. D. S.; Luzzardi, P. R. G.; Cava, R. A.; Winckler, M. A.; Pimenta, M. S.; Nedel, L. P. Evaluating Usability of Information Visualization Techniques. In: IHC 2002 - 5th Workshop on Human Factors in Computer Systems. Brazilian Computer Society Press (2002).
7. Garzotto, F., Matera, M. and Paolini, P. Abstract tasks: a tool for the inspection of Web sites and off-line hypermedia. In: Proc. ACM Conf. on Hypertext and Hypermedia. ACM Press (1999), 157--163.
8. Johnson, B. and Shneiderman, B. Tree-maps: A space-filing approach to the visualization of hierarchical information structures. In: Proc. IEEE Visualization'91, IEEE Computer Society (1999), 284--291.
9. Lamping, J., Rao, R. and Pirolli, P. A Focus+Context Technique Based in Hyperbolic Geometry for Visualizing Large Hierarchies. In: Proc. CHI'95 - ACM Conference on Human Factors in Computing Systems. ACM Press (1991), 401--408.
10. Mori, G., Paterno, F. and Santoro, C. CTTE: Support for Developing and Analysing Task Models for Interactive System Design. IEEE Transactions on Software Engineering, 28 (2002), 797--813.
11. Morse, E.; Lewis, M.; Olsen, K. Evaluating visualizations: using a taxonomic guide. Int. J. Human-Computer Studies, 53 (2000), 637--662.
12. Paterno, F., Mancini, C. and Meniconi, S. ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models. In: Proc. of Interact'97. Chapman & Hall (1997), 362--369.
13. Shneiderman, B. The eyes have it: a task by data type taxonomy for information visualization. In: Proc. IEEE Visual Languages. IEEE Computer Society (1996), 336--343.
14. Springmeyer, R.; Blattner, M. and Max, N. L. A characterization of the scientific data analysis process. In: Proc. IEEE Visualization'92. IEEE Computer Society (1992), pp. 235--242.
15. Tauscher, L.; Greenberg, S. (1997). Revisitation patterns in World Wide Web navigation. In: Proc. of CHI'97 - Human Factors in Computing Systems. ACM Press (1997), 399--406
16. Weherend, S. and Lewis, C. A Problem-oriented Classification of Visualization Techniques. In: Proc. IEEE Visualization'90. IEEE Computer Society (1990). 139--143.
17. Wiss, U., Carr, D. and Jonsson, H. (1998) Evaluating 3-Dimensional Information Visualization Designs. In: Proc. of the IEEE Conference on Information Visualization. IEEE Computer Society (1998), 137--144.
18. Zhou, M. and Feiner, S. K. Visual Task Characterization for Automated Visual Discourse Synthesis. In: Proc. CHI'98, ACM Press (1998), 392--399.
19. Manssour, I.; Freitas, C. M. D. S.; Claudio, D. M. & Wagner, F. R. Visualizing and exploring meteorological data using a tool-oriented approach. In: Earnshaw, R.; Vince, J.; Jones, H. Visualization & Modeling. London, Academic Press, 1997. Chapter 4 (16 pp.)

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)