An integrated task-based framework for the design and evaluation of visualizations to support preferential choice

ABSTRACT

In previous work, we proposed ValueCharts, a set of visualizations and interactive techniques to support the inspection of linear models of preferences. We now identify the need to consider the decision process in its entirety, and to redesign ValueCharts in order to support all phases of preferential choice. In this paper, we present our task-based approach to the redesign of ValueCharts grounded in recent findings from both Decision Analysis and Information Visualization. We propose a set of domain-independent tasks for the design and evaluation of interactive visualizations for preferential choice. We use the resulting framework as a basis for an analytical evaluation of ValueCharts and alternative approaches. We conclude with a detailed discussion of the redesign of our system based on our analysis.

REFERENCES

• 1: Robert Amar , John Stasko, BEST PAPER: A Knowledge Task-Based Framework for Design and Evaluation of Information Visualizations, Proceedings of the IEEE Symposium on Information Visualization (INFOVIS'04), p.143-150, October 10-12, 2004 [doi>10.1109/INFOVIS.2004.10]
• 2: Natalia Andrienko , Gennady Andrienko, Informed spatial decisions through coordinated views, Information Visualization, v.2 n.4, p.270-285, December 2003 [doi>10.1057/palgrave.ivs.9500058]
• 3: Toshiyuki Asahi , David Turo , Ben Shneiderman, Visual decision-making: using treemaps for the analytic hierarchy process, Conference companion on Human factors in computing systems, p.405-406, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223747]
• 4: V. Belton. VISA: Visual Interactive Sensitivity Analysis. SIMUL8 Corporation, Boston, MA, 2005.
• 5: Jim Blythe, Visual exploration and incremental utility elicitation, Eighteenth national conference on Artificial intelligence, p.526-532, July 28-August 01, 2002, Edmonton, Alberta, Canada
• 6: Giuseppe Carenini , John Loyd, ValueCharts: analyzing linear models expressing preferences and evaluations, Proceedings of the working conference on Advanced visual interfaces, May 25-28, 2004, Gallipoli, Italy [doi>10.1145/989863.989885]
• 7: R. T. Clemen. Making Hard Decisions. Duxbury Press, Belmont, CA, USA, 2nd edition, 1996.
• 8: Brock Craft , Paul Cairns, Beyond Guidelines: What Can We Learn from the Visual Information Seeking Mantra?, Proceedings of the Ninth International Conference on Information Visualisation (IV'05), p.110-118, July 06-08, 2005 [doi>10.1109/IV.2005.28]
• 9: W. Edwards and F. H. Barron. SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement. Organizational Behavior and Human Decision Processes, 60(4):306--325, 1996.
• 10: Wesley Johnston, Model visualization, Information visualization in data mining and knowledge discovery, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2001
• 11: R. Keeney. Value-Focused Thinking: A Path to Creative Decision Making. Harvard University Press, Cambridge, 1992.
• 12: Logical Decisions, Inc. Logical Decisions for Windows V. 5.1. Logical Decisions, Inc., Falls Church, VA, 2004.
• 13: J. W. Payne, J. R. Bettman, and E. J. Johnson. The Adaptive Decision Maker. Cambridge University Press, 1993.
• 14: Pearl Pu , Boi Faltings, Enriching buyers' experiences: the SmartClient approach, Proceedings of the SIGCHI conference on Human factors in computing systems, p.289-296, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332446]
• 15: Pearl Huan Z. Pu , Pratyush Kumar, Evaluating example-based search tools, Proceedings of the 5th ACM conference on Electronic commerce, May 17-20, 2004, New York, NY, USA [doi>10.1145/988772.988804]
• 16: Ben Shneiderman, The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations, Proceedings of the 1996 IEEE Symposium on Visual Languages, p.336, September 03-06, 1996
• 17: R. Spence and L. Tweedie. The Attribute Explorer: Information Synthesis Via Exploration. Interacting with Computers, 11(2):137--146, 1998.
• 18: P. Todd and I. Benbasat. Inducing Compensatory Information Processing through Decision Aids that Facilitate Effort Reduction: An Experimental Assessment. Journal of Behavioural Decision Making, 13:91--106, 2000.
• 19: Christopher Williamson , Ben Shneiderman, The dynamic HomeFinder: evaluating dynamic queries in a real-estate information exploration system, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.338-346, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133216]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.2 Types of Systems
          Subjects: Decision support (e.g., MIS)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

General Terms:
Design, Human Factors

Keywords:
preferential choice, task analysis, visualization techniques