Metrics for measuring human interaction with interactive visualizations for information analysis

ABSTRACT

There is a lack of widely-accepted metrics for evaluating analysts' experiences with interactive visualizations (IV) for information analysis. We report an approach for developing analyst-centered IV metrics that is built upon understanding the workplace needs and experiences of information analysts with respect to IVs. We derive metrics from human-computer interaction heuristics, specializing the metrics to address the characteristics of IVs and analysts. When there are no existing heuristics, analysts' needs and experiences inform new heuristics.

REFERENCES

• 1: W. Dzida , S. Herda , W. D. Itzfeldt, User-Perceived Quality of Interactive Systems, IEEE Transactions on Software Engineering, v.4 n.4, p.270-276, July 1978 [doi>10.1109/TSE.1978.231511]
• 2: Engelbart, D. Augmenting human intellect: A conceptual framework. Summary Report AFOSR-3233. Stanford Research Institute: Menlo Park. Retrieved from http://www.bootstrap.org/augdocs/friedewald030402/augmentinghumanintellect/ahi62index.html July 20, 2007.
• 3: Jill Gerhardt-Powals, Cognitive engineering principles for enhancing human-computer performance, International Journal of Human-Computer Interaction, v.8 n.2, p.189-211, April-June 1996
• 4: John D. Gould , Clayton Lewis, Designing for usability—key principles and what designers think, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.50-53, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801579]
• 5: International Organization for Standardization (ISO). 1998. Ergonomic requirements for office work with visual display terminals (BDTs) - Part 11: Guidance on usability.
• 6: Jonas-Dwyer, D. and Pospisil, R. The millennial effect: Implications for academic development. In Proc. HERDSA 2004, 194--207.
• 7: Research-Based Web Design & Usability Guidelines, U.S. Dept. of Health and Human Services, 2006
• 8: Lin, H.X., Choong, Y. and Salvendy, G., 1997. A proposed index of usability: a method for comparing the relative usability of different software systems. Behaviour and Information Technology 16 (4-5), 267--278.
• 9: Marcus, A. Graphical User Interfaces. In Handbook of Human-Computer Interaction, Chapter 19, eds., Helander, M., Landauer, T.K., and Prabhu, P. Elsevier Science B.V., Amsterdam, 1997.
• 10: Smith, S. L. and Mosier, J. N. 1986, Design Guidelines for Designing User Interface Software. Technical Report MTR-10090 (The MITRE Corporation, Bedford, MA).
• 11: Thomas, J.J. and Cook, K.A., eds. 2005. Illuminating the path. Los Alamitos, CA: IEEE.
• 12: Torre Zuk , Lothar Schlesier , Petra Neumann , Mark S. Hancock , Sheelagh Carpendale, Heuristics for information visualization evaluation, Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization, May 23-23, 2006, Venice, Italy [doi>10.1145/1168149.1168162]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

General Terms:
Human Factors, Measurement

Keywords:
evaluation, heuristics, information visualization, metrics, usability