SoundBar: exploiting multiple views in multimodal graph browsing

ABSTRACT

In this paper we discuss why access to mathematical graphs is problematic for visually impaired people. By a review of graph understanding theory and interviews with visually impaired users, we explain why current non-visual representations are unlikely to provide effective access to graphs. We propose the use of multiple views of the graph, each providing quick access to specific information as a way to improve graph usability. We then introduce a specific multiple view system to improve access to bar graphs called SoundBar which provides an additional quick audio overview of the graph. An evaluation of SoundBar revealed that additional views significantly increased accuracy and reduced time taken in a question answering task.

REFERENCES

• 1: Michelle Q. Wang Baldonado , Allison Woodruff , Allan Kuchinsky, Guidelines for using multiple views in information visualization, Proceedings of the working conference on Advanced visual interfaces, p.110-119, May 2000, Palermo, Italy [doi>10.1145/345513.345271]
• 2: Andy Brown , Robert Stevens , Steve Pettifer, Issues in the Non-Visual Presentation of Graph Based Diagrams, Proceedings of the Information Visualisation, Eighth International Conference on (IV'04), p.671-676, July 14-16, 2004 [doi>10.1109/IV.2004.86]
• 3: Brown, L., and Brewster, S. A. Drawing by ear: Interpreting sonified line graphs. In Proceedings of ICAD 2003 (Boston, Massachusetts, 2003), ICAD, pp. 152--156.
• 4: Curcio, F. R. Comprehension of mathematical relationships expressed in graphs. Journal of Research in Mathematics Education 18, 5 (1987), 382--393.
• 5: Dimigen, G., Scott, F., Thackeray, F., Pimm, M., and Roy, A. W. N. Career expectations of british visually impaired students who are of school-leaving age. Journal of Visual Impairment and Blindness 87 (1993), 209--210.
• 6: Kosslyn, S. M. Understanding charts and graphs. Applied Cognitive Psychology 3, 3 (1989), 185--226.
• 7: Lohse, G. L. Models of graphical perception. In Handbook of Human-Computer Interaction, M. Helander, T. Landauer, and P. Prabu, Eds., 2 ed. Elsevier, Amsterdam, 1997, pp. 107--135.
• 8: Mansur, D. L. Graphs in Sound: A Numerical Data Analysis Method for the Blind. M.sc., University of California, 1985.
• 9: Miller, G. A. The magical number seven, plus or minus two: Some limits on our capacity for processing information. The Psychological Review 63, 1 (1956), 81--97.
• 10: Peebles, D., and Cheng, P. C. H. Modeling the effect of task and graphical representation on response latency in a graph reading task. Human Factors 45, 1 (2003), 28--46.
• 11: Pinker, S. A theory of graph comprehension. In Artificial Intelligence and the Future of Testing, R. Freedle, Ed. Laurence Erlbaum Associates, Hillsdale, New Jersey, 1990, pp. 73--126.
• 12: Jonathan C. Roberts , Computing Laboratory , University of Kent , Uk, On Encouraging Multiple Views for Visualisation, Proceedings of the International Conference on Information Visualisation, p.8, July 29-31, 1998
• 13: David A. Ross , Bruce B. Blasch, Development of a Wearable Computer Orientation System, Personal and Ubiquitous Computing, v.6 n.1, p.49-63, February 2002 [doi>10.1007/s007790200005]
• 14: Ben Shneiderman, Designing the User Interface: Strategies for Effective Human-Computer Interaction, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1997
• 15: Frances L. Van Scoy , Takamitsu Kawai , Marjorie Darrah , Connie Rash, Haptic Display of Mathematical Functions for Teaching Mathematics to Students with Vision Disabilities: Design and Proof of Concept, Proceedings of the First International Workshop on Haptic Human-Computer Interaction, p.31-40, August 31-September 01, 2000
• 16: Walker, B. N., and Cothran, J. T. Sonification sandbox: A graphical toolkit for auditory graphs. In ICAD 2003 (Boston, MA, 2003), ICAD, pp. 161--163.
• 17: Fredrik Winberg , John Bowers, Assembling the senses: towards the design of cooperative interfaces for visually impaired users, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031662]
• 18: Woods, D. D., Patterson, E. S., and Roth, E. M. Can we ever escape from data overload? a cognitive systems diagnosis. Cognition, Technology and Work 4 (2002), 22--36.
• 19: Yu, W., and Brewster, S. A. Evaluation of multimodal graphs for blind people. Journal of Universal Access in the Information Society 2, 2 (2003), 105--124.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
haptics, non-speech audio, visual impairment, visualisation