Using haptic cues to aid nonvisual structure recognition

ABSTRACT

Retrieving information presented visually is difficult for visually disabled users. Current accessibility technologies, such as screen readers, fail to convey presentational layout or structure. Information presented in graphs or images is almost impossible to convey through speech alone. In this paper, we present the results of an experimental study investigating the role of touch (haptic) and auditory cues in aiding structure recognition when visual presentation is missing. We hypothesize that by guiding users toward nodes in a graph structure using force fields, users will find it easier to recognize overall structure. Nine participants were asked to explore simple 3D structures containing nodes (spheres or cubes) laid out in various spatial configurations and asked to identify the nodes and draw their overall structure. Various combinations of haptic and auditory feedback were explored. Our results demonstrate that haptic cues significantly helped participants to quickly recognize nodes and structure. Surprisingly, auditory cues alone did not speed up node recognition; however, when they were combined with haptics both node identification and structure recognition significantly improved. This result demonstrates that haptic feedback plays an important role in enabling people to recall spatial layout.

REFERENCES

• 1: Aldrich, F. K. and Hindle, Y. 2003. Tactile graphics -- problem or solution? RNIB Visability 39, 25--26.
• 2: Ando, H., Watanabe, J., Amemiya, T., and Nakatani, M. 2006. Siggraph '06: Acm Siggraph 2006. Emerging Technologies. ACM Press, New York.
• 3: Brown, A., Stevens, R., and Pettifer, S. 2006. Audio representation of graphs: A quick look. In Proceedings of the International Conference on Auditory Displays 2006.
• 4: Colwell, C., Petrie, H., Kornbrot, D., Hardwick, A., and Furner, S. 1998. Haptic virtual reality for blind computer users. In Assets '98: Proceedings of the Third International ACM Conference on Assistive Technologies. ACM Press, New York. 92--99.
• 5: Edman, P. K. 1991. Tactile graphics. American foundation for the blind. New York.
• 6: Faconti, G. P., Massink, M., Bordegoni, M., Angelis, F. D., and Booth, S. 2000. Haptic cues for image disambiguation. Comput. Graph. Forum 19, 3.
• 7: Kildal, J. and Brewster, S. A. 2006. Non-visual overviews of complex data sets. In Proceedings of ACM CHI. ACM Press, New York. 947--952.
• 8: Lederman, S. J. and Klatzky, R. L. 1987. Hand movements: A window into haptic object recognition. Cognitive Psychology 19, 342--368.
• 9: Mcgookin, D. K. 2006. Graph builder: Constructing non-visual visualizations. In ICAD 2006, London, UK.
• 10: McGookin, D. K. and Brewster, S. A. 2006. Multivis: Improving access to visualisations for visually impaired people. In CHI '06: CHI '06 Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York. 267--270.
• 11: Petrie, H., Johnson, V., Strothotte, T., Raab, A., Michel, R., Reichert, L., and Schalt, A. 1997. Mobic: An aid to increase the independent mobility of blind travellers. The British Journal of Visual Impairment 15, 2, 63--66.
• 12: Ramloll, R. and Brewster, S. 2002. A generic approach for augmenting tactile diagrams with spatial non-speech sounds. In CHI '02: CHI '02 Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York. 770--771.
• 13: Sjostrom, C. 2001a. Designing haptic computer interfaces for blind people. In Proceedings of the 3rd International Workshop on Website Evolution. IEEE Press, Los Alamitos, CA.
• 14: Sjostrom, C. 2001b. Virtual haptic search tools—the white cane in a haptic computer interface. In AAATE.
• 15: Wall, S. and Brewster, S. 2006a. Feeling what you hear: tactile feedback for navigation of audio graphs. In CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press, New York. 1123--1132.
• 16: Wall, S. A. and Brewster, S. A. 2006b. Tac-tiles: multimodal pie charts for visually impaired users. In NordiCHI '06: Proceedings of the 4th Nordic Conference on Human-Computer Interaction. ACM Press, New York. 9--18.
• 17: Yu, W. and Brewster, S. 2002. Multimodal virtual reality versus printed medium in visualisation for blind people. In ACM Assets. Edinburgh, Scotland. 57--64.
• 18: Yu, W., Ramloll, R., and Brewster, S. A. 2001. Haptic graphs for blind computer users. In Proceedings of the First International Workshop on Haptic Human-Computer Interaction. Springer-Verlag, New York. 41--51.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Experimentation, Human Factors

Keywords:
Multimodal cues, accessibility, haptic perception, visual disability