Learning and perceiving colors haptically

ABSTRACT

Color is an integral part of spatial perception and there is a need to develop systems that render color information accessible to blind individuals. A novel system that allows learning, presentation and analysis of color information, designed in consultations with focus groups of individuals who are blind is proposed. Our system is based on a methodology that renders colors as textures through a haptic device. The aim of the proposed approach is to enable color perception and provide a basis for assessing color similarity. Initial testing of the system shows that both blind individuals and sighted individuals can recognize colors through our approach and further assess similarity between colors through the system. A space was obtained through multidimensional scaling performed on similarity scores between pairs of colors as presented through our system. This space obtained high congruency with the chromaticity diagram and the hue saturation color wheel which shows the validity of our system to allow color visualization. A realtime system based on the proposed mapping is designed to allow realtime color perception.

REFERENCES

• 1: Berlin, B. and Kay, P. Basic color terms : their universality and evolution. Oxford Press, UC Berkeley, 1991.
• 2: Cappelletti, L., Ferri, M. and Nicoletti, G., Vibrotactile color rendering for the visually impaired within the VIDET project. in Telemanipulator and Telepresence Technologies V, (1998), 92--96.
• 3: Hatwell, Y., Streri, A. and Gentaz, E. Touching for knowing : cognitive psychology of haptic manual perception. John Benjamins Pub., Amsterdam , Philadelphia, 2003.
• 4: Kees, V.D.D., Soundview: sensing color images by kinesthetic audio. in International conference on auditory display, (2003), 303--306.
• 5: Kruskal, J.B. and M., W. Multidimensional Scaling. Sage Publications, Beverly Hills CA, 1977.
• 6: Kruskal, J.B. and Wish, M. Multidimensional Scaling. Sage Publications, Beverly Hills CA, 1978.
• 7: Marr, D. Vision. Freeman Publishers, New York, 1982.
• 8: Olson, M.M. and Harris, K.R. Color Vision Deficiency and Color Blindness (Paperback). Fern Ridge Press, Portland, Oregon, 1988.
• 9: Revesz, G. Psychology and art of the blind. Longmans Green, London, 1950.
• 10: Sjöström, C. and Jönsson, B., The Phantasticon: To Use the Sense of Touch to Control a Computer and the World around You. in The 4th European Conference for the Advancement of Assistive Technology (AAATE'97), (Greece, 1997).
• 11: Thompson, E. Colour Vision. Routledge, London, 1995.
• 12: Way, T.P. and Barner, K.E. Automatic visual to tactile translation-II. Evaluation of the TACTile image creation system. IEEE Transactions on Rehabilitation Engineering, 5 (1). 95.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O

General Terms:
Algorithms, Design, Human Factors, Measurement, Performance

Keywords:
color perception, haptic user interfaces