SmartColor: disambiguation framework for the colorblind

ABSTRACT

Failure in visual communication between the author and the colorblind reader is caused when color effects that the author expects for the reader to experience are not observed by the reader. The proposed framework allows the author to annotate his/her intended color effects to the colored document. They are used to generate a repainted document that let the colorblind enjoy similar color effects that normal color vision person does for the original document. The annotations are formulated as a set of mathematical constraints that can describe several commonly used color effects. Constraints are defined over the normal vision color space. Then they are projected onto the restricted color space that corresponds to the one that the colorblind perceives. Finally, the projected constraints are resolved for the search of best repainting of the document that most successfully presents to the colorblind person the color effects experienced by the normal vision person on the original document. Effectiveness of the proposal is shown by colorblind simulation.

REFERENCES

• 1: James L. Alty , Dimitrios I. Rigas, Communicating graphical information to blind users using music: the role of context, Proceedings of the SIGCHI conference on Human factors in computing systems, p.574-581, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274721]
• 2: A. Borning. ThingLab: an object-oriented system for building simulations using constraints. In Proc. 5th intl. joint conf. Artificial intelligence, pages 73--85, Cambridge, MA, August 1977. William Kaufmann.
• 3: Alan Borning , Richard Lin , Kim Marriott, Constraints for the web, Proceedings of the fifth ACM international conference on Multimedia, p.173-182, November 09-13, 1997, Seattle, Washington, United States [doi>10.1145/266180.266361]
• 4: H. Brettel, F. Viénot, and J. D. Mollon. Computerized simulation of color appearance for dichromats. Optical Society of America (Series A), 14(10):2647--2655, October 1997.
• 5: K. R. Gegenfurtner and L. T. Sharpe, editors. Color Vision: From Genes to Perception. Cambridge University Press, 1999.
• 6: Christopher G. Healey, Choosing effective colours for data visualization, Proceedings of the 7th conference on Visualization '96, p.263-ff., October 28-29, 1996, San Francisco, California, United States
• 7: Anita W. Huang , Neel Sundaresan, A semantic transcoding system to adapt Web services for users with disabilities, Proceedings of the fourth international ACM conference on Assistive technologies, p.156-163, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354363]
• 8: S. Ishizaki. Adjusting simultaneous contrast effect for dynamic information display. In Proc. 2nd IS&T/SID Color imaging conf., pages 137--140, 1994.
• 9: Suguru Ishizaki, Color adaptive graphics: what you see in your color palette isn't what you get!, Conference companion on Human factors in computing systems, p.300-301, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223684]
• 10: Julie A. Jacko , Max A. Dixon , Robert H. Rosa, Jr. , Ingrid U. Scott , Charles J. Pappas, Visual profiles: a critical component of universal access, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.330-337, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303105]
• 11: N. Jacobson , W. Bender, Color as a determined communication, IBM Systems Journal, v.35 n.3-4, p.526-538, 1996
• 12: S. Kirkpatrick, C. D. Jr. Gerlatt, and M. P. Vecchi. Optimization by simulated annealing. Science, 220:671--680, 1983.
• 13: D. Malacara. Color Vision and Colorimetry: Theory and Applications. SPIE Press, 2002.
• 14: M. Okabe and K. Ito. How to make figures and presentations that are friendly to color blind people. http://jfly.iam.u-tokyo.ac.jp/html/color_blind/, November 2002.
• 15: Michael Sannella , John Maloney , Bjorn Freeman-Benson , Alan Borning, Multi-way versus one-way constraints in user interfaces: experience with the DeltaBlue algorithm, Software—Practice & Experience, v.23 n.5, p.529-566, May 1993 [doi>10.1002/spe.4380230507]
• 16: Lisa Seeman, The semantic web, web accessibility, and device independence, Proceedings of the 2004 international cross-disciplinary workshop on Web accessibility (W4A), May 18, 2004, New York City, New York [doi>10.1145/990657.990669]
• 17: A. Stockman and L. T. Sharpe. Spectral sensitivities of the middle- and long-wavelength sensitive cones derived from measurements in observers of known genotype. Vision Research, 40:1711--1737, 2000.
• 18: A. Stockman, L. T. Sharpe, and C. C. Fach. The spectral sensitivity of the human short-wavelength cones. Vision Research, 39:2901--2927, 2000.
• 19: F. Viénot, H. Brettel, L. Ott, A. B. M'Barek, and J. D. Mollon. What do colour-blind people see? Nature, 376(6536):127--128, 1995.
• 20: K. Wakita and K. Shimamura. Full-color images from ASSETS '05 SmartColor paper. http://www.is.titech.ac.jp/~wakita/public/assets2005/, August 2005.
• 21: K. Wakita and Y. Ueno. SmartGray: information preserving monochromatic rendering of colored documents. In ICITA '04: Proc. 2nd intl. conf. Information technology for applications, pages 470--475, Harbin, China, January 2004.
• 22: Accessibility research: aDesigner. http://www.research.ibm.com/trl/projects/acc_tech/adesigner.htm.
• 23: Vischeck. http://www.vischeck.com/.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Color

  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.2 Social Issues
          Subjects: Assistive technologies for persons with disabilities

General Terms:
Algorithms, Experimentation, Theory

Keywords:
colorblindness, constraint system, vision