Using visual texture for information display

ABSTRACT

Results from vision research are applied to the synthesis of visual texture for the purposes of information display. The literature surveyed suggests that the human visual system processes spatial information by means of parallel arrays of neurons that can be modeled by Gabor functions. Based on the Gabor model, it is argued that the fundamental dimensions of texture for human perception are orientation, size (1/frequency), and contrast. It is shown that there are a number of trade-offs in the density with which information can be displayed using texture. Two of these are (1) a trade-off between the size of the texture elements and the precision with which the location can be specified, and (2) the precision with which texture orientation can be specified and the precision with which texture size can be specified. Two algorithms for generating texture are included.

REFERENCES

• 1: BARI,OW, H.B. 1972. Single units and sensation: A neuron doctrine for perceptual psychology? Perception I, 3 (May), 371-394.
• 2: BECK, J. 1983. Textural segmentation, second order statistics, and textural elements. Biol. Cybern. 48, 2 (April), 125-130.
• 3: Jacques Bertin, Semiology of graphics, University of Wisconsin Press, 1983
• 4: BI,AKE, R., AND HOLOPIC, AN, K. 1985. Orientation selectivity in cats and humans assessed by masking. Vision Res. 25, 10 (Oct.), 1459 1467.
• 5: BI.AKEMORE, C., AND CAMPBEIA., F.W. 1969. On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images. J. Physiol. 203, 237 260.
• 6: BI,AKEMORE, C., NACHMIAS, J., AND SUTTON, P. 1970. The perceived spatial frequency shift: Evidence for frequency selective neurons in the human brain. J. Physiol. 210, 727-75
• 7: A. C. Bovik , M. Clark , W. S. Geisler, Multichannel Texture Analysis Using Localized Spatial Filters, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.12 n.1, p.55-73, January 1990 [doi>10.1109/34.41384 ]
• 8: CAELLI, T. M., ANI) BEVAN, P. 1983. Probing the spatial frequency spectrum for orientation sensitivity with stochastic textures. Vision Res. 23, 1 (Jan.), 39 45.
• 9: CAELI,I, T. M., BRETTEI,, H., RENTSCHLER, I., AND HII2, R. 1983. Discrimination thresholds in the two-dimensional spatial frequency domain. Vision Res. 23, 2 (Feb.), 129- 133.
• 10: CAELLI, T. M., AND MORAGLIA, G. 1985. On the detection of Gabor signals and discriminations of Gabor textures. Vision Res. 25, 5 (May), 671-684.
• 11: CAMPBELL, F. W., AND ROBSON, J.G. 1968. Application of Fourier analysis to the visibility of gratings. J. Physiol. 197, 551-566.
• 12: CI4UA, F.C. 1990. The processing of spatial frequency and orientation information. Percept. Psychophysics 47, 1 (Jan.), 79-86.
• 13: DAUGMAN, J. G. 1985. Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. J. Opt. Soc. Am. 2A, 7, 1160-1169.
• 14: DAUGMAN, J.G. 1984. Spatial visual channels in the Fourier plane. Vision Res. 24, 9 (Sept.), 91-910.
• 15: GARNER, W. R., AND FELFOLDY, G.L. 1970. Integrality of stimulus dimensions in various types of information processing. Cognitive Psychol. 1, 3 (Aug.), 225-241.
• 16: HARVEy, L. O., ANo GEar^Is. 1981. Internal representation of visual texture as the basis for the judgement of similarity. J. Exp. Psychol: Human Perception Perform. 7, 4 (July), 741-753.
• 17: HEELEY, D. 1991. Spatial frequency difference thresholds depend on stimulus area. Spat. Vision 5, 3 (July), 205-217.
• 18: HUBEL, D. H., AND WIESEL, T. 1968. Receptive fields and functional architecture of monkey striate cortex. J. Physiol. 195, 215-243.
• 19: JONES, J., ANO PALMER, L. 1987. An evaluation of the two-dimensional Gabor filter model of simple receptive fields in the cat striate cortex. J. Neurophysiol. 59, 1233-1258.
• 20: JULESZ, B. 1975. Textons, the elements of texture perception and their interactions. Nature 290, 5802 (March), 91-97.
• 21: MARCE~A, S. 1980. Mathematical descriptions of the responses of simple cortical cells. J. Opt. Soc. Am. 70, 11 (Nov.), 1297-1300.
• 22: MITCHELL, D. E., FREEMAN, R., AND WESTHEIMER, G. 1967. Effect of orientation on the modula- tion sensitivity for interference fringes on the retina. J. Opt. Soc. Am. 57, 245-249.
• 23: NOTHDURFT, H.C. 1991. Different effects from spatial frequency masking in texture segregation and texton detection tasks. Vision Res. 31, 2 (Feb.), 299-320.
• 24: PORAT, M., AND ZEEVI, Y. Y. 1989. Localized texture processing in vision: Analysis and synthesis in Gaborian space. IEEE Trans. Biorned. Eng. 36, 1 (Jan.), 115-129.
• 25: SAGI, D. 1990. Detection of an orientation singularity in Gabor textures: Effect of signal density and spatial frequency. Vision Res. 30, 9 (Sept.), 1377-1388.
• 26: Alvy Ray Smith, Color gamut transform pairs, ACM SIGGRAPH Computer Graphics, v.12 n.3, p.12-19, August 1978
• 27: STEIN, E.M. 1976. Harmonic analysis on R". In Studies in Harmonic Analysis, J. H. Ash, Ed. Studies in Mathematics, vol. 13. Mathematical Association of America, Washington, D.C., 237-243.
• 28: Jarke J. van Wijk, Spot noise texture synthesis for data visualization, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.309-318, July 1991
• 29: WAINER, H., AND FRANCOLIN{, C. M. 1980. An empirical enquiry concerning human understanding of two variable color maps. Am. Stat. 34, 2 (Feb.), 81-93.
• 30: Colin Ware, Color Sequences for Univariate Maps: Theory, Experiments and Principles, IEEE Computer Graphics and Applications, v.8 n.5, p.41-49, September 1988 [doi>10.1109/38.7760 ]
• 31: Colin Ware , William Cowan, The RGYB color geometry, ACM Transactions on Graphics (TOG), v.9 n.2, p.226-232, April 1990 [doi>10.1145/78956.78962]
• 32: Colin Ware , William Knight, Orderable dimensions of visual texture for data display: orientation, size and contrast, Proceedings of the SIGCHI conference on Human factors in computing systems, p.203-209, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142791]
• 33: H. Joseph Weaver, Theory of discrete and continuous Fourier analysis, John Wiley & Sons, Inc., New York, NY, 1989
• 34: WILSON, H. R., AND BERGEN, J.R. 1979. A four mechanism model for threshold spatial vision. Vision Res. 19, 1 (Jan.), 19-32.
• 35: WYSZECKI, G., AND STmES, W.S. 1982. Color Science: Concepts and Methods, Quantitative Data and Formulae. Wiley, New York.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
          Subjects: Display algorithms

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.3 Enhancement
          Subjects: Filtering

General Terms:
Algorithms, Human Factors

Keywords:
Gabor functions, information display, scientific visualization, texture, visualization