Stavri G. Nikolov
ABSTRACT
This paper describes a novel gaze-contingent display (GCD) using texture mapping and OpenGL. This new system has a number of key features: (a) it is platform independent, i.e. it runs on different computers and under different operating systems; (b) it is eyetracker independent, since it provides an interactive focus+context display that can be easily integrated with any eye-tracker that provides real-time 2-D gaze estimation; (c) it is flexible in that it provides for straightforward modification of the main GCD parameters, including size and shape of the window and its border; and (d) through the use of OpenGL extensions it can perform local real-time image analysis within the GCD window. The new GCD system implementation is described in detail and some performance figures are given. Several applications of this system are studied, including gaze-contingent multi-resolution displays, gaze-contingent multi-modality displays, and gaze-contingent image analysis.
Supplemental Material
Available for Download
pdf
p11-nikolov-plate.pdf (1.2 MB)
This is the 1st color plate for Gaze-contingent display using texture mapping and OpenGL
- AMD. 2003. Athlon processors. http://www.amd.com.Google Scholar
- CARPENTER, R. H. S. 1981. Oculomotor procrastination. In Eye Movements, Cognition and Visual Perception, Lawrence Erlbaum, Hillsdale, N.J., 237-246.Google Scholar
- CARPENTER, R. H. S. 1988. Movements of the eyes. (2nd edn). Pion Press, London.Google Scholar
- DAGNELIE, G., AND MASSOF, R. W. 1996. Toward an artificial eye. IEEE Spectrum 33, 5, 20-29. Google ScholarDigital Library
- DUCHOWSKI, A. T. 2002. A breadth-first survey of eye tracking applications. Behavior Research Methods, Instruments, and Computers (BRMIC) 34, 4, 455-470.Google ScholarCross Ref
- DUCHOWSKI, A. T. 2003. Gaze Tracking Methodology: Theory and Practice . Springer, London, UK. Google ScholarDigital Library
- GEISLER, W. S., AND PERRY, J. S. 1998. A real-time foveated multiresolution system for low-bandwidth video communication. In Human Vision and Electronic Imaging, SPIE, B. Rogowitz and T. Pappas, Eds., vol. 3299, 294-305.Google Scholar
- GEISLER, W. S., AND PERRY, J. S. 1999. Variable-resolution displays for visual communication and simulation. The Society for Information Display 30, 420-423.Google Scholar
- GEISLER, W. S., AND PERRY, J. S. 2002. Real-time simulation of arbitrary visual fields. In Proceedings of the Eye Tracking Research and Applications Symposium 2002, ACM SIGGRAPH, 83-87. Google ScholarDigital Library
- INTEL. 2003. Pentium processors. http://www.intel.com.Google Scholar
- JONES, M. G., AND NIKOLOV, S. G. 2000. Volume visualisation via region-enhancement around an observer's fixation point. In MEDSIP 2000 (International Conference on Advances in Medical Signal and Information Processing), Bristol, UK, 4-6 September, 2000, IEE, no. 476, 305-312.Google ScholarCross Ref
- KORTUM, P. T., AND GEISLER, W. S. 1996. Implementation of a foveated image-coding system for bandwidth reduction of video images. In Human Vision and Electronic Imaging, SPIE, B. Rogowitz and J. Allebach, Eds., vol. 2657, 350-360.Google Scholar
- LOSCHKY, L. C., AND MCCONKIE, G. W. 2000. User performance with gaze contingent displays. In Proceedings of the Eye Tracking Research and Applications Symposium 2000, ACM SIGGRAPH, 97-103. Google ScholarDigital Library
- LUEBKE, D., REDDY, M., COHEN, J., VARSHNEY, A., WATSON, B., AND HUEBNER, R. 2002. Level of Detail for 3D Graphics. Morgan Kaufmann Publishers, San Francisco, CA. Google ScholarDigital Library
- MCCONKIE, G. W., AND RAYNER, K. 1975. The span of the effective stimulus during a fixation in reading. Perception and Psychophysics 17, 578-586.Google ScholarCross Ref
- MICROSOFT. 2003. DirectX. http://www.microsoft.com/directx/.Google Scholar
- MOLOFEE, J. 2003. Nehe productions: OpenGL examples. http://nehe.gamedev.net/data/lessons/lesson.asp?lesson=01.Google Scholar
- MULTIMAP. 2003. UK aerial photo coverage. http://www.multimap.com.Google Scholar
- NEWMAN, T. 2003. Gaze-contingent displays using texture mapping, MEng Thesis. University of Bristol, UK, Bristol, UK.Google Scholar
- NIKOLOV, S. G., JONES, M. G., BULL, D. R., CANAGARAJAH, C. N., HALLIWELL, M., AND WELLS, P. N. T. 2001. Focus+context visualisation for image fusion. In 4th International Conference on Information Fusion (Fusion 2001), Montreal, Canada, 7-10 August, International Society of Information Fusion (ISIF), vol. I, WeC3-3 - WeC3-9.Google Scholar
- NIKOLOV, S. G., JONES, M. G., GILCHRIST, I. D., BULL, D. R., AND CANAGARAJAH, C. N. 2002. Multi-modality gaze-contingent displays for image fusion. In Proceedings of the 5th International Conference on Information Fusion (Fusion 2002), Annapolis, MD, USA, 8-11 July, International Society of Information Fusion (ISIF), 1213-1220.Google ScholarCross Ref
- NIKOLOV, S. G., GILCHRIST, I. D., AND BULL, D. R. 2003. Gazecontingent multi-modality displays of multi-layered geographical maps. In Proceeedings of the Fifth International Conference on Numerical Methods and Applications (NM&A02), Symposium on Numerical Methods for Sensor Data Processing, Borovetz, Bulgaria, Lecture Notes in Computer Science, Springer-Verlag, vol. 2542, 325-332. Google ScholarDigital Library
- NIKOLOV, S. G., GILCHRIST, I. D., JONES, M. G., BULL, D. R., AND CANAGARAJAH, C. N. 2003. Gaze-contingent image analysis and multi-sensorial image display. In Proceedings of the 12th European Conference on Eye Movements (ECEM), Dundee, Scotland, 20-24 August, PC10.Google ScholarCross Ref
- NIKOLOV, S. G., GILCHRIST, I. D., JONES, M. G., BULL, D. R., AND CANAGARAJAH, C. N. 2003. A system for gaze-contingent image analysis and multi-sensorial image display. In Proceedings of the 6th International Conference on Information Fusion (Fusion 2003), Cairns, Queensland, Australia, 8-11 July, International Society of Information Fusion (ISIF), 749-756.Google ScholarCross Ref
- NVIDIA. 2003. GeForce graphics cards. http://www.nvidia.com.Google Scholar
- OPENGL ARCHITECTURE REVIEW BOARD (ARB). 2003. OpenGL. http://www.opengl.org.Google Scholar
- PARKHURST, D. J., AND NIEBUR, E. 2002. Variable resolution displays: A theoretical, practical, and behavioral evaluation. Human Factors 44, 4, 611-629.Google ScholarCross Ref
- POMPLUN, M., REINGOLD, E. M., AND SHEN, J. 2001. Investigating the visual span in comparative search: the effects of task difficulty and divided attention. Cognition 81, B57-B67.Google ScholarCross Ref
- POMPLUN, M., REINGOLD, E. M., AND SHEN, J. 2001. Peripheral and parafoveal cueing and masking effects on saccadic selectivity in a gazecontingent window paradigm. Vision Research 41, 2757-2769.Google ScholarCross Ref
- RAYNER, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin 124, 372-422.Google ScholarCross Ref
- REINGOLD, E. M., AND LOSCHKY, L. C. 2002. Reduced saliency of peripheral targets in gaze-contingent multi-resolution displays: Blended versus sharp boundary windows. In Proceedings of the Eye Tracking Research and Applications Symposium 2002, ACM SIGGRAPH, 89-94. Google ScholarDigital Library
- REINGOLD, E. M., CHARNESS, N., POMPLUN, M., AND STAMPE, D. M. 2001. Visual span in expert chess players: evidence from eye movements. Psychological Science 12, 48-55.Google ScholarCross Ref
- SAIDA, S., AND IKEDA, M. 1979. Useful visual field size for pattern perception. Perception and Psychophysics 25, 119-125.Google ScholarCross Ref
- SEEINGMACHINES. 2003. faceLAB. http://www.seeingmachines.com.au.Google Scholar
- SEGAL, M., AND AKELEY, K. 1998. The OpenGL graphics system: A specification (version 1.2.1). Tech. rep., Silicon Graphics, Inc., Mountain View, CA, October.Google Scholar
- SRREASEARCH. 2003. EyeLink. http://www.eyelinkinfo.com.Google Scholar
- VAHONEN, S. 2003. Samu's OpenGL programs. http://www.students.tut.fi/vahonen/computer/OpenGL/.Google Scholar
- VAN DIEPEN, P. M. J., GRAEF, P. D., AND RENSBERGEN, J. V. 1994. On-line control of moving masks and windows on a complex background using the ATVista Videographics Adapter. Behavior Research Methods, Instruments and Computers 26, 454-460.Google ScholarCross Ref
- VAN DIEPEN, P. M. J., GRAEF, P. D., AND RENSBERGEN, J. V. 1997. A pixel-resolution video switcher for eye-contingent display changes. Spatial Vision 10, 335-344.Google ScholarCross Ref
- WATSON, B., WALKER, N., HODGES, L. F., AND WORDEN, A. 1997. Managing level of detail through peripheral degradation: Effects on search performance with a head-mounted display. ACM Transactions on Computer-Human Interaction 4, 4, 323-346. Google ScholarDigital Library
- WEIMAN, C. F. R. 1990. Video compression via log polar mapping. In Real Time Image Processing II, SPIE, vol.1295, 266-277.Google Scholar
- WOO, M., NEIDER, J., DAVIS, T., AND SHREINER, D. 1999. OpenGL Programming Guide:The Official Guide to Learning OpenGL, Version 1.2. Addison-Wesley Pub Co. Google ScholarDigital Library
Index Terms
- Gaze-contingent display using texture mapping and OpenGL: system and applications
Recommendations
Compression-Based 3D Texture Mapping for Real-Time Rendering
Pacific Graphics '99 in Graphical ModelsWhile 2D texture mapping is one of the most effective of the rendering techniques that make 3D objects appear visually interesting, it often suffers from visual artifacts produced when 2D image patterns are wrapped onto the surfaces of objects with ...
Accelerated volume ray-casting using texture mapping
VIS '01: Proceedings of the conference on Visualization '01Acceleration techniques for volume ray-casting are primarily based on pre-computed data structures that allow one to efficiently traverse empty or homogeneous regions. In order to display volume data that successively undergoes color lookups, however, ...
Interactive multi-pass programmable shading
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniquesProgrammable shading is a common technique for production animation, but interactive programmable shading is not yet widely available. We support interactive programmable shading on virtually any 3D graphics hardware using a scene graph library on top ...
Comments