Observing effects of attention on presence with fMRI

ABSTRACT

Presence is one of the goals of many virtual reality systems. Historically, in the context of virtual reality, the concept of presence has been associated much with spatial perception (bottom up process) as its informal definition of "feeling of being there" suggests. However, recent studies in presence have challenged this view and attempted to widen the concept to include psychological immersion, thus linking more high level elements (processed in a top down fashion) to presence such as story and plots, flow, attention and focus, identification with the characters, emotion, etc. In this paper, we experimentally studied the relationship between two content elements, each representing the two axis of the presence dichotomy, perceptual cues for spatial presence and sustained attention for (psychological) immersion. Our belief was that spatial perception or presence and a top down processed concept such as voluntary attention have only a very weak relationship, thus our experimental hypothesis was that sustained attention would positively affect spatial presence in a virtual environment with impoverished perceptual cues, but have no effect in an environment rich in them. In order to confirm the existence of the sustained attention in the experiment, fMRI of the subjects were taken and analyzed as well. The experimental results showed that that attention had no effect on spatial presence, even in the environment with impoverished spatial cues.

References

1. P. A. Bandettini, E. C. Wong, R. S. Hinks, R. S. Tikofsky, and J. S. Hyde. Time course epi of human brain function during task activation. Magn. Reson. Med, 25(2):390--397, 6 1992.
2. S. Baumann, C. Neff, S. Fetzick, G. Stangl, L. Basler, R. Vereneck, and W. Schneider. A virtual reality system for neurobehavioral and fmri studies. In Proceedings of Virtual Reality, pages 312--312. IEEE, March 2003.
3. K. E. Bystrom, W. Barfield, and C. Hendrix. A conceptual model of the sense of presence in virtual environments. Presence: Teleoperators and Virtual Environments, 8(2):241--244, 4 1999.
4. B. J. Casey, J. D. Cohen, P. Jezzard, R. Turner, D. C. Noll, R. J. Trainor, J. Giedd, D. Kaysen, L. Hertz-Pannier, and J. L. Rapoport. Activation of prefrontal cortex in children during a nonspatial working memory task with functional mri. NeuroImage, 2(3):221--229, 9 1995.
5. D. Cho, J. Park, G. J. Kim, S. Hong, S. Han, and S. Lee. The dichotomy of presence elements: The where and what. In Proceedings of Virtual Reality, pages 271--272. IEEE, March 2003.
6. K. J. Friston, C. D. Fristh, P. F. Liddle, and R. S. Frackowiak. Comparing functional (pet) images: The assessment of significant change. J. Cereb. Blood Flow Metab., 11:690--699, 1991.
7. C. Hendrix and W. Barfield. Presence within virtual environments as a function of visual display parameters. Presence: Teleoperators and Virtual Environments, 5(3):274--289, 1996.
8. D. Zeltzer. Autonomy, Interaction and Presence, Presence, Teleoperators and Virtual Environments, 1(1), pp 127--132, 1992
9. G. Riva, F. Davide and W. A IJsselsteijn (Eds.) Being There: Concepts, effects and measurement of user presence in synthetic environments. Ios Press, 2003, Amsterdam, The Netherlands
10. H. G. Hoffman, T. Richards, B. Coda, A. Richards, and S. R. Sharar. The illusion of presence in immersive virtual reality during an fmri brain scan. Cyberpsychology and Behavior, 6(2):127--131, 2003.
11. W. A. Ijsselsteijn, H. de Ridder, J. Freeman, S. E. Avons, and D. Bouwhuis. Effects of stereoscopic presentation, image motion, and screen size on subjective and objective corroborative measures of presence. Presence: Teleoperators and Virtual Environments, 10(3):298--311, 6 2001.
12. F. Macar, H. Lejeune, M. Bonnet, A. Ferrara., V. Pouthas, F. Vidal, and P. Maquet. Activation of the supplementary motor area and of attentional networks during temporal processing. Exp. Brain Res., 142(4):475--485, 1 2002.
13. M. M. Mesulam. Attention, Confusional States and Neglect. Davis, Philadelphia, 1985.
14. R. Mraz, J. Hong, G. Quintin, K. Zakzanis, and S. Graham. A platform for combining virtual reality and fmri through multidisciplinary experiments involving basic neuroscience, engineering, and neuropsychology. In 10th Annual Scientific Meeting of International Society of Magnetic Resonance in Medicine. ISMRM, May 2002.
15. D. Nunez. A connectionist explanation of presence in virtual environments. MPhil Thesis, 2003.
16. F. Ortunõ, N. Ojeda, J. Arbizu, P. López, J. M. Marti-Climent, I. Pen~uelas, and S. Cervera. Sustained attention in a counting task: Normal performance and functional neuroanatomy. NeuroImage, 17(1):411--420, 1 2002.
17. J. V. Pardo, P. T. Fox, and M. E. Raichle. Localization of a human system for sustained attention by positron emission tomography. Nature, 349:61--62, 1 1991.
18. M. I. Posner and S. E. Petersen. The attention system of the human brain. Annu. Rev. Neurosci, 13:25--42, 1990.
19. H. Regenbrecht and T. Schubert. Real and illusory interactions enhance presence in virtual environments. Presence: Teleoperators and Virtual Environments, 11(4):425--434, August 2002.
20. L. Rueckert, N. Lange, A. Patriot, I. Appollonio, I. Litvan, D. L. Bihan, and J. Grafman. Visualizing cortical activation during mental calculation with functional mri. Neurolmage, 3(2):97--103, 4 1996.
21. C. Sas and G. M. P. O"Hare. Presence equation: An investigation into cognitive factors underlying presence. Presence: Teleoperators and Virtual Environments, 12(5):523--537, 2003.
22. J. Hwang, G. J. Kim and A. S. Rizzo. Space Extension: The Perceptual Presence Perspective. In Proceedings of VRCAI (Virtual-Reality Continuum and its Application in Industry), Singapore, 2004
23. W. Shim and G. Kim. Designing for presence and performance: The case of the virtual fish tank. Presence: Teleoperators and Virtual Environments, 12(4), August 2003.
24. M. Slater. Do Avatars Dream of Digital Sheep? Virtual People and the Sense of Presence. Unpublished Slides from IEEE VR Invited Talk, Orlando, Florida, 2002.
25. J. Talairach and P. Tournoux. Co-Planar Stereotaxic Atlas of the Human Brain. Thieme, Stuttgart, 1988.
26. E. L. Waterworth and J. A. Waterworth. Being and time: Judged presence and duration as a function of media form. Presence: Teleoperators and Virtual Environments, 12(5):495--511, October 2003.
27. J. A. Waterworth and E. L. Waterworth. Focus, locus and sensus: the 3 dimensions of virtual experience. Cyberpsychology and Behavior, 4(2):203--214, 2001.
28. B. G. Witmer and M. J. Singer. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7(3):225--240, 6 1998.
29. R. Pausch, D. Proffitt and Williams, G. Quantifying Immersion in Virtual Reality SIGGRAPH 97 Conference Proceedings, pages 13--18. ACM, 1997.
30. T. B. Sheridan. Musings on Telepresence and Virtual Presence. Presence: Teleoperators and Virtual Environments, 1(1), 120--126, 1992
31. C. Heeter. Being There: The Subjective Experience of Presence, Presence: Teleoperators and Virtual Environments, 1(2), 262--271, 1992
32. R. Kalawsky, S. Bee and S. Nee. Human factors evaluation techniques to aid understanding of virtual interfaces, BT Technology Journal, 17(1), 1999
33. M. W. McGreevy. The Presence of Field Geologists in Mars-Like Terrain. Presence: Teleoperators and Virtual Environments, vol. 1, no. 4, pp. 375--403, 1992
34. M. Slater, M. Usoh, V. Linakis, and R. Kooper. Immersion, presence and performance in virtual environments: An experiment with tri-dimensional chess. Proceedings of 1996 ACM VRST, 163--172, 1996
35. R. B. Welch, T. T. Blackman, A. Liu, B. A. Mellers, and W. Stark. The effects of pictorial realism, delay of visual feedback, and observer interactivity on the subjective sense of presence. Presence: Teleoperators and Virtual Environments, 5, 263--273, 1996
36. M. J. Wells. Virtual reality: Technology, experience, assumptions. Human Factors Society Bulletin, 35(1), 1--3, 1992

Index Terms

• Applied computing

  • Law, social and behavioral sciences

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Virtual reality