ABSTRACT
Participants' eye-gaze is generally not captured or represented in immersive collaborative virtual environment (ICVE) systems. We present EyeCVE, which uses mobile eye-trackers to drive the gaze of each participant's virtual avatar, thus supporting remote mutual eye-contact and awareness of others' gaze in a perceptually unfragmented shared virtual workspace. We detail trials in which participants took part in three-way conferences between remote CAVE™ systems linked via EyeCVE. Eye-tracking data was recorded and used to evaluate interaction, confirming the system's support for the use of gaze as a communicational and management resource in multiparty conversational scenarios. We point toward subsequent investigation of eye-tracking in ICVEs for enhanced remote social-interaction and analysis.
- S. Acker and S. Levitt. Designing Videoconference Facilities for Improved Eye Contact. J. Broad. & Elec. Media, 31: 181, 1987.Google ScholarCross Ref
- M. Argyle and M. Cook. Gaze and Mutual Gaze. Cambridge University Press Cambridge, 1976.Google Scholar
- J. Bailenson, A. Beall, J. Loomis, J. Blascovich, and M. Turk. Transformed Social Interaction: Decoupling Representation from Behavior and Form in Collaborative Virtual Environments. Presence: Teleoperators & Virtual Environments, 13(4): 428--441, 2004. Google ScholarDigital Library
- J. Bailenson, J. Blascovich, A. Beall, and J. Loomis. Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments. Presence: Teleoperators & Virtual Environments, 10(6): 583--598, 2001. Google ScholarDigital Library
- S. Benford, J. Bowers, L. Fahlén, C. Greenhalgh, and D. Snowdon. User embodiment in collaborative virtual environments. Proceedings of the SIGCHI conference on Human factors in computing systems, pages 242--249, 1995. Google ScholarDigital Library
- M. Chen. Leveraging the asymmetric sensitivity of eye contact for videoconference. Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, pages 49--56, 2002. Google ScholarDigital Library
- S. Duncan. Some signals and rules for taking speaking turns in conversations. Nonverbal Communication: Readings with Commentary, 1974.Google Scholar
- M. Garau, M. Slater, V. Vinayagamoorthy, A. Brogni, A. Steed, and M. Sasse. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. Proceedings of the conference on Human factors in computing systems, pages 529--536, 2003. Google ScholarDigital Library
- E. Gu and N. Badler. Visual Attention and Eye Gaze During Multiparty Conversations with Distractions. Intelligent Virtual Agents, 2006. Google ScholarDigital Library
- J. Hauber, H. Regenbrecht, M. Billinghurst, and A. Cockburn. Spatiality in videoconferencing: trade-offs between efficiency and social presence. Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work, pages 413--422, 2006. Google ScholarDigital Library
- I. Heldal, A. Steed, M. Spante, et al. Successes and Failures in Co-Present Situations. Presence: Teleoperators & Virtual Environments, 14(5): 563--579, 2005. Google ScholarDigital Library
- J. Hindmarsh, M. Fraser, C. Heath, S. Benford, and C. Greenhalgh. Object-focused interaction in collaborative virtual environments. ACM Transactions on Computer-Human Interaction (TOCHI), 7(4): 477--509, 2000. Google ScholarDigital Library
- E. Isaacs and J. Tang. What video can and cannot do for collaboration: A case study. Multimedia Systems, 2(2): 63--73, 1994. Google ScholarDigital Library
- S. Langton, R. Watt, and V. Bruce. Do the eyes have it? Cues to the direction of social attention. Trends in Cognitive Sciences, 4(2): 50--59, 2000.Google ScholarCross Ref
- S. Lee, J. Badler, and N. Badler. Eyes alive. ACM Transactions on Graphics (TOG), 21(3): 637--644, 2002. Google ScholarDigital Library
- A. Murgia, R. Wolff, W. Steptoe, et al. A Tool For Replay And Analysis of Gaze-Enhanced Multiparty Sessions Captured in Immersive Collaborative Environments. ACM DS-RT '08, 2008. Google ScholarDigital Library
- N. Murray and D. Roberts. Comparison of head gaze and head and eye gaze within an immersive environment. the 10th IEEE International Symposium on Distributed Simulation and Real Time Applications. IEEE Computer Society, Los Alamitos, CA, 2006. Google ScholarDigital Library
- K. Okada, F. Maeda, Y. Ichikawaa, and Y. Matsushita. Multiparty videoconferencing at virtual social distance: MAJIC design. Proceedings of the 1994 ACM conference on Computer supported cooperative work, pages 385--393, 1994. Google ScholarDigital Library
- D. Roberts, R. Wolff, O. Otto, and A. Steed. Constructing a Gazebo: Supporting Teamwork in a Tightly Coupled, Distributed Task in Virtual Reality. Presence: Teleoperators & Virtual Environments, 12(6): 644--657, 2003. Google ScholarDigital Library
- H. Sacks. Lectures on Conversation. Blackwell, 1995.Google ScholarCross Ref
- A. Steed, D. Roberts, R. Schroeder, and I. Heldal. Interaction between Users of Immersion Projection Technology Systems. HCI International 2005, the 11th International Conference on Human Computer Interaction, pages 22--27, 2005.Google Scholar
- W. Steptoe and A. Steed. High-Fidelity Avatar Eye-Representation. Virtual Reality Conference, 2008. VR '08. IEEE, pages 111--114, 2008.Google ScholarCross Ref
- R. Vertegaal. The GAZE groupware system: mediating joint attention in multiparty communication and collaboration. Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, pages 294--301, 1999. Google ScholarDigital Library
- R. Vertegaal, I. Weevers, C. Sohn, and C. Cheung. GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction. Proceedings of the conference on Human factors in computing systems, pages 521--528, 2003. Google ScholarDigital Library
- V. Vinayagamoorthy, M. Garau, A. Steed, and M. Slater. An Eye Gaze Model for Dyadic Interaction in an Immersive Virtual Environment: Practice and Experience. Computer Graphics Forum, 23(1): 1--11, 2004.Google ScholarCross Ref
- R. Wolff, D. Roberts, A. Murgia, et al. Communicating Eye Gaze across a Distance without Rooting Participants to the Spot. ACM DS-RT '08, 2008. Google ScholarDigital Library
Index Terms
Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments
Recommendations
The effect of avatar realism in immersive social virtual realities
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and TechnologyThis paper investigates the effect of avatar realism on embodiment and social interactions in Virtual Reality (VR). We compared abstract avatar representations based on a wooden mannequin with high fidelity avatars generated from photogrammetry 3D scan ...
The impact of eye gaze on communication using humanoid avatars
CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsIn this paper we describe an experiment designed to investigate the importance of eye gaze in humanoid avatar's representing people engaged in conversation. We compare responses to dyadic conversations in four mediated conditions: video, audio-only, and ...
The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment
CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThis paper presents an experiment designed to investigate the impact of scommunication in an immersive virtual environment.Participants were paired by gender and were randomly assigned to a CAVE-like system or a head-mounted display. Both were ...
Comments