What is connected by mutual gaze?: user's behavior in video-mediated communication

ABSTRACT

Video-mediated communication systems such as teleconferencing and videophone have become popular. As with face-to-face communication, non-verbal cues such as gaze, facial expression, head orientation and gestures in visual systems play an important role. Existing systems, however, do not support mutual gaze because the lay-out of the camera and monitor is restricted. Thus, conversations using visual systems differ from those in face-to-face communication. This paper clarifies the problems of the video-mediated system, specifically for comparing the system with communication using eye-contact and with communication using no-eye-contact. This study focuses on the protocol of opening communication, e.g. establishment of a visual-audio link, person identification and confirmation of the acceptance of conversation. We conducted experiments using the two systems. Analysis of recorded video sequences revealed that the system using communication with eye-contact induced behavior similar to the system using face-to-face communication.

REFERENCES

• 1: Abigail J. Sellen , Sylvia B. Wilbur , Kathleen E. Finn, Video-Mediated Communication, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1997
• 2: Argyle, M. and Cook, M. Gaze and Mutual Gaze. London: Cambridge University Press. 1976.
• 3: David M. Grayson , Andrew F. Monk, Are you looking at me? Eye contact and desktop video conferencing, ACM Transactions on Computer-Human Interaction (TOCHI), v.10 n.3, p.221-243, September 2003 [doi>10.1145/937549.937552]
• 4: Hiroshi Ishii , Minoru Kobayashi, ClearBoard: a seamless medium for shared drawing and conversation with eye contact, Proceedings of the SIGCHI conference on Human factors in computing systems, p.525-532, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142977]
• 5: Milton Chen, Leveraging the asymmetric sensitivity of eye contact for videoconference, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503386]
• 6: Emanuel A. Schegloff, Beginnings in the telephone, Perpetual contact: mobile communication, private talk, public performance, Cambridge University Press, New York, NY, 2002
• 7: Ken-Ichi Okada , Fumihiko Maeda , Yusuke Ichikawaa , Yutaka Matsushita, Multiparty videoconferencing at virtual social distance: MAJIC design, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.385-393, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.193054]
• 8: Rosenthal, A.H. Two-way Television Communication Unit. US Pat. 2,420,198, 1947.
• 9: John Short, Ederyn Williams and Bruce Christie: The Social Psychology of Telecommunications, John Wiley & Sons, 1976
• 10: Vertegaahl, T., Van der Veer, G. C., and Vons, H. Effects of Gaze on Multiparty Mediated Communication. In Proc. Graphics Interface 2000 pp.95--102, 2000

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces

Keywords:
ethenographical approach, eye contact, gaze, video-mediated communication