"Look!": using the gaze direction of embodied agents

ABSTRACT

This paper describes the results of three studies investigating an embodied agent that supports its interaction with the user by gazing at corresponding objects within its close environment. Three experiments were conducted in order to research whether users can detect an agent's line of sight, whether the agent's gaze direction can help to guide the users' attention towards designated locations and whether such a setup can be used to improve realistic interaction situations. The results show that a) users can detect the agent's gaze direction quickly (within 200 ms) but not very exactly, b) the use of the agent's gaze direction can speed up but also slow down the detection of objects in dependence on their location and c) that the agent's gaze towards corresponding objects during the interaction can have counterproductive effects in realistic settings.

REFERENCES

• 1: Bickmore, T.W. (2003). Relational Agents: Effecting Change through Human-Computer Relationships, Ph.D. Thesis, MIT.
• 2: Colburn, R.A., Cohen, M.F. and Drucker, S.M. (2000). The Role of Eye Gaze in Avatar Mediated Conversational Interfaces. Technical Report, MSR-TR-2000-81. Microsoft Research.
• 3: Clifford Nass , Jonathan Steuer , Ellen R. Tauber, Computers are social actors, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.72-78, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191703]
• 4: Byron Reeves , Clifford Nass, The media equation: how people treat computers, television, and new media like real people and places, Cambridge University Press, New York, NY, 1996
• 5: Ivo van Es , Dirk Heylen , Betsy van Dijk , Anton Nijholt, Gaze behavior of talking faces makes a difference, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506571]
• 6: Vernon, D. (2004). Cognitive Vision -- The Development of a Discipline, Proc. IST 2004 Event 'Participate in your future'.
• 7: www.haptek.com

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Human Factors

Keywords:
computer vision, embodied agent, gaze direction