Gaze-based infotainment agents

ABSTRACT

We propose an infotainment presentation system that relies on eyegaze as an intuitive and unobtrusive input modality. The system analyzes eye movements in real-time to infer users' attention, visual interest, and preference regarding interface objects. The application consists of a virtual showroom where a team of two highly realistic 3D agents presents product items in an entertaining and attractive way. The presentation flow adapts to the user's attentiveness and interest, or lack thereof, and thus provides a more personalized and user-attentive experience of the presentation.

REFERENCES

• 1: Joseph Bates, The role of emotion in believable agents, Communications of the ACM, v.37 n.7, p.122-125, July 1994 [doi>10.1145/176789.176803]
• 2: N. Bee, H. Prendinger, A. Nakasone, E. André, and MIshizuka. AutoSelect: What You Want Is What You Get. all Real-time processing of visual attention and affect. In Tutorial and Research Workshop on Perception and Interactive all Technologies (PIT-06)}, pages 40--52. Springer LNCS 4021, 2006.
• 3: H.H. Clark and S.E. Brennan. Grounding in communication. In L.B. Resnick, J.M. Levine, and S.D. Teasley, editors, all Perspectives on Socially Shared Cognition, pages 127--149. APA Books, WA, 1991.
• 4: H.H. Clark and S.E. Brennan. Grounding in communication. In L.B. Resnick, J.M. Levine, and S.D. Teasley, editors, all Perspectives on Socially Shared Cognition, pages 127--149. APA Books, WA, 1991.
• 5: Mark Maybury , Oliviero Stock , Wolfgang Wahlster, Intelligent Interactive Entertainment Grand Challenges, IEEE Intelligent Systems, v.21 n.5, p.14-18, September 2006 [doi>10.1109/MIS.2006.98]
• 6: Yukiko I. Nakano , Gabe Reinstein , Tom Stocky , Justine Cassell, Towards a model of face-to-face grounding, Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, p.553-561, July 07-12, 2003, Sapporo, Japan [doi>10.3115/1075096.1075166]
• 7: M. Nischt, H. Prendinger, E. André, and M. Ishizuka. MPML3D: a reactive framework for the Multimodal Presentation all Markup Language. In Proceedings 6th International Conference on Intelligent all Virtual Agents (IVA-06)}, Springer LNAI 4133, pages 218--229, 2006.
• 8: Helmut Prendinger , Mitsuru Ishizuka, Life-Like Characters: Tools, Affective Functions, and Applications (Cognitive Technologies), SpringerVerlag, 2004
• 9: Helmut Prendinger , Chunling Ma , Mitsuru Ishizuka, Eye movements as indices for the utility of life-like interface agents: A pilot study, Interacting with Computers, v.19 n.2, p.281-292, March, 2007 [doi>10.1016/j.intcom.2006.10.004]
• 10: Pernilla Qvarfordt , Shumin Zhai, Conversing with the user based on eye-gaze patterns, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055004]
• 11: T. Rist, E. André, S. Baldes, P. Gebhard, M. Klesen, M. Kipp, P. Rist, and M. Schmitt. A review of the development of embodied presentation agents and their allappication fields. In Prendinger and Ishizuka Prendinger+Ishizuka.2004, pages 377--404.
• 12: Seeing Machines. Seeing Machines, 2005. http://www.seeingmachines.com/.
• 13: T. Selker, Visual Attentive Interfaces, BT Technology Journal, v.22 n.4, p.146-150, October 2004 [doi>10.1023/B:BTTJ.0000047593.70147.df]
• 14: S. Shimojo, C. Simion, E. Shimojo, and C. Scheier. Gaze bias both reflects and influences preference. Nature Neuroscience, 6(12):1317--1322, 2003.
• 15: Candace L. Sidner , Cory D. Kidd , Christopher Lee , Neal Lesh, Where to look: a study of human-robot engagement, Proceedings of the 9th international conference on Intelligent user interfaces, January 13-16, 2004, Funchal, Madeira, Portugal [doi>10.1145/964442.964458]
• 16: India Starker , Richard A. Bolt, A gaze-responsive self-disclosing display, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.3-10, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97245]
• 17: Boris M. Velichkovsky , John Paulin Hansen, New technological windows into mind: there is more in eyes and brains for human-computer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.496-503, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238619]
• 18: Roel Vertegaal , Robert Slagter , Gerrit van der Veer , Anton Nijholt, Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes, Proceedings of the SIGCHI conference on Human factors in computing systems, p.301-308, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365119]
• 19: Shumin Zhai, What's in the eyes for attentive input, Communications of the ACM, v.46 n.3, March 2003 [doi>10.1145/636772.636795]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Theory and methods

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation); Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Human Factors

Keywords:
eye tracking, interest recognition, multi-modal presentation, preference detection