Heimo Müller
ABSTRACT
We present an architectural model for adaptive interfaces based on eye-gaze patterns and facial expression analysis. In our approach, each basic visual sign can adapt its appearance and level of detail during the communication process. Atomic Communication Units (ACUs) -- analogous to graphical output primitives - encapsulate the intended denotation, the encoding of the message and a method for the judgment of the communication goal. We have analyzed feedback cycles in human-human communication tasks, and propose applications scenarios for ACUs.
- H. von Foerster, Cybernetics of Cybernetics (2nd edition), Future Systems, Minneapolis, (1996).Google Scholar
- P. Patrik, Intelligent User Interfaces -- Introduction and survey -- Research Report DKS03-01 / ICE 01, Delft University of Technology, (2003).Google Scholar
- E. Ross, Intelligent User Interfaces: Survey and Research Directions. Technical Report: CSTR-00-004, Bristol, (2000). Google ScholarDigital Library
- P. Langley, User modeling in adaptive interfaces. Proceedings of the Seventh International Conference on User Modeling. Banff, Alberta: Springer, (1999), pp. 357--370. Google ScholarDigital Library
- P. Brusilovsky, D. W. Cooper, Domain, task, and user models for an adaptive hypermedia performance support system, Proceedings of the 7th international conference on Intelligent user interfaces, (2002), pp. 23--30. Google ScholarDigital Library
- R. M. Young, T. R. G. Green, T. Simon, Programmable User Models for Predictive Evaluation of Interface Designs, in K. Bice and C. Lewis (eds.) Proceedings of CHI'89 Human Factors in Computing Systems, ACM Press, New York, (1989). Google ScholarDigital Library
- B. Myers, Creating User Interfaces by Demonstration, Academic Press, (1988). Google ScholarDigital Library
- W. Kintsch, Comprehension: A Paradigm for Cognition, MA: Cambridge University Press, (1998).Google Scholar
- Y. W. Sohn, & S. M. Doane, Evaluating Comprehension-Based User Models: Predicting Individual User Planning and Action. User Modeling and User Adapted Interaction. 12(2-3), (2002), pp. 171--205. Google ScholarDigital Library
- L. A. Suchman, Plans and Situated Actions, Cambride University Press (1987).Google Scholar
- G. Fischer, User Modeling in Human-Computer Interaction, in Human-Computer Interaction, User Modeling and User-Adapted Interaction Volume 11, Numbers 1-2 (2002), pp. 65--86. Google ScholarDigital Library
- D. D. Salvucci, An integrated model of eye movements and visual encoding. Cognitive Systems Research, 1(4) 2001, pp. 201--220. Google ScholarDigital Library
- D. D. Salvucci. J. R. Anderson, Intelligent Gaze-Added Interfaces, in Human Factors in Computing Systems: CHI 2000 Conference Proceedings. (2000), pp. 273--280. Google ScholarDigital Library
- P. Qvarfordt, S. Zhai: Conversing with the user based on eye-gaze patterns, Proceedings of the SIGCHI conference on Human factors in computing systems CHI 2005, ACM Press (2005), pp. 221--230. Google ScholarDigital Library
- B. Kiss, B. Benedek, G. Szijarto, B. Takacs: Closed Loop Dialog Model of Face-to-Face Communication with a Photo-Real Virtual Human, Visual Communications and Image Processing 2004 (EI25) SPIE Electronic Imaging, (2004).Google Scholar
- M. Argyle, M. Cook, Gaze and Mutual Gaze, Cambridge University Press, London, (1977).Google Scholar
- P. Ekman, W. Friesen, Unmasking the Face. A guide to recognizing emotions from facial expressions, Palo Alto: Consulting Psychologists Press, (1984).Google Scholar
- S. Morishima, Face Analysis and Synthesis, IEEE Signal Processing Magazine, Vol.18, No.3 (2001), pp.26--34.Google ScholarCross Ref
- M. Pantic, Facial gesture recognition from static dual-view face images, International Conference on Measuring Behaviour, (2002), pp. 195--197.Google Scholar
Index Terms
- Modelling "user understanding" in simple communication tasks
Recommendations
Exploring the design space for adaptive graphical user interfaces
AVI '06: Proceedings of the working conference on Advanced visual interfacesFor decades, researchers have presented different adaptive user interfaces and discussed the pros and cons of adaptation on task performance and satisfaction. Little research, however, has been directed at isolating and understanding those aspects of ...
Impact of screen size on performance, awareness, and user satisfaction with adaptive graphical user interfaces
CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsAdaptive personalization, where the system adapts the interface to a user's needs, has the potential for significant performance benefits on small screen devices. However, research on adaptive interfaces has almost exclusively focused on desktop ...
A grammar-free visual language-based communication
CompSysTech '12: Proceedings of the 13th International Conference on Computer Systems and TechnologiesIn previous work, dedicated grammars and methods from NLP have been adopted for interpreting and converting visual language-based messages into NL text and speech. However, we found that the selected techniques still restricted message creations. This ...
Comments