Experiments with a robotic computer: body, affect and cognition interactions

ABSTRACT

We present RoCo, the first robotic computer designed with the ability to move its monitor in subtly expressive ways that respond to and encourage its user¿s own postural movement. We use RoCo in a novel user study to explore whether a computer¿s "posture" can in fluence its use''s subsequent posture, and if the interaction of the user's body state with their affective state during a task leads to improved task measures such as persistence in problem solving. We believe this is possible in light of new theories that link physical posture and its in uence on affect and cognition. Initial results with 71 subjects support the hypothesis that RoCo's posture not only manipulates the user¿s posture, but also is associated with hypothesized posture-affect interactions. Specifically, we found effects on increased persistence on a subsequent cognitive task, and effects on perceived level of comfort.

REFERENCES

• 1: M. Argyle. Bodily Communication. Methuen and Co. Ltd., New York, NY, 1988.
• 2: B. Blumberg, R. Burke, D. Isla, M. Downie, and Y. Ivanov. CreatureSmarts: The art and architecture of a virtual brain. In Game Developers Conference, pages 147--166, 2001.
• 3: Cynthia Breazeal, Designing Sociable Robots, MIT Press, Cambridge, MA, 2002
• 4: Cynthia Breazeal , Daphna Buchsbaum , Jesse Gray , David Gatenby , Bruce Blumberg, Learning From and About Others: Towards Using Imitation to Bootstrap the Social Understanding of Others by Robots, Artificial Life, v.11 n.1-2, p.31-62, January 2005 [doi>10.1162/1064546053278955]
• 5: L. Chirstensen and K. Menzel. The linear relationship between student reports of teacher immediacy behaviors and perception of state motivation, and of cognitive, affective, and behavioral learning. Communcation Education, 47:82--90, 1998.
• 6: S. Duclos, J. Laird, E. Schneider, M. Sexter, L. Stern, and O. Van Lighten. Emotion-specific effects of facial expressions and postures on emotional experience. Journal of Personality and Social Psychology, 57:100--108, 1989.
• 7: R. el Kaliouby and P. Robinson. Real-Time Vision for Human-Computer Interaction, chapter Real-time Inference of Complex Mental States from Facial Expressions and Head Gestures, pages 181--200. Springer-Verlag, 2005.
• 8: F. Faiks and S. Reinecke. Investigation of spinal curvature while changing one's posture during sitting. Contemporary Ergonomics, 1998.
• 9: J. Glass and J. Singer. Urban Stress. Academic Press, New York, NY, 1972.
• 10: W. Hartup. Cooperation, Close Relationships, and Cognitive Development. Cambridge University, Cambridge, 1996.
• 11: E. Hatfield, J. Cacioppo, and R. Rapson. Emotion Contagion. Cambridge University Press, New York, NY, 1994.
• 12: A. M. Isen. Positive affect and decision making. In M. Lewis and J. Haviland, editors, Handbook of Emotions. Guilford, New York, 2 edition, 2000.
• 13: D. K. Isen, A. and G. Nowicki. Positive affect facilitates creative problem solving. Journal of Personality and Social Psychology, 52:1122--1131, 1987.
• 14: J. Lerner, D. Small, and L. G. Heart strings and purse strings: Carryover effects of emotions on economic decisions. Psychological Science, 15(5):337--341, May 2004.
• 15: S. Mota and R. W. Picard. Automated posture analysis for detecting learner's interest level. In Workshop on Computer Vision and Pattern Recognition for Human-Computer Interaction, CVPR, HCI, Madison, WI, 2003. IEEE Computer Society.
• 16: Clifford Nass , Ing-Marie Jonsson , Helen Harris , Ben Reaves , Jack Endo , Scott Brave , Leila Takayama, Improving automotive safety by pairing driver emotion and car voice emotion, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1057070]
• 17: S. Reinecke, T. Bevins, J. Weisman, M. Krag, and M. Pope. The relationship between seating postures and low back pain. In Rehabilitation Engineering Society in North Ameriac, 8th Annual Conference, 1995.
• 18: V. Richmond and J. McCroskey. Immediacy, Nonverbal Behavior in Interpersonal Relations. Allyn and Bacon, Boston, MA, 1995.
• 19: J. Riskind. They stoop to conquer: Guiding and self-regulatory functions of physical posture after success and failure. Journal of Personality and Social Psychology, 47:479--493, 1984.
• 20: J. Riskind and C. Gotay. Physical posture: Could it have regulatory or feedback effects upon motivation and emotion? Motivation and Emotion, 6:273--296, 1982.
• 21: C. Rose, B. Bodenheimer, and M. Cohen. Verbs and adverbs. In press: Computer Graphics and Animation, 1998.
• 22: R. R. Rottenberg, J. and J. Gross. Emotion elicitation using films. Oxford University Press, New York, NY, 2004.
• 23: N. Schwartz. Situated cognition and the wisdom in feelings: Cognitive tuning. In L. F. Barrett and P. Salovey, editors, The Wisdom in Feeling, pages 144--166. The Guilford Press, 2002.
• 24: V. Wilson and E. Peper. The effects of upright and slumped postures on recall of postive and negative thoughts. Applied Psychophysiology and Biofeedback, 29:189--195, 2004.

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.4 SOCIAL AND BEHAVIORAL SCIENCES

General Terms:
Experimentation, Human Factors

Keywords:
affect, embodiment, human-robot interaction, user studies