skip to main content
10.1145/3011263.3011266acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

Analysis of gesture frequency and amplitude as a function of personality in virtual agents

Published: 12 November 2016 Publication History

Abstract

Embodied conversational agents are changing the way humans interact with technology. In order to develop humanlike ECAs they need to be able to perform natural gestures that are used in day-to-day conversation. Gestures can give insight into an ECAs personality trait of extraversion, but what factors into it is still being explored. Our study focuses on two aspects of gesture: amplitude and frequency. Our goal is to find out whether agents should use specific gestures more frequently than others depending on the personality type they have been designed with. We also look to quantify gesture amplitude and compare it to a previous study on the perception of an agent's naturalness of its gestures. Our results showed some indication that introverts and extraverts judge the agent's naturalness similarly. The larger the amplitude our agent used, the more natural its gestures were perceived. The frequency of gestures between extraverts and introverts seem to contain hardly any difference, even in terms of types of gesture used.

References

[1]
Bergmann, K., Kopp, S., & Eyssel, F. (2010, September). Individualized gesturing outperforms average gesturing-evaluating gesture production in virtual humans. In International Conference on Intelligent Virtual Agents, 104--117.
[2]
Bond, P. (2011). "Video game sales on winning streak, study projects." Reuters. Retrieved (2011): 03--12.
[3]
Cafaro, A., Vilhjálmsson, H. H., Bickmore, T., Heylen, D., Jóhannsdóttir, K. R., Valgarðsson, G. S. (2012). First impressions: Users' judgments of virtual agents' personality and interpersonal attitude in first encounters. In Intelligent Virtual Agents, 67--80.
[4]
Cerekovic, A., Aran, O., & Gatica-Perez, D. (2014, September). How do you like your virtual agent?: Human-agent interaction experience through nonverbal features and personality traits. In International Workshop on Human Behavior Understanding, 1--15.
[5]
Clausen-Bruun, M., Ek, T., and Haake, M. (2013). Size certainly matters at least if you are a gesticulating digital character: The impact of gesture amplitude on addressee's information uptake. In Intelligent Virtual Agents, 446.
[6]
Hu, C., Walker, M. A., Neff, M., & Tree, J. E. F. (2015, August). Storytelling agents with personality and adaptivity. In International Conference on Intelligent Virtual Agents, 181--193.
[7]
Jung, C.: Psychological types. In The collected works of C. G. Jung. Volume 6., Princeton, NJ, Princeton University Press (1971, originally 1921)
[8]
Hostetter, Autumn B., and Andrea L. Potthoff. "Effects of personality and social situation on representational gesture production." Gesture 12.1 (2012): 62--83.
[9]
Kendon, A. (1980). Gesticulation and speech: Two aspects of the process of utterance. In M.R. Key (Ed.) The Relationship of Verbal and Nonverbal communication. The Hague, NL: Mouton Publishers.
[10]
Kendon, A. (1986). Some reasons for studying gesture. Semiotica 62, 3--28.
[11]
Kendon, A. (1994). Do gestures communicate?: A review. Research on Language and Social Interaction, 27, 175--200.
[12]
Kipp, Michael; Kipp, Kerstin H.; Ndiaye, Alassane; Patrick (2006), Evaluating the tangible interface and virtual characters in the interactive COHIBIT exhibit, Proceedings of the International Conference on Intelligent Virtual Agents, 434--444.
[13]
McNeill, D. (1985). So you think gestures are nonverbal? Psychological Review, 3, 350--371.
[14]
Mehrabian, A. and Ferris, S.R. (1967). Inference of attitude from non-verbal communication in two channels. The Journal of Councelling Psychology, 31, 248--252.
[15]
Myers, I.B., Myers, P.B.: Gifts differing. Consulting Psychologists Press (1980)
[16]
Neff, M., Kipp, M., Albrecht, I., and Seidel, H. P. (2008). Gesture modeling and animation based on a probabilistic recreation of speaker style. ACM Transactions on Graphics, 27(1), 5.
[17]
Neff. M., Wang, Y., Abbot, R. and Walker, M. (2010). Evaluating the effect of gesture and language on personality perception in conversational agents. In J. Allbeck et al. (Eds.): Proceedings of the International Conference on Intelligent Virtual Agents, 222--235
[18]
Niedenthal, Paula M., et al. (2010). The Simulation of Smiles (SIMS) model: Embodied simulation and the meaning of facial expression." Behavioral and Brain Sciences 33.06. 417--433.
[19]
Novick, David, and Gris, I. (2014) "Building rapport between human and ECA: A pilot study." International Conference on Human-Computer Interaction, 472--480.
[20]
http://similarminds.com/jung_word_pair.html

Cited By

View all
  • (2024)An architecture for integrating social interaction in upper-limb rehabilitationInternational Journal of Intelligent Robotics and Applications10.1007/s41315-024-00382-7Online publication date: 12-Nov-2024
  • (2018)Developing a New Brand of Culturally-Aware Personal Robots Based on Local Cultural Practices in the Danish Health Care System2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS.2018.8594478(2002-2007)Online publication date: 1-Oct-2018

Index Terms

  1. Analysis of gesture frequency and amplitude as a function of personality in virtual agents

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    MA3HMI '16: Proceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction
    November 2016
    64 pages
    ISBN:9781450345620
    DOI:10.1145/3011263
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 12 November 2016

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. amplitude
    2. embodied conversational agents
    3. extravert
    4. frequency
    5. gesture
    6. introvert
    7. personality

    Qualifiers

    • Research-article

    Conference

    ICMI '16

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)15
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 24 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)An architecture for integrating social interaction in upper-limb rehabilitationInternational Journal of Intelligent Robotics and Applications10.1007/s41315-024-00382-7Online publication date: 12-Nov-2024
    • (2018)Developing a New Brand of Culturally-Aware Personal Robots Based on Local Cultural Practices in the Danish Health Care System2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS.2018.8594478(2002-2007)Online publication date: 1-Oct-2018

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media