skip to main content
10.1145/1690388.1690398acmotherconferencesArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
research-article

An intelligent agent with affect sensing from metaphorical language and speech

Published: 29 October 2009 Publication History

Abstract

We report new developments on affect detection from textual metaphorical affective expression and affect sensing from speech. The textual affect detection component has been embedded in an intelligent conversational AI agent interacting with human users under loose scenarios. The detected affective states from text also play an important role in producing emotional animation for users' avatars. Evaluation of the affect detection from speech and text is provided. Our work contributes to the conference themes on affective computing and ambient intelligence, human-robots interaction, multimodal interaction, narrative storytelling in education and evaluation of affective social interaction.

References

[1]
Amir, N and Cohen. R. 2007. Characterizing Emotion in the Soundtrack of an Animated Film: Credible or Incredible? In Proceedings of ACII 2007, ACM, Springer, 148--158.
[2]
ATT-Meta Project Databank: Examples of Usage of Metaphors of Mind. July 2008. http://www.cs.bham.ac.uk/~jab/ATT-Meta/Databank/.
[3]
Aylett, R., Louchart, S., Dias, J., Paiva, A., Vala M., Woods, S. Hall, L. E. 2006. Unscripted Narrative for Affectively Driven Characters. IEEE Computer Graphics and Applications 26(3). 42--52.
[4]
Boucouvalas, A. C. 2002. Real Time Text-to-Emotion Engine for Expressive Internet Communications. In Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments. G. Riva, F. Davide and W. IJsselsteijn (eds.), 305--318.
[5]
Cavazza, M., Smith, C., Charlton, D., Zhang, L., Turunen, M. and Hakulinen, J. 2008. A 'Companion' ECA with Planning and Activity Modelling. In Proceedings of AAMAS'08. Portugal, 1281--1284.
[6]
Cichosz, J. and Slot, K. 2007. Emotion recognition in speech signal using emotion-extracting binary decision trees. Doctoral Consortium. ACII 2007, ACM, Springer.
[7]
Craggs, R. & Wood. M. 2004. A Two Dimensional Annotation Scheme for Emotion in Dialogue. In Proceedings of AAAI Spring Symposium: Exploring Attitude and Affect in Text.
[8]
Egges, A., Kshirsagar, S. & Magnenat-Thalmann, N. 2003. A Model for Personality and Emotion Simulation, In Proceedings of Knowledge-Based Intelligent Information & Engineering Systems (KES2003), Lecture Notes in AI. Springer-Verlag: Berlin, 453--461.
[9]
Elliott, C., Rickel, J. & Lester, J. 1997. Integrating Affective Computing into Animated Tutoring Agents. In Proceedings of IJCAI'97 Workshop on Intelligent Interface Agents, 113--121.
[10]
Glynn, D. 2002. Love and Anger. The grammatical structure of conceptual metaphors. Cognitive Approaches to Metaphor. Style 36: 541--559.
[11]
Grimm, M., Kroschel, K., Harris, H., Nass, C., Schuller, B., Rigoll, G. and Moosmayr, T. 2007. On the Necessity and Feasibility of Detecting a Driver's Emotional State While Driving. In Proceedings of ACII 2007, Lisbon, ACM, Springer, 126--138.
[12]
Kövecses, Z. 1998. Are There Any Emotion-Specific Metaphors? In Speaking of Emotions: Conceptualization and Expression. Berlin and New York: Mouton de Gruyter, 127--151.
[13]
Liu, H. & Singh, P. 2004. ConceptNet: A practical commonsense reasoning toolkit. BT Technology Journal, Volume 22, Kluwer Academic Publishers.
[14]
Mateas, M. 2002. Ph.D. Thesis. Interactive Drama, Art and Artificial Intelligence. School of Computer Science, Carnegie Mellon University.
[15]
Murray, I. R. and Arnott, J. L. 1995. Implementation and testing of a system for producing emotion-by-rule in synthetic speech. Speech Communication (16), 369--390.
[16]
Nogueiras, A., Moreno, A., Bonafante, A. and Maririo. J. 2001. Speech Emotion Recognition Using Hidden Markov Models, Eurospeech 2001, 2679--2682.
[17]
Oudeyer, P. Y. 2003. The production and recognition of emotions in speech: features and algorithms, International Journal in Human-Computer Studies, vol. 59/1--2, 157--183, Special Issue on Affective Computing.
[18]
Rayson, P. 2003. Matrix: A statistical method and software tool for linguistic analysis through corpus comparison. Ph.D. thesis, Lancaster University.
[19]
Shaikh, M. A. M., Prendinger, H. & Mitsuru, I. 2007. Assessing sentiment of text by semantic dependency and contextual valence analysis. In Proceeding of ACII.
[20]
Zhang, L., Barnden, J. A., Hendley, R. J., Lee, M. G., Wallington, A. M. and Wen, Z. 2008. Affect Detection and Metaphor in E-drama. Int. J. Continuing Engineering Education and Life-Long Learning, Vol 18(2), 234--252.
[21]
Zhe, X. & Boucouvalas, A. C. 2002. Text-to-Emotion Engine for Real Time Internet Communication. In Proceedings of International Symposium on Communication Systems, Networks and DSPs, Staffordshire University, UK, 164--168.

Index Terms

  1. An intelligent agent with affect sensing from metaphorical language and speech

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      ACE '09: Proceedings of the International Conference on Advances in Computer Entertainment Technology
      October 2009
      456 pages
      ISBN:9781605588643
      DOI:10.1145/1690388
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      • Foundation of the Hellenic World

      In-Cooperation

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 29 October 2009

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. affect sensing
      2. anger metaphor
      3. emotional speech recognition

      Qualifiers

      • Research-article

      Conference

      ACE '09
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 36 of 90 submissions, 40%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 309
        Total Downloads
      • Downloads (Last 12 months)2
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 15 Feb 2025

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media