skip to main content
10.1145/2786451.2786473acmconferencesArticle/Chapter ViewAbstractPublication PageswebsciConference Proceedingsconference-collections
research-article

Emotional States vs. Emotional Words in Social Media

Published:28 June 2015Publication History

ABSTRACT

A number of social media studies have equated people's emotional states with the frequency with which they use affectively positive and negative words in their posts. We explore how such word frequencies relate to a ground truth measure of both positive and negative emotion for 515 Facebook users and 448 Twitter users. We find statistically significant but very weak (ρ in the 0.1 to 0.2 range) correlations between positive and negative emotion-related words from the Linguistic Inquiry Word Count (LIWC) dictionary and a well-validated scale of trait emotionality called the Positive and Negative Affect Schedule (PANAS). We test this for tweets and Facebook status updates, focus on different time slices around the completion of the survey, and consider participants who report expressing emotions frequently on social media. With rare exception, this pattern of low correlation persists, suggesting that for the typical user, dictionary-based sentiment analysis tools may not be sufficient to infer how they truly feel.

References

  1. L. F. Barrett. Descriptions, and retrospective ratings of emotion. Personality & Social Psychology Bulletin, 23(i10):1100, 1997.Google ScholarGoogle Scholar
  2. J. Bollen, B. Gonçalves, G. Ruan, and H. Mao. Happiness is assortative in online social networks. Artificial life, 17(3):237--251, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. J. Bollen, A. Pepe, and H. Mao. Modeling public mood and emotion: Twitter sentiment and socio-economic phenomena. arXiv preprint arXiv:0911.1583, 2009.Google ScholarGoogle Scholar
  4. J. T. Cacioppo, W. L. Gardner, and G. G. Berntson. Beyond bipolar conceptualizations and measures: The case of attitudes and evaluative space. Personality and Social Psychology Review, 1(1):3--25, 1997.Google ScholarGoogle ScholarCross RefCross Ref
  5. R. B. Cialdini, R. E. Petty, and J. T. Cacioppo. Attitude and attitude change. Annual review of psychology, 32(1):357--404, 1981.Google ScholarGoogle Scholar
  6. L. Coviello, Y. Sohn, A. D. Kramer, C. Marlow, M. Franceschetti, N. A. Christakis, and J. H. Fowler. Detecting emotional contagion in massive social networks. PloS one, 9(3):e90315, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  7. J. Crocker and C. T. Wolfe. Contingencies of self-worth. Psychological review, 108(3):593, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  8. M. De Choudhury, M. Gamon, S. Counts, and E. Horvitz. Predicting depression via social media. In ICWSM, 2013.Google ScholarGoogle Scholar
  9. P. S. Dodds, K. D. Harris, I. M. Kloumann, C. A. Bliss, and C. M. Danforth. Temporal patterns of happiness and information in a global social network: Hedonometrics and twitter. PloS one, 6(12):e26752, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  10. B. L. Fredrickson. The role of positive emotions in positive psychology: The broaden-and-build theory of positive emotions. American psychologist, 56(3):218, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  11. D. Gildea and D. Jurafsky. Automatic labeling of semantic roles. Computational linguistics, 28(3):245--288, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. R. González-Ibánez, S. Muresan, and N. Wacholder. Identifying sarcasm in twitter: a closer look. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers- Volume 2, pages 581--586. Association for Computational Linguistics, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. A. Gruzd, S. Doiron, and P. Mai. Is happiness contagious online? a case of twitter and the 2010 winter olympics. In System Sciences (HICSS), 2011 44th Hawaii International Conference on, pages 1--9. IEEE, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. C. Hutto and E. Gilbert. Vader: A parsimonious rule-based model for sentiment analysis of social media text. In Eighth International AAAI Conference on Weblogs and Social Media, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  15. O. Irsoy and C. Cardie. Opinion mining with deep recurrent neural networks. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 720--728, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  16. A. M. Isen, K. A. Daubman, and G. P. Nowicki. Positive affect facilitates creative problem solving. Journal of personality and social psychology, 52(6):1122, 1987.Google ScholarGoogle Scholar
  17. L. Jiang, M. Yu, M. Zhou, X. Liu, and T. Zhao. Target-dependent twitter sentiment classification. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, pages 151--160. Association for Computational Linguistics, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. J. H. Kahn, R. M. Tobin, A. E. Massey, and J. A. Anderson. Measuring emotional expression with the linguistic inquiry and word count. The American journal of psychology, pages 263--286, 2007.Google ScholarGoogle Scholar
  19. A. D. Kramer. An unobtrusive behavioral model of gross national happiness. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 287--290. ACM, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. A. D. Kramer. The spread of emotion via facebook. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 767--770. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. A. D. Kramer, J. E. Guillory, and J. T. Hancock. Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences, 111(24):8788--8790, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  22. J. Kruschke. Doing Bayesian data analysis: A tutorial introduction with R. Academic Press, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. C. W. Leach, M. van Zomeren, S. Zebel, M. L. Vliek, S. F. Pennekamp, B. Doosje, J. W. Ouwerkerk, and R. Spears. Group-level self-definition and self-investment: a hierarchical (multicomponent) model of in-group identification. Journal of personality and social psychology, 95(1):144, 2008.Google ScholarGoogle Scholar
  24. A. R. McConnell. The multiple self-aspects framework: Self-concept representation and its implications. Personality and Social Psychology Review, 2010.Google ScholarGoogle Scholar
  25. S. M. Mohammad, S. Kiritchenko, and X. Zhu. Nrc-canada: Building the state-of-the-art in sentiment analysis of tweets. In Proceedings of the Second Joint Conference on Lexical and Computational Semantics (SEMSTARâĂŹ13), 2013.Google ScholarGoogle Scholar
  26. S. M. Mohammad, X. Zhu, and J. Martin. Semantic role labeling of emotions in tweets. ACL 2014, page 32, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  27. A. Pak and P. Paroubek. Twitter as a corpus for sentiment analysis and opinion mining. In LREC, volume 10, pages 1320--1326, 2010.Google ScholarGoogle Scholar
  28. M. Park, D. W. McDonald, and M. Cha. Perception differences between the depressed and non-depressed users in twitter. In Seventh International AAAI Conference on Weblogs and Social Media, 2013.Google ScholarGoogle Scholar
  29. J. W. Pennebaker, R. J. Booth, and M. E. Francis. Linguistic inquiry and word count: Liwc {computer software}. Austin, TX: liwc. net, 2007.Google ScholarGoogle Scholar
  30. D. Quercia, L. Capra, and J. Crowcroft. The social world of twitter: Topics, geography, and emotions. In ICWSM, 2012.Google ScholarGoogle Scholar
  31. D. Quercia, J. Ellis, L. Capra, and J. Crowcroft. Tracking gross community happiness from tweets. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, pages 965--968. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. R. S. Ritter, J. L. Preston, and I. Hernandez. Happy tweets: Christians are happier, more socially connected, and less analytical than atheists on twitter. Social Psychological and Personality Science, page 1948550613492345, 2013.Google ScholarGoogle Scholar
  33. S. Schachter and J. Singer. Cognitive, social, and physiological determinants of emotional state. Psychological review, 69(5):379, 1962.Google ScholarGoogle ScholarCross RefCross Ref
  34. N. Schwarz. Emotion, cognition, and decision making. Cognition & Emotion, 14(4):433--440, 2000.Google ScholarGoogle ScholarCross RefCross Ref
  35. Y. R. Tausczik and J. W. Pennebaker. The psychological meaning of words: Liwc and computerized text analysis methods. Journal of language and social psychology, 29(1):24--54, 2010.Google ScholarGoogle Scholar
  36. D. Watson, L. A. Clark, and A. Tellegen. Development and validation of brief measures of positive and negative affect: the panas scales. Journal of personality and social psychology, 54(6):1063, 1988.Google ScholarGoogle Scholar
  37. B. Yang and C. Cardie. Extracting opinion expressions with semi-markov conditional random fields. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 1335--1345. Association for Computational Linguistics, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Emotional States vs. Emotional Words in Social Media

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        WebSci '15: Proceedings of the ACM Web Science Conference
        June 2015
        366 pages
        ISBN:9781450336727
        DOI:10.1145/2786451

        Copyright © 2015 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 28 June 2015

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate218of875submissions,25%

        Upcoming Conference

        Websci '24
        16th ACM Web Science Conference
        May 21 - 24, 2024
        Stuttgart , Germany

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader