ABSTRACT
Weather related tweets are user's comments about daily weather. We can gain useful information about how weather influence people's mood by analyzing them. This is what we called opinion mining in natural language processing field. Traditional opinion mining algorithm use feature engineering to build sentence model, and classifier like naive bayes is used for further classification. However, these feature vectors can sometimes be insufficient to represent the text, and they are manually designed, highly relevant to the problem's background. In this work1, we propose a method modeling text based on deep learning approach, which can automatically extract text feature. As for word's vector representation, we incorporate linguistic knowledge into word's representation, and use three different word representations in our model. The performance of the sentiment analysis system shows that our method is an efficient way analyzing user's sentiment on weather events.
- Pang, B. and Lee, L., 2008. Opinion mining and sentiment analysis. Foundations and Trends® in Information Retrieval, 2(1-2), pp. 1--135. Google ScholarDigital Library
- Hannak, A., Anderson, E., Barrett, L.F., Lehmann, S., Mislove, A. and Riedewald, M., 2012, June. Tweetin'in the Rain: Exploring Societal-Scale Effects of Weather on Mood. In ICWSM.Google Scholar
- Li, J., Wang, X. and Hovy, E., 2014, November. What a nasty day: Exploring mood-weather relationship from twitter. In proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (pp. 1309--1318). ACM. Google ScholarDigital Library
- Agarwal, A., Xie, B., Vovsha, I., Rambow, O. and Passonneau, R., 2011, June. Sentiment analysis of twitter data. In Proceedings of the workshop on languages in social media (pp. 30--38). Association for Computational Linguistics. Google ScholarDigital Library
- Pak, A. and Paroubek, P., 2010, May. Twitter as a corpus for sentiment analysis and opinion mining. In LREc (Vol. 10, No. 2010).Google Scholar
- LeCun, Y., Bengio, Y. and Hinton, G., 2015. Deep learning. Nature, 521(7553), pp. 436--444.Google ScholarCross Ref
- Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S. and Dean, J., 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems (pp. 3111--3119). Google ScholarDigital Library
- Mikolov, T., Karafiát, M., Burget, L., Cernocký, J. and Khudanpur, S., 2010, September. Recurrent neural network based language model. In Interspeech (Vol. 2, p. 3).Google Scholar
- Mikolov, T., Chen, K., Corrado, G. and Dean, J., 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781.Google Scholar
- Taboada, M., Brooke, J., Tofiloski, M., Voll, K. and Stede, M., 2011. Lexicon-based methods for sentiment analysis. Computational linguistics, 37(2), pp. 267--307. Google ScholarDigital Library
- Zhao, J., Dong, L., Wu, J. and Xu, K., 2012, August. Moodlens: an emoticon-based sentiment analysis system for chinese tweets. In Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 1528--1531). ACM. Google ScholarDigital Library
- Wang, S. and Manning, C.D., 2012, July. Baselines and bigrams: Simple, good sentiment and topic classification. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers-Volume 2 (pp. 90--94). Association for Computational Linguistics. Google ScholarDigital Library
- Pennington, J., Socher, R. and Manning, C., 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) (pp. 1532--1543).Google Scholar
- Tang, D., Wei, F., Qin, B., Yang, N., Liu, T. and Zhou, M., 2016. Sentiment embeddings with applications to sentiment analysis. IEEE Transactions on Knowledge and Data Engineering, 28(2), pp. 496--509. Google ScholarDigital Library
- Toutanova, K., Chen, D., Pantel, P., Poon, H., Choudhury, P. and Gamon, M., 2015, September. Representing Text for Joint Embedding of Text and Knowledge Bases. In EMNLP (Vol. 15, pp. 1499--1509).Google Scholar
- Ling, W., Luís, T., Marujo, L., Astudillo, R.F., Amir, S., Dyer, C., Black, A.W. and Trancoso, I., 2015. Finding function in form: Compositional character models for open vocabulary word representation. arXiv preprint arXiv:1508.02096.Google Scholar
- Kalchbrenner, N., Grefenstette, E. and Blunsom, P., 2014. A convolutional neural network for modelling sentences. arXiv preprint arXiv:1404.2188.Google Scholar
- Johnson, R. and Zhang, T., 2014. Effective use of word order for text categorization with convolutional neural networks. arXiv preprint arXiv:1412.1058.Google Scholar
- Yin, W., Schütze, H., Xiang, B. and Zhou, B., 2015. Abcnn: Attention-based convolutional neural network for modeling sentence pairs. arXiv preprint arXiv:1512.05193.Google Scholar
- Chen, D. and Manning, C., 2014. A fast and accurate dependency parser using neural networks. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) (pp. 740--750).Google Scholar
- Zhang, X., Zhao, J. and LeCun, Y., 2015. Character-level convolutional networks for text classification. In Advances in neural information processing systems (pp. 649--657). Google ScholarDigital Library
- Dos Santos, C.N. and Gatti, M., 2014, August. Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts. In COLING (pp. 69--78).Google Scholar
- Kim, Y., Jernite, Y., Sontag, D. and Rush, A.M., 2016, February. Character-Aware Neural Language Models. In AAAI (pp. 2741--2749). Google ScholarDigital Library
- Tang, D., Qin, B. and Liu, T., 2015, September. Document Modeling with Gated Recurrent Neural Network for Sentiment Classification. In EMNLP (pp. 1422--1432).Google Scholar
- Zaremba, W., Sutskever, I. and Vinyals, O., 2014. Recurrent neural network regularization. arXiv preprint arXiv:1409.2329.Google Scholar
- Sutskever, I., Vinyals, O. and Le, Q.V., 2014. Sequence to sequence learning with neural networks. In Advances in neural information processing systems (pp. 3104--3112). Google ScholarDigital Library
Index Terms
Sentiment Analysis Model on Weather Related Tweets with Deep Neural Network
Recommendations
Sentiment-Specific Representation Learning for Document-Level Sentiment Analysis
WSDM '15: Proceedings of the Eighth ACM International Conference on Web Search and Data MiningIn this paper, we propose a representation learning research framework for document-level sentiment analysis. Given a document as the input, document-level sentiment analysis aims to automatically classify its sentiment/opinion (such as thumbs up or ...
Extracting domain-specific opinion words for sentiment analysis
MICAI'12: Proceedings of the 11th Mexican international conference on Advances in Computational Intelligence - Volume Part IIIn this paper, we consider opinion word extraction, one of the key problems in sentiment analysis. Sentiment analysis (or opinion mining) is an important research area within computational linguistics. Opinion words, which form an opinion lexicon, ...
Joint sentiment/topic model for sentiment analysis
CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge managementSentiment analysis or opinion mining aims to use automated tools to detect subjective information such as opinions, attitudes, and feelings expressed in text. This paper proposes a novel probabilistic modeling framework based on Latent Dirichlet ...
Comments