Erik Aumayr
ABSTRACT
Maintaining online communities is vital in order to increase and retain their economic and social value. That is why community managers look to gauge the success of their communities by measuring a variety of user behaviour, such as member activity, turnover and interaction. However, such communities vary widely in their purpose, implementation and user demographics, and although many success indicators have been proposed in the literature, we will show that there is no one-fits-all approach to community success: Different success criteria depend on different user behaviour. To demonstrate this, we put together a set of user behaviour features, including many that have been used in the literature as indicators of success, and then we define and predict community success in three different types of online communities: Questions & Answers (Q&A), Healthcare and Emotional Support (Life & Health), and Encyclopaedic Knowledge Creation. The results show that it is feasible to relate community success to specific user behaviour with an accuracy of 0.67--0.93 F1 score and 0.77--1.0 AUC.
- Sofia Angeletou, Matthew Rowe, and Harith Alani. 2011. Modelling and analysis of user behaviour in online communities. In The Semantic Web-ISWC. Springer. Google Scholar
Digital Library
- Arthur Armstrong and John Hagel III. 1996. The real value of online communities. Harvard Business Review 74 (1996).Google Scholar
- Erik Aumayr and Conor Hayes. 2017. Separating the Wheat from the Chaff: Evaluating Success Determinants for Online Q&A Communities. In ICWSM.Google Scholar
- Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural language processing with Python: analyzing text with the natural language toolkit. O'Reilly Media. Google ScholarDigital Library
- Carl Hugo Björnsson. 1968. Läsbarhet. Liber.Google Scholar
- Leo Breiman. 2001. Random forests. Machine learning (2001). Google ScholarDigital Library
- Aidan Budd, Manuel Corpas, and others. 2015. A Quick Guide for Building a Successful Bioinformatics Community. PLOS Computational Biology (2015).Google Scholar
- Jacques Bughin and John Hagel III. 2000. The Operational Performance of Virtual Communities - Towards a Successful Business Model? Electronic Markets (2000).Google Scholar
- Brian S. Butler and Xiaoqing Wang. 2012. The Cross-Purposes of Cross-Posting: Boundary Reshaping Behavior in Online Discussion Communities. Information Systems Research (2012). Google ScholarDigital Library
- Justin Cheng, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2015. Antisocial Behavior in Online Discussion Communities. http://arxiv.org/abs/1504.00680Google Scholar
- Morakot Choetkiertikul, Hoa Khanh Dam, Truyen Tran, and Aditya Ghose. 2015. Characterization and Prediction of Issue-Related Risks in Software Projects. In Working Conference on Mining Software Repositories. IEEE Press. Google ScholarDigital Library
- David Wagner and others. 2015. Zum Status von Social-Media- und Community-Management in D-A-CH. Technical Report. Bundesverband Community Management e.V. für digitale Kommunikation und Social-Media. https://www.bvcm.org/wp-content/uploads/2015/10/151026-BVCM-Studie-Report.pdfGoogle Scholar
- William H. DeLone and Ephraim R. McLean. 1992. Information systems success: The quest for the dependent variable. IS research (1992). Google ScholarDigital Library
- William H. DeLone and Ephraim R. McLean. 2003. The DeLone and McLean model of information systems success: a ten-year update. Journal of management information systems (2003). Google ScholarDigital Library
- Vedat Diker. 2004. A Dynamic Feedback Framework for Studying Growth Policies in Open Online Collaboration Communities. AMCIS Proceedings (2004).Google Scholar
- Khe Foon Hew. 2009. Determinants of success for online communities: an analysis of three communities in terms of members' perceived professional development. Behaviour and Information Technology (2009).Google Scholar
- Philippa A. Hiscock, Athanassios N. Avramidis, and Jörg Fliege. 2015. Predicting Micro-Level Behavior in Online Communities for Risk Management. In Data Science, Learning by Latent Structures, and Knowledge Discovery. Springer.Google Scholar
- Alicia Iriberri and Gondy Leroy. 2009. A Life-cycle Perspective on Online Community Success. ACM Computing Surveys (CSUR) (2009). Google ScholarDigital Library
- Aditya Johri, Oded Nov, and Raktim Mitra. 2011. Environmental jolts: Impact of exogenous factors on online community participation. In ACM CSCW. Google ScholarDigital Library
- J. Koh and Y.-G Kim. 2004. Knowledge sharing in virtual communities: an e-business perspective. Expert Systems with Applications (2004).Google Scholar
- N. Korfiatis, E. García-Bariocanal, and S. Sánchez-Alonso. 2012. Evaluating content quality and helpfulness of online product reviews: The interplay of review helpfulness vs. review content. E-Commerce Research and Appl. (2012). Google ScholarDigital Library
- Robert E. Kraut, Paul Resnick, and others. 2012. Building Successful Online Communities: Evidence-Based Social Design. MIT Press. Google ScholarDigital Library
- Miron B. Kursa and Witold R. Rudnicki. 2010. Feature Selection with the Boruta Package. Journal of Statistical Software (2010).Google Scholar
- Andrea Lancichinetti, Filippo Radicchi, José J. Ramasco, and Santo Fortunato. 2011. Finding statistically significant communities in networks. PlOS ONE (2011).Google Scholar
- J. Lazar and J. Preece. 2002. Social considerations in online communities: Usability, sociability, and success factors. In Cognition in A Digital World.Google Scholar
- Jan Marco Leimeister, Pascal Sidiras, and Helmut Krcmar. 2004. Success factors of virtual communities from the perspective of members and operators: An empirical study. In HICSS. IEEE.Google Scholar
- Eldon Y. Li. 1997. Perceived importance of information system success factors: A meta analysis of group differences. Information & Management (1997). Google ScholarDigital Library
- Hui Lin, Weiguo Fan, Linda Wallace, and Zhongju Zhang. 2007. An empirical study of web-based knowledge community success. In HICCS. Google ScholarDigital Library
- Hsiu-Fen Lin. 2008. Determinants of successful virtual communities: Contributions from system characteristics and social factors. Inform. & Mgmt (2008). Google ScholarDigital Library
- Lithium Technologies Inc. 2011. Community Health Index for Online Communities. Technical Report. http://www.lithium.com/pdfs/whitepapers/Lithium-Community-Health-Index_v1AY2ULb.pdfGoogle Scholar
- Y. Liu, J. Bian, and E. Agichtein. 2008. Predicting information seeker satisfaction in community question answering. In ACM SIGIR conference on R&D in IR. Google ScholarDigital Library
- Xianghua Lu, Chee Wei Phang, and Jie Yu. 2011. Encouraging participation in virtual communities through usability and sociability development: An empirical investigation. ACM SIGMIS Database (2011). Google ScholarDigital Library
- Kevin Kyung Nam, Mark S. Ackerman, and Lada A. Adamic. 2009. Questions in, knowledge in?: A study of naver's question answering community. In SIGCHI Human Factors in Computing Systems. ACM. Google ScholarDigital Library
- Akshay Patil, Juan Liu, and Jie Gao. 2013. Predicting group stability in online social networks. In World Wide Web. Google ScholarDigital Library
- Jenny Preece. 2001. Sociability and usability in online communities: Determining and measuring success. Behaviour & Information Technology (2001).Google Scholar
- Xiangju Qin, Michael Salter-Townshend, and Pádraig Cunningham. 2014. Exploring the relationship between membership turnover and productivity in online communities. In ICWSM.Google Scholar
- Daphne R. Raban, Mihai Moldovan, and Quentin Jones. 2010. An empirical study of critical mass and online community survival. In Computer Supported Cooperative Work. ACM. Google ScholarDigital Library
- Sam Ransbotham and Gerald C. Kane. 2011. Membership turnover and collaboration success in online communities: Explaining rises and falls from grace in Wikipedia. MIS Quarterly (2011). Google ScholarDigital Library
- Inbal Ronen and others. 2011. Metrics and Requirements Update for Employee Use Case. ROBUST EU Project Deliverable. http://www.robust-project.eu/results/metrics-and-requirements-update-for-employee-use-case/at_download/fileGoogle Scholar
- Matthew Rowe and Harith Alani. 2012. What makes communities tick? Community health analysis using role compositions. In International Conference on Social Computing. IEEE. Google ScholarDigital Library
- Matthew Rowe, Miriam Fernandez, Sofia Angeletou, and Harith Alani. 2013. Community analysis through semantic rules and role composition derivation. Journal of Web Semantics (2013). Google ScholarDigital Library
- Sunanda Sangwan. 2005. Virtual community success: A uses and gratifications perspective. In Hawaii International Conference on System Sciences. IEEE. Google ScholarDigital Library
- Felix Schwagereit, Sergej Sizov, and Steffen Staab. Finding optimal policies for online communities with cosimo. In Web Science Conference.Google Scholar
- Trent J. Spaulding. 2010. How can virtual communities create value for business? E-Commerce Research and Applications (2010).Google Scholar
- Mike Thelwall, Kevan Buckley, Georgios Paltoglou, Di Cai, and Arvid Kappas. 2010. Sentiment strength detection in short informal text. Journal of the American Society for Information Science and Technology (2010). Google ScholarDigital Library
- S. L. Toral, M. Rocío Martínez-Torres, F. Barrero, and F. Cortés. 2009. An empirical study of the driving forces behind online communities. Internet Research (2009).Google Scholar
- Saskia Vola. 2010. Simple Metrics for Text Mining. Technical Report. Temis Deutschland GmbH. http://saskia-vola.com/simple-metrics-for-textmining/Google Scholar
- David Wagner, Alexander Richter, Matthias Trier, and Heinz-Theo Wagner. 2014. Towards a Conceptualization of Online Community Health. In Inform. Systems.Google Scholar
- Xiaoqing Wang and Shannon Lantzy. 2011. A Systematic Examination of Member Turnover and Online Community Health. In ICIS.Google Scholar
- G. Whyte, A. Bytheway, and C. Edwards. 1997. Understanding user perceptions of information systems success. Journal of Strategic Information Systems (1997).Google Scholar
- Anbang Xu, Jilin Chen, Tara Matthews, and others. 2013. CommunityCompare: visually comparing communities for online community leaders in the enterprise. In SIGCHI Conference on Human Factors in Computing Systems. ACM. Google ScholarDigital Library
- Colleen Young. 2013. Community Management That Works: How to Build and Sustain a Thriving Online Health Community. Medical Internet Research (2013).Google Scholar
- Lixiu Yu, Paul André, Aniket Kittur, and Robert Kraut. 2014. A comparison of social, learning, and financial strategies on crowd engagement and output quality. In Computer supported cooperative work & social computing. ACM. Google ScholarDigital Library
- Y. Zheng, K. Zhao, and A. Stylianou. 2009. Information quality and system quality in online communities: an empirical investigation. SIGHCI (2009).Google Scholar
- Haiyi Zhu, Robert E. Kraut, and Aniket Kittur. 2014. The impact of membership overlap on the survival of online communities. In SIGCHI Conference on Human Factors in Computing Systems. ACM. Google ScholarDigital Library
Index Terms
- The path to success: a study of user behaviour and success criteria in online communities
Recommendations
Are All Successful Communities Alike? Characterizing and Predicting the Success of Online Communities
WWW '19: The World Wide Web ConferenceThe proliferation of online communities has created exciting opportunities to study the mechanisms that explain group success. While a growing body of research investigates community success through a single measure - typically, the number of members - ...
Talk to me: foundations for successful individual-group interactions in online communities
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsPeople come to online communities seeking information, encouragement, and conversation. When a community responds, participants benefit and become more committed. Yet interactions often fail. In a longitudinal sample of 6,172 messages from 8 Usenet ...
Stimulation of activity in online communities
ECCE '11: Proceedings of the 29th Annual European Conference on Cognitive ErgonomicsMotivation -- Identify the factors that relate to the activity within a community, to derive a framework which can be used to stimulate activity in both new and existing online communities and to test the effectiveness of the framework.
Research ...
Comments