Churn prediction in new users of Yahoo! answers

ABSTRACT

One of the important targets of community-based question answering (CQA) services, such as Yahoo! Answers, Quora and Baidu Zhidao, is to maintain and even increase the number of active answerers, that is the users who provide answers to open questions. The reasoning is that they are the engine behind satisfied askers, which is the overall goal behind CQA. Yet, this task is not an easy one. Indeed, our empirical observation shows that many users provide just one or two answers and then leave. In this work we try to detect answerers that are about to quit, a task known as churn prediction, but unlike prior work, we focus on new users. To address the task of churn prediction in new users, we extract a variety of features to model the behavior of \YA{} users over the first week of their activity, including personal information, rate of activity, and social interaction with other users. Several classifiers trained on the data show that there is a statistically significant signal for discriminating between users who are likely to churn and those who are not. A detailed feature analysis shows that the two most important signals are the total number of answers given by the user, closely related to the motivation of the user, and attributes related to the amount of recognition given to the user, measured in counts of best answers, thumbs up and positive responses by the asker.

References

1. Z. Birnbaum and O. M. Klose. Bounds for the variance of the mann-whitney statistic.Annals of Mathematical Statistics, 28(4):933--945, 1957.
2. W. Buckinx and D. Van Den Poel. Customer base analysis: Partial defection of behaviorally-loyal clients in a non-contractual fmcg retail setting. European Journal Of Operational Research, 164:252--268, 2003.
3. J. Burez and D. Vandenpoel. Crm at a pay-tv company: Using analytical models to reduce customer attrition by targeted marketing for subscription services.Expert Systems with Applications, 32:277--288, 2007.
4. K. Coussement and D. Van Den Poel. Churn prediction in subscription services: An application of support vector machines while comparing two parameter-selection techniques. Expert Systems with Applications, 34(1):313--327, 2008.
5. K. Dasgupta, R. Singh, B. Viswanathan, D. Chakraborty, S. Mukherjea, A. A. Nanavati, and A. Joshi. Social ties and their relevance to churn in mobile telecom networks. In EDBT'08, pages 668--677, 2008.
6. P. Datta, B. Masand, D. R. Mani, and B. Li. Automated cellular modeling and prediction on a large scale. Artif. Intell. Rev., 14:485--502, 2000.
7. J. Hadden, A. Tiwari, R. Roy, and D. Ruta. Churn prediction using complaints data. InProceedings of world academy of science, engineering, and technology, volume 13, pages 158--163, 2006.
8. M. Karnstedt, T. Hennessy, J. Chan, P. Basuchowdhuri, C. Hayes, and T. Strufe. Churn in social networks. Handbook of Social Network Technologies and Applications (Springer), 2010.
9. M. Karnstedt, M. Rowe, J. Chan, H. Alani, and C. Hayes. The effect of user features on churn in social networks. In Proceedings of the third ACM/ICA Web Science Conference, 2011.
10. J. Kawale, A. Pal, and J. Srivastava. Churn prediction in mmorpgs: A social influence based approach. In IEEE International Conference on Computational Science and Engineering, pages 423--428, 2009.
11. D. A. Kumar and V. Ravi. Predicting credit card customer churn in banks using data mining. International Journal of Data Analysis Techniques and Strategies, 1, 2008.
12. M. Mozer, R. Wolniewicz, D. Grimes, E. Johnson, and H. Kaushansky. Predicting subscriber dissatisfaction and improving retention in the wireless telecommunications industry.IEEE Trans Neural Netw, 11(3):690--696, 2000.
13. T. Mutanen, S. Nousiainen, and J. Ahola. Customer churn prediction --a case study in retail banking. In Proceedings of the 2010 conference on Data Mining for Business Applications, pages 77--83, 2010.
14. P. C. Pendharkar. Genetic algorithm based neural network approaches for predicting churn in cellular wireless network services.Expert Syst. Appl., 36, 2009.
15. C. ping Wei and I. tang Chiu. Turning telecommunications call details to churn prediction: a data mining approach.Expert Systems With Applications, 23:103--112, 2002.
16. Y. Richter, E. Yom-Tov, and N. Slonim. Predicting customer churn in mobile networks through analysis of social groups. In SIAM International Conference on Data Mining, pages 732--741, 2010.
17. D. Stutzbach and R. Rejaie. Understanding churn in peer-to-peer networks. In Proceedings of the 6th ACM SIGCOMM conference on Internet measurement, IMC '06, pages 189--202, 2006.
18. W. Verbeke, D. Martens, C. Mues, and B. Baesens. Building comprehensible customer churn prediction models with advanced rule induction techniques. Expert Systems With Applications, 38:2354--2364, 2011.

Index Terms

• Human-centered computing

  • Collaborative and social computing

    • Collaborative and social computing systems and tools

• Information systems

  • World Wide Web