SoRec: social recommendation using probabilistic matrix factorization

ABSTRACT

Data sparsity, scalability and prediction quality have been recognized as the three most crucial challenges that every collaborative filtering algorithm or recommender system confronts. Many existing approaches to recommender systems can neither handle very large datasets nor easily deal with users who have made very few ratings or even none at all. Moreover, traditional recommender systems assume that all the users are independent and identically distributed; this assumption ignores the social interactions or connections among users. In view of the exponential growth of information generated by online social networks, social network analysis is becoming important for many Web applications. Following the intuition that a person's social network will affect personal behaviors on the Web, this paper proposes a factor analysis approach based on probabilistic matrix factorization to solve the data sparsity and poor prediction accuracy problems by employing both users' social network information and rating records. The complexity analysis indicates that our approach can be applied to very large datasets since it scales linearly with the number of observations, while the experimental results shows that our method performs much better than the state-of-the-art approaches, especially in the circumstance that users have made few or no ratings.

References

1. P. Bedi, H. Kaur, and S. Marwaha. Trust based recommender system for semantic web. In IJCAI'07: Proceedings of International Joint Conferences on Artificial Intelligence, pages 2677--2682, 2007.
2. J. S. Breese, D. Heckerman, and C. Kadie. Empirical analysis of predictive algorithms for collaborative filtering. In UAI'98: Proceedings of Uncertainty in Artificial Intelligence, 1998.
3. J. Canny. Collaborative filtering with privacy via factor analysis. In SIGIR '02: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, pages 238--245, New York, NY, USA, 2002. ACM.
4. M. Deshpande and G. Karypis. Item-based top-n recommendation. ACM Transactions on Information Systems, 22(1):143--177, 2004.
5. D. Dueck and B. Frey. Probabilistic sparse matrix factorization. In Technical Report PSI TR 2004-023, Dept. of Computer Science, University of Toronto, 2004.
6. R. Guha, R. Kumar, P. Raghavan, and A. Tomkins. Propagation of trust and distrust. In WWW '04: Proceedings of the 13th international conference on World Wide Web, pages 403--412, New York, NY, USA, 2004. ACM.
7. J. L. Herlocker, J. A. Konstan, A. Borchers, and J. Riedl. An algorithmic framework for performing collaborative filtering. In SIGIR '99: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, pages 230--237, New York, NY, USA, 1999. ACM.
8. T. Hofmann. Collaborative filtering via gaussian probabilistic latent semantic analysis. In SIGIR '03: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, pages 259--266, New York, NY, USA, 2003. ACM.
9. T. Hofmann. Latent semantic models for collaborative filtering. ACM Transactions on Information Systems, 22(1):89--115, 2004.
10. R. Jin, J. Y. Chai, and L. Si. An automatic weighting scheme for collaborative filtering. In SIGIR '04: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, pages 337--344, New York, NY, USA, 2004. ACM.
11. A. Kohrs and B. Merialdo. Clustering for collaborative filtering applications. In Proceedings of CIMCA, 1999.
12. G. Linden, B. Smith, and J. York. Amazon.com recommendations: Item-to-item collaborative filtering. IEEE Internet Computing, pages 76--80, Jan/Feb 2003.
13. H. Ma, I. King, and M. R. Lyu. Effective missing data prediction for collaborative filtering. In SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 39--46, New York, NY, USA, 2007. ACM.
14. P. Massa and P. Avesani. Trust-aware collaborative filtering for recommender systems. In Proceedings of CoopIS/DOA/ODBASE, pages 492--508, 2004.
15. J. D. M. Rennie and N. Srebro. Fast maximum margin matrix factorization for collaborative prediction. In ICML '05: Proceedings of the 22th International Conference on Machine Learning, 2005.
16. P. Resnick, N. Iacovou, M. Suchak, P. Bergstrom, and J. Riedl. Grouplens: An open architecture for collaborative filtering of netnews. In Proceedings of ACM Conference on Computer Supported Cooperative Work, 1994.
17. R. Salakhutdinov and A. Mnih. Bayesian probabilistic matrix factorization using markov chain monte carlo. In ICML '08: Proceedings of the 25th International Conference on Machine Learning, 2008.
18. R. Salakhutdinov and A. Mnih. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems, volume 20, 2008.
19. B. Sarwar, G. Karypis, J. Konstan, and J. Reidl. Item-based collaborative filtering recommendation algorithms. In WWW '01: Proceedings of the 10th international conference on World Wide Web, pages 285--295, New York, NY, USA, 2001. ACM.
20. L. Si and R. Jin. Flexible mixture model for collaborative filtering. In ICML '03: Proceedings of the 20th International Conference on Machine Learning, 2003.
21. P. Singla and M. Richardson. Yes, there is a correlation - from social networks to personal behavior on the web. In WWW '08: Proceedings of the 17th international conference on World Wide Web, pages 655--664, New York, NY, USA, 2008. ACM.
22. R. R. Sinha and K. Swearingen. Comparing recommendations made by online systems and friends. In DELOS Workshop: Personalisation and Recommender Systems in Digital Libraries, 2001.
23. N. Srebro and T. Jaakkola. Weighted low-rank approximations. In ICML '03: Proceedings of the 20th International Conference on Machine Learning, pages 720--727, 2003.
24. J. Wang, A. P. de Vries, and M. J. T. Reinders. Unifying user-based and item-based collaborative filtering approaches by similarity fusion. In SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, pages 501--508, New York, NY, USA, 2006. ACM.
25. G.-R. Xue, C. Lin, Q. Yang, W. Xi, H.-J. Zeng, Y. Yu, and Z. Chen. Scalable collaborative filtering using cluster-based smoothing. In SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pages 114--121, New York, NY, USA, 2005. ACM.
26. D. Zhou, B. Scholkopf, and T. Hofmann. Semi-supervised learning on directed graphs. In Advances in Neural Information Processing Systems, volume 17, 2005.
27. D. Zhou, S. Zhu, K. Yu, X. Song, B. L. Tseng, H. Zha, and C. L.Giles. Learning multiple graphs for document recommendations. In WWW '08: Proceedings of the 17th international conference on World Wide Web, pages 141--150, New York, NY, USA, 2008. ACM.
28. S. Zhu, K. Yu, Y. Chi, and Y. Gong. Combining content and link for classification using matrix factorization. In SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 487--494, New York, NY, USA, 2007. ACM.

Index Terms

• Applied computing

  • Law, social and behavioral sciences

• Information systems

  • Information retrieval

    • Retrieval tasks and goals

      • Document filtering

      • Information extraction