Gaussian process factorization machines for context-aware recommendations

ABSTRACT

Context-aware recommendation (CAR) can lead to significant improvements in the relevance of the recommended items by modeling the nuanced ways in which context influences preferences. The dominant approach in context-aware recommendation has been the multidimensional latent factors approach in which users, items, and context variables are represented as latent features in low-dimensional space. An interaction between a user, item, and a context variable is typically modeled as some linear combination of their latent features. However, given the many possible types of interactions between user, items and contextual variables, it may seem unrealistic to restrict the interactions among them to linearity.

To address this limitation, we develop a novel and powerful non-linear probabilistic algorithm for context-aware recommendation using Gaussian processes. The method which we call Gaussian Process Factorization Machines (GPFM) is applicable to both the explicit feedback setting (e.g. numerical ratings as in the Netflix dataset) and the implicit feedback setting (i.e. purchases, clicks). We derive stochastic gradient descent optimization to allow scalability of the model. We test GPFM on five different benchmark contextual datasets. Experimental results demonstrate that GPFM outperforms state-of-the-art context-aware recommendation methods.

References

1. G. Adomavicius, R. Sankaranarayanan, S. Sen, and A. Tuzhilin. Incorporating contextual information in recommender systems using a multidimensional approach. ACM Transactions on Information Systems (TOIS) 23 (1):103--145, 2005.
2. D. Agarwal and B.-C. Chen. Regression-based latent fact or models. In KDD , pages 19--28, NewYork, NY, USA, 2009. ACM.
3. D. Agarwal, B.-C. Chen, and B. Long. Localized factor models for multi-context recommendation. In KDD, pages 609--617, New York, NY, USA, 2011. ACM.
4. L. Baltrunas and F. Ricci. Context-based splitting of item ratings in collaborative filtering. In RecSys, pages 245--248, New York, NY, USA, 2009. ACM.
5. E. Bonilla, S. Guo, and S. Sanner. Gaussian process preference elicitation. In NIPS, volume 23, pages 262--270, 2010.
6. W. Chu, V. Sindhwani, Z. Ghahramani, and S. Keerthi. Relational learning with gaussian processes. In NIPS, volume 19, page 289, 2007.
7. N. Houlsby, J. M. Hernandez-Lobato, F. Huszar, and Z. Ghahramani. Collaborative gaussian processes for preference learning. In NIPS, pages 2105--2113, 2012.
8. Y. Hu, Y. Koren, and C. Volinsky. Collaborative filtering for implicit feedback datasets. In Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, pages 263--272, Washington, DC, USA, 2008. IEEE Computer Society.
9. T. Kamishima. Nantonac collaborative filtering: recommendation based on order responses. In KDD, pages 583--588. ACM, 2003.
10. A. Karatzoglou, X. Amatriain, L. Baltrunas, and N. Oliver. Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering. In RecSys, pages 79--86, New York, NY, USA, 2010. ACM.
11. I. Konstas, V. Stathopoulos, and J. M. Jose. On social networks and collaborative recommendation. In SIGIR, SIGIR'09, pages 195--202, New York, NY, USA, 2009. ACM.
12. Y. Koren. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In KDD, KDD'08, pages 426--434, New York, NY, USA, 2008. ACM.
13. Y. Koren, R. Bell, and C. Volinsky. Matrix factorization techniques for recommender systems. Computer, 42: 30--37, August 2009.
14. A. Kosir, A. Odic, M. Kunaver, M. Tkalcic, and J. F. Tasic. Database for contextual personalization. Elektrotehniski Vestnik, 78(5): 270--274, 2011.
15. N. D. Lawrence and R. Urtasun. Non-linear matrix factorization with gaussian processes. In ICML, pages 601--608. ACM, 2009.
16. N. D. Lawrence and R. Urtasun. Non-linear matrix factorization with gaussian processes. In Proceedings of the 26th Annual International Conference on Machine Learning, ICML '09, pages 601--608, New York, NY, USA, 2009. ACM.
17. C. Ono, Y. Takishima, Y. Motomura, and H. Asoh. Context-aware preference model based on a study of difference between real and supposed situation data. In User Modeling, Adaptation, and Personalization, pages 102--113.Springer, 2009.
18. C. E. Rasmussen and C. K. I. Williams. Gaussian Processes for Machine Learning. The MIT Press, 2006.
19. S. Rendle. Factorization machines. In Data Mining (ICDM), 2010 IEEE 10th International Conference on, pages 995--1000. IEEE, 2010.
20. S. Rendle, C. Freudenthaler, Z. Gantner, and S.-T. Lars. Bpr: Bayesian personalized ranking from implicit feedback. In UAI, pages 452--461, Arlington, Virginia, United States, 2009. A UAI Press.
21. S. Rendle, Z. Gantner, C. Freudenthaler, and L. Schmidt-Thieme. Fast context-aware recommendations with factorization machines. In SIGIR, pages 635--644.ACM, 2011.
22. A. Said, S. Berkovsky, and E. W. De Luca. Putting things in context: Challenge on context-aware movie recommendation. In Proceedings of the Workshop on Context-Aware Movie Recommendation, CAMRa'10, pages2--6, NewYork, NY, USA, 2010. ACM.
23. R. Salakhutdinov and A. Mnih. Probabilistic matrix factorization. In NIPS, volume 20, 2008.
24. R. Salakhutdinov, A. Mnih, and G. Hinton. Restricted boltzmann machines for collaborative filtering. In ICML, pages 791--798. ACM, 2007.
25. Y. Shi, A. Karatzoglou, L. Baltrunas, M. Larson, A. Hanjalic, and N. Oliver. Tfmap: Optimizing map for top-n context-aware recommendation. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR'12, pages155--164, NewYork, NY, USA, 2012. ACM.
26. Y. Shi, A. Karatzoglou, L. Baltrunas, M. Larson, N. Oliver, and A. Hanjalic. Climf: Learning to maximize reciprocal rank with collaborative less-is-more filtering. In RecSys, pages 139--146, New York, NY, USA, 2012. ACM.
27. A. P. Singh and G. J. Gordon. Relational learning via collective matrix factorization. In KDD, pages 650--658, NewYork, NY, USA, 2008. ACM.
28. N. Srebro, J. Rennie, and T. S. Jaakkola. Maximum-margin matrix factorization. In NIPS, pages 1329--1336, 2004.
29. G. Takács, I. Pilászy, B. Németh, and D. Tikk. Scalable collaborative filtering approaches for large recommender systems. Journal Machine Learning Research, 10: 623--656, June 2009.
30. M. Weimer, A. Karatzoglou, Q. Le, and A. Smola. Cofirank - maximum margin matrix factorization for collaborative ranking. In NIPS , pages 1593--1600, 2007.
31. L. Xiong, X. Chen, T.-K. Huang, J. Schneider, and J. G. Carbonell. Temporal collaborative filtering with bayesian probabilistic tensor factorization. In SDM'10, pages211--222, 2010.
32. Z. Xu, K. Kersting, and V. Tresp. Multi-relational learning with gaussian processes. In IJCAI, pages 1309--1314, San Francisco, CA, USA, 2009.
33. Z. Xu, F. Yan, et al. Infinite tucker decomposition: Nonparametric bayesian models for multiway data analysis. arXiv preprint arXiv:1108.6296, 2011.
34. S.-H. Yang, B. Long, A. J. Smola, H. Zha, and Z. Zheng. Collaborative competitive filtering: learning recommender using context of user choice. In SIGIR, SIGIR'11, pages 295--304, New York, NY, USA, 2011. ACM.
35. K. Yu and W. Chu. Gaussian process models for link analys is and transfer learning. In NIPS, pages 1657--1664, 2007

Index Terms

• Information systems

  • Information retrieval

    • Retrieval models and ranking

    • Retrieval tasks and goals

      • Document filtering

      • Information extraction