Using external aggregate ratings for improving individual recommendations

Abstract

This article describes an approach for incorporating externally specified aggregate ratings information into certain types of recommender systems, including two types of collaborating filtering and a hierarchical linear regression model. First, we present a framework for incorporating aggregate rating information and apply this framework to the aforementioned individual rating models. Then we formally show that this additional aggregate rating information provides more accurate recommendations of individual items to individual users. Further, we experimentally confirm this theoretical finding by demonstrating on several datasets that the aggregate rating information indeed leads to better predictions of unknown ratings. We also propose scalable methods for incorporating this aggregate information and test our approaches on large datasets. Finally, we demonstrate that the aggregate rating information can also be used as a solution to the cold start problem of recommender systems.

References

1. Adomavicius, G., Sankaranarayanan, R., Sen, S., and Tuzhilin, A. 2005. Incorporating contextual information in recommender systems using a multidimensional approach. ACM Trans. Inform. Syst. 23, 1, 103--145.
2. Adomavicius, G. and Tuzhilin, A. 2001. Multidimensional recommender systems: a data warehousing approach. Lecture Notes in Computer Science, 180--192.
3. Adomavicius, G. and Tuzhilin, A. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Engine. 17, 6, 734--749.
4. Agarwal, D., Broder, A., Chakrabarti, D., Diklic, D., Josifovski, V., and Sayyadian, M. 2007. Estimating rates of rare events at multiple resolutions. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM New York, NY, 16--25.
5. AngiesList. 2009. http://www.angieslist.com.
6. Ansari, A., Essegaier, S., and Kohli, R. 2000. Internet recommendation systems. J. Market. Resear. 37, 3, 363--375.
7. Bell, R., Koren, Y., and Volinsky, C. 2007. Modeling relationships at multiple scales to improve accuracy of large recommender systems. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM New York, NY, 95--104.
8. Bennett, J. and Lanning, S. 2007. The netflix prize. In Proceedings of KDD Cup and Workshop.
9. Bhatia, R. 2007. Positive Definite Matrices. Princeton University Press.
10. Bishop, C. 2006. Pattern Recognition and Machine Learning. Springer New York.
11. Black, F. and Scholes, M. 1973. The pricing of options and corporate liabilities. J. Polit. Econ. 81, 3, 637--654.
12. Bollen, J. 2000. Group user models for personalized hyperlink recommendations. Lecture Notes in Computer Science, 38--50.
13. Bryk, A. and Raudenbush, S. 1992. Hierarchical Linear Models: Applications and Data Analysis Methods. Sage Publications.
14. Condliff, M. K., Lewis, D. D., and Madigan, D. 1999. Bayesian mixed-effects models for recommender systems. In Proceedings of the Workshop on Recommender: Algorithms and Evaluation (ACM SIGIR'99).
15. Fletcher, R. 1987. Practical Methods of Optimization. Wiley-Interscience New York, NY.
16. Flury, B. 1997. A First Course in Multivariate Statistics. Springer.
17. Gelman, A. 2004. Bayesian Data Analysis. CRC Press.
18. Greene, W. 2003. Econometric Analysis. Prentice Hall Upper Saddle River, NJ.
19. Härdle, W. 2004. Nonparametric and Semiparametric Models. Springer.
20. Hox, J. 2002. Multilevel Analysis: Techniques and Applications. Lawrence Erlbaum.
21. IMDB. 2006. http://www.imdb.com.
22. Jameson, A. and Smyth, B. 2007. Recommendation to groups. In The Adaptive Web: Methods and Strategies of Web Personalization, P. Brusilovsky, A. Kobsa, and W. Nejdl Eds., Springer, 596--627.
23. Karatzas, I. and Shreve, S. 1991. Brownian Motion and Stochastic Calculus. Springer.
24. Linden, G., Smith, B., and York, J. 2003. Amazon. com recommendations: Item-to-item collaborative filtering. IEEE Intern. Comput. 7, 1, 76--80.
25. Masthoff, J. 2003. Modeling the multiple people that are me. Lecture notes in computer science, 258--262.
26. Masthoff, J. 2004. Group modeling: Selecting a sequence of television items to suit a group of viewers. User Model. User-Adapt. Interac. 14, 1, 37--85.
27. McCarthy, K., Salamó, M., Coyle, L., McGinty, L., Smyth, B., and Nixon, P. 2006. Group recommender systems: a critiquing based approach. In Proceedings of the 11th International Conference on Intelligent User Interfaces. ACM New York, NY, 267--269.
28. Melville, P., Mooney, R., and Nagarajan, R. 2002. Content-boosted collaborative filtering for improved recommendations. In Proceedings of the National Conference on Artificial Intelligence. AAAI Press, 187--192.
29. MovieLens. 2006. http://www.grouplens.org/node/73 (as provided in 2006).
30. Neumaier, A. and Groeneveld, E. 1998. Restricted maximum likelihood estimation of covariances in sparse linear models. Genet. Select. Evol. 30, 1, 3--26.
31. O'Connor, M., Cosley, D., Konstan, J., and Riedl, J. 2001. PolyLens: A recommender system for groups of users. In Proceedings of the European Conference on Computer-Supported Cooperative Work. 199--218.
32. Park, Y. and Tuzhilin, A. 2008. The long tail of recommender systems and how to leverage it. In Proceedings of the ACM Conference on Recommender Systems. ACM New York, NY, 11--18.
33. Sarwar, B., Karypis, G., Konstan, J., and Reidl, J. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web. ACM New York, NY, 285--295.
34. Schafer, J., Konstan, J., and Riedl, J. 2001. E-commerce recommendation applications. Data Mini. Knowle. Discov. 5, 1, 115--153.
35. Schein, A., Popescul, A., Ungar, L., and Pennock, D. 2002. Methods and metrics for cold-start recommendations. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM New York, NY, 253--260.
36. Schwaighofer, A., Tresp, V., and Yu, K. 2004. Learning Gaussian process kernels via hierarchical Bayes. Advances Neural Inform. Process. Syst. 17, 1209--1216.
37. Umyarov, A. and Tuzhilin, A. 2007. Leveraging aggregate ratings for better recommendations. In Proceedings of the ACM Conference on Recommender Systems, 161--164.
38. Umyarov, A. and Tuzhilin, A. 2008. Improving collaborative filtering recommendations using external data. In Proceedings of the 8th IEEE International Conference on Data Mining (ICDM'08). 618--627.
39. Verbeke, G. and Molenberghs, G. 2000. Linear Mixed Models for Longitudinal Data. Springer Verlag.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Philosophical/theoretical foundations of artificial intelligence

      • Cognitive science

• Human-centered computing

  • Human computer interaction (HCI)

• Information systems

  • Information retrieval

    • Retrieval tasks and goals

      • Document filtering

      • Information extraction