Neighbor Selection and Weighting in User-Based Collaborative Filtering: A Performance Prediction Approach

Abstract

User-based collaborative filtering systems suggest interesting items to a user relying on similar-minded people called neighbors. The selection and weighting of these neighbors characterize the different recommendation approaches. While standard strategies perform a neighbor selection based on user similarities, trust-aware recommendation algorithms rely on other aspects indicative of user trust and reliability. In this article we restate the trust-aware recommendation problem, generalizing it in terms of performance prediction techniques, whose goal is to predict the performance of an information retrieval system in response to a particular query. We investigate how to adopt the preceding generalization to define a unified framework where we conduct an objective analysis of the effectiveness (predictive power) of neighbor scoring functions. The proposed framework enables discriminating whether recommendation performance improvements are caused by the used neighbor scoring functions or by the ways these functions are used in the recommendation computation. We evaluated our approach with several state-of-the-art and novel neighbor scoring functions on three publicly available datasets. By empirically comparing four neighbor quality metrics and thirteen performance predictors, we found strong predictive power for some of the predictors with respect to certain metrics. This result was then validated by checking the final performance of recommendation strategies where predictors are used for selecting and/or weighting user neighbors. As a result, we have found that, by measuring the predictive power of neighbor performance predictors, we are able to anticipate which predictors are going to perform better in neighbor-scoring-powered versions of a user-based collaborative filtering algorithm.

References

1. Adomavicius, G. and Tuzhilin, A. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Engin. 17, 6, 734--749.
2. Bellogín, A. and Castells, P. 2010. A performance prediction approach to enhance collaborative filtering performance. In Proceedings of the 32nd European Conference on Information Retrieval (ECIR’10). C. Gurrin, Y. He, G. Kazai, U. Kruschwitz, and S. Little Eds., Lecture Notes in Computer Science, vol. 5993, Springer, 382--393.
3. Bellogín, A., Castells, P., and Cantador, I. 2011. Predicting the performance of recommender systems: An information theoretic approach. In Proceedings of the 3rd International Conference on the Theory of Information Retrieval (ICTIR’11). G. Amati and F. Crestani Eds., Lecture Notes in Computer Science, vol. 6931, Springer, 27--39.
4. Bellogín, A., Castells, P., and Cantador, I. 2013. Improving memory-based collaborative filtering by neighbour selection based on user preference overlap. In Proceedings of the 10th Conference on Open Research Areas in Information Retrieval (OAIR’13). Le Centre de Hautes Etudes Internationales D’Informatique Documentaire, 145--148.
5. Cacheda, F., Carneiro, V., Fernández, V., and Formoso, V. 2011. Comparison of collaborative filtering algorithms: Limitations of current techniques and proposals for scalable, high-performance recommender systems. ACM Trans. Web 5, 1, 1--33.
6. Carmel, D. and Yom-Tov, E. 2010. Estimating the query difficulty for information retrieval. In Synthesis Lectures of Information Concepts, Retrieval, and Services, Morgan and Claypool.
7. Clements, M., De Vries, A. P., Pouwelse, J. A., Wang, J., and Reinders, M. J. T. 2007. Evaluation of neighbourhood selection in decentralized recommendation systems. In Proceedings of the Workshop on Large Scale Distributed Systems for Information Retrieval.
8. Cover, T. M. and Thomas, J. A. 1991. Elements of Information Theory. Wiley-Interscience.
9. Cronen-Townsend, S., Zhou, Y., and Croft, B. W. 2002. Predicting query performance. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’02). ACM Press, New York, 299--306.
10. Desrosiers, C. and Karypis, G. 2011. A comprehensive survey of neighborhood-based recommendation methods. In Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor Eds., Springer, 107--144.
11. Ekstrand, M. D., Riedl, J., and Konstan, J. A. 2011. Collaborative filtering recommender systems. Foundat. Trends Hum.-Comput. Interact. 4, 2, 175--243.
12. Elahi, M. 2011. Adaptive active learning in recommender systems. In Proceedings of the 19th International Conference on User Modeling, Adaptation, and Personalization (UMAP’11). J. A. Konstan, R. Conejo, J. L. Marzo, and N. Oliver Eds., Lecture Notes in Computer Science, vol. 6787, Springer, 414--417.
13. Golbeck, J. 2009. Trust and nuanced profile similarity in online social networks. ACM Trans. Web 3, 4, 12--32.
14. Golbeck, J. and Hendler, J. 2006. FilmTrust: Movie recommendations using trust in web-based social networks. In Proceedings of the 3rd IEEE Consumer Communications and Networking Conference (CCNC’06). 282--286.
15. Guo, G., Zhang, J., and Thalmann, D. 2012. A simple but effective method to incorporate trusted neighbors in recommender systems. In Proceedings of the 20th International Conference on User Modeling, Adaptation, and Personalization (UMAP’12). K. Masthoff, B. Mobasher, M. C. Desmarais, and R. Kambou Eds., Lecture Notes in Computer Science, vol. 7379, Springer, 114--125.
16. Herlocker, J., Konstan, J. A., and Riedl, J. 2002. An empirical analysis of design choices in neighborhood-based collaborative filtering algorithms. Inf. Retriev. 5, 4, 287--310.
17. Hwang, C.-S. and Chen, Y.-P. 2007. Using trust in collaborative filtering recommendation. In Proceedings of the 20th International Conference on Industrial Engineering and other Applications of Applied Intelligent Systems (IEA/AIE’07). H. Okuno and M. Ali Eds., Lecture Notes in Computer Science, vol. 4570, Springer, 1052--1060.
18. Kwon, K., Cho, J., and Park, Y. 2009. Multidimensional credibility model for neighbor selection in collaborative recommendation. Expert Syst. Appl. 36, 3, 7114--7122.
19. Ma, H., King, I., and Lyu, M. R. 2007. Effective missing data prediction for collaborative filtering. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’07). ACM Press, New York, 39--46.
20. Ma, H., King, I., and Lyu, M. R. 2009. Learning to recommend with social trust ensemble. In Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’09). ACM Press, New York, 203--210.
21. Marx, P., Thurau, T. H., and Marchand, A. 2010. Increasing consumers’ understanding of recommender results: A preference-based hybrid algorithm with strong explanatory power. In Proceedings of the 4th ACM Conference on Recommender Systems (RecSys’10). ACM Press, New York, 297--300.
22. Massa, P. and Avesani, P. 2007. Trust-aware recommender systems. In Proceedings of the 1st ACM Conference on Recommender Systems (RecSys’07). ACM Press, New York, 17--24.
23. Massa, P. and Bhattacharjee, B. 2004. Using trust in recommender systems: An experimental analysis. In Proceedings of the 2nd International Conference on Trust Management (iTrust’04). C. Jensen, S. Poslad, and T. Dimitrakos Eds., Lecture Notes in Computer Science, vol. 2995, Springer, 221--235.
24. McLaughlin, M. R. and Herlocker, J. L. 2004. A collaborative filtering algorithm and evaluation metric that accurately model the user experience. In Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’04). ACM Press, New York, 329--336.
25. O’Donovan, J. and Smyth, B. 2005. Trust in recommender systems. In Proceedings of the 10th International Conference on Intelligent User Interfaces (IUI’05). ACM Press, New York, 167--174.
26. Rafter, R., O’Mahony, M., Hurley, N., and Smyth, B. 2009. What have the neighbours ever done for us? A collaborative filtering perspective. In Proceedings of the 17th User Modeling, Adaptation, and Personalization (UMAP’09). G.-J. Houben, G. McCalla, F. Pianesi, and M. Zancanaro Eds., Lecture Notes in Computer Science, vol. 5535, Springer, 355--360.
27. Rashid, A. M., Karypis, G., and Riedl, J. 2005. Influence in ratings-based recommender systems: An algorithm-independent approach. In Proceedings of the 5th SIAM International Conference on Data Mining. 556--560.
28. Ren, Y., Li, G., Zhang, J., and Zhou, W. 2012. The efficient imputation method for neighborhood-based collaborative filtering. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management (CIKM’12). ACM Press, New York, 684--693.
29. Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., and Riedl, J. 1994. GroupLens: An open architecture for collaborative filtering of netnews. In Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW’94). ACM Press, New York, 175--186.
30. Schclar, A., Tsikinovsky, A., Rokach, L., Meisels, A., and Antwarg, L. 2009. Ensemble methods for improving the performance of neighborhood-based collaborative filtering. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys’09). ACM Press, New York, 261--264.
31. Shani, G. and Gunawardana, A. 2011. Evaluating recommender systems. In Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor Eds., Springer, 257--298.
32. Snedecor, G. W. and Cochran, W. G. 1980. Statistical Methods 7th Ed. Iowa State Press.
33. Su, X. and Khoshgoftaar, T. M. 2009. A survey of collaborative filtering techniques. Adv. Artif. Intell., 1--19.
34. Walter, F. E., Battiston, S., and Schweitzer, F. 2009. Personalised and dynamic trust in social networks. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys’09). ACM Press, New York, 197--204.
35. Weng, J., Miao, C., and Goh, A. 2006. Improving collaborative filtering with trust-based metrics. In Proceedings of the 21st ACM Symposium on Applied Computing (SAC’06). ACM Press, New York, 1860--1864.
36. Yom-Tov, E., Fine, S., Carmel, D., and Darlow, A. 2005. Learning to estimate query difficulty: Including application to missing content detection and distributed information retrieval. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’05). ACM Press, New York, 512--519.
37. Zar, J. H. 1972. Significance testing of the spearman’s rank correlation coefficient. J. Amer. Statist. Assoc. 67, 339, 578--580.
38. Zhou, Y. and Croft, B. W. 2006. Ranking robustness: A novel framework to predict query performance. In Proceedings of the 15th ACM International Conference on Information and Knowledge Management (CIKM’06). ACM Press, New York, 567--574.
39. Ziegler, C. N. and Lausen, G. 2004. Analyzing correlation between trust and user similarity in online communities. In Proceedings of the 2nd International Conference on Trust Management (iTrust’04). C. Jensen, S. Poslad, and T. Dimitrakos Eds., Lecture Notes in Computer Science, vol. 2995, Springer, 251--265.

Index Terms

• Information systems

  • Information retrieval