CoNet: Collaborative Cross Networks for Cross-Domain Recommendation

ABSTRACT

The cross-domain recommendation technique is an effective way of alleviating the data sparse issue in recommender systems by leveraging the knowledge from relevant domains. Transfer learning is a class of algorithms underlying these techniques. In this paper, we propose a novel transfer learning approach for cross-domain recommendation by using neural networks as the base model. In contrast to the matrix factorization based cross-domain techniques, our method is deep transfer learning, which can learn complex user-item interaction relationships. We assume that hidden layers in two base networks are connected by cross mappings, leading to the collaborative cross networks (CoNet). CoNet enables dual knowledge transfer across domains by introducing cross connections from one base network to another and vice versa. CoNet is achieved in multi-layer feedforward networks by adding dual connections and joint loss functions, which can be trained efficiently by back-propagation. The proposed model is thoroughly evaluated on two large real-world datasets. It outperforms baselines by relative improvements of 7.84% in NDCG. We demonstrate the necessity of adaptively selecting representations to transfer. Our model can reduce tens of thousands training examples comparing with non-transfer methods and still has the competitive performance with them.

References

1. S. Berkovsky, T. Kuflik, and F. Ricci. 2007. Cross-domain mediation in collaborative filtering. UMAP.
2. I. Cantador, I. Fernández-Tobías, S. Berkovsky, and P. Cremonesi. 2015. Cross-domain recommender systems. Recommender Systems Handbook.
3. R. Caruana. 1997. Multitask Learning. Machine Learning (1997).
4. H.-T. Cheng, L. Koc, J. Harmsen, et al. 2016. Wide & deep learning for recommender systems. In ACM Recsys Workshop.
5. R. Collobert and J. Weston. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In ICML.
6. P. Covington, J. Adams, and E. Sargin. 2016. Deep neural networks for youtube recommendations. ACM RecSys.
7. M. Deshpande and G. Karypis. 2004. Item-based top-n recommendation algorithms. ACM Transactions on Information Systems.
8. C. Doersch and A. Zisserman. 2017. Multi-Task Self-Supervised Visual Learning. In IEEE CVPR.
9. G. Dziugaite and D. Roy. 2015. Neural network matrix factorization. arXiv:1511.06443.
10. A. Elkahky, Y. Song, and X. He. 2015. A multi-view deep learning approach for cross domain user modeling in recommendation systems. In WWW.
11. R. He and J. McAuley. 2016. VBPR: visual Bayesian Personalized Ranking from implicit feedback. In AAAI.
12. X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T.-S. Chua. 2017. Neural collaborative filtering. In WWW.
13. G.-N. Hu and X.-Y. Dai. 2017. Integrating reviews into personalized ranking for cold start recommendation. In PAKDD.
14. G.-N. Hu, X.-Y. Dai, F.-Y. Qiu, R. Xia, T. Li, S.-J. Huang, and J.-J. Chen. 2018. Collaborative Filtering with Topic and Social Latent Factors Incorporating Implicit Feedback. ACM Transactions on Knowledge Discovery from Data (2018).
15. G.-N. Hu, X.-Y. Dai, Y. Song, S.-J. Huang, and J.-J. Chen. 2015. A Synthetic Approach for Recommendation: Combining Ratings, Social Relations, and Reviews. In IJCAI.
16. L. Hu, J. Cao, G. Xu, L. Cao, Z. Gu, and C. Zhu. 2013. Personalized recommendation via cross-domain triadic factorization. In WWW.
17. Y. Hu, Y. Koren, and C. Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In IEEE ICDM.
18. D. Kim, C. Park, J. Oh, S. Lee, and H. Yu. 2016. Convolutional matrix factorization for document context-aware recommendation. In ACM RecSys.
19. D. Kingma and J. Ba. 2015. Adam: A method for stochastic optimization. ICLR.
20. Y. Koren, R. Bell, and C. Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer (2009).
21. A. Krizhevsky, I. Sutskever, and G. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In NIPS.
22. B. Li, Q. Yang, and X. Xue. 2009. Can movies and books collaborate?: cross-domain collaborative filtering for sparsity reduction. In IJCAI.
23. B. Li, X. Zhu, R. Li, C. Zhang, X. Xue, and X. Wu. 2011. Cross-domain collaborative filtering over time. In IJCAI.
24. B. Liu, Y. Fu, Z. Yao, and H. Xiong. 2013. Learning geographical preferences for point-of-interest recommendation. In ACM SIGKDD.
25. B. Loni, Y. Shi, M. Larson, and A. Hanjalic. 2014. Cross-Domain Collaborative Filtering with Factorization Machines. In ECIR.
26. Z. Lu, E. Zhong, L. Zhao, E. Xiang, W. Pan, and Q. Yang. 2013. Selective transfer learning for cross domain recommendation. In SIAM International Conference on Data Mining.
27. I. Misra, A. Shrivastava, A. Gupta, and M. Hebert. 2016. Cross-stitch networks for multi-task learning. In IEEE CVPR.
28. A. Mnih and R. Salakhutdinov. 2008. Probabilistic matrix factorization. In NIPS.
29. V. Nair and G. Hinton. 2010. Rectified linear units improve restricted boltzmann machines. In ICML.
30. M. Oquab, L. Bottou, I. Laptev, and J. Sivic. 2014. Learning and transferring mid-level image representations using convolutional neural networks. In IEEE CVPR.
31. R. Pan, Y. Zhou, B. Cao, N. Liu, R. Lukose, M. Scholz, and Q. Yang. 2008. One-class collaborative filtering. In IEEE ICDM.
32. S. Pan and Q. Yang. 2010. A survey on transfer learning. IEEE Transactions on knowledge and data engineering (2010).
33. W. Pan, N. Liu, E. Xiang, and Q. Yang. 2011. Transfer learning to predict missing ratings via heterogeneous user feedbacks. In IJCAI.
34. M. Pazzani and D. Billsus. 2007. Content-based recommendation systems. The adaptive web.
35. S. Rendle. 2012. Factorization machines with libfm. ACM Transactions on Intelligent Systems and Technology (2012).
36. S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In UAI.
37. C. Shi, Z. Zhang, P. Luo, P. Yu, Y. Yue, and B. Wu. 2015. Semantic path based personalized recommendation on weighted heterogeneous information networks. In ACM CIKM.
38. A. Singh and G. Gordon. 2008. Relational learning via collective matrix factorization. In ACM SIGKDD.
39. R. Tibshirani. 1996. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (1996).
40. P. Wang, J. Guo, Y. Lan, J. Xu, S. Wan, and X. Cheng. 2015. Learning hierarchical representation model for nextbasket recommendation. In ACM SIGIR.
41. S. Wu, W. Ren, C. Yu, G. Chen, D. Zhang, and J. Zhu. 2016. Personal recommendation using deep recurrent neural networks in NetEase. In IEEE ICDE.
42. L. Xiang, Q. Yuan, S. Zhao, L. Chen, X. Zhang, Q. Yang, and J. Sun. 2010. Temporal recommendation on graphs via long-and short-term preference fusion. In ACM SIGKDD.
43. K. Xu, J. Ba, R. Kiros, K. Cho, A. Courville, R. Salakhudinov, R. Zemel, and Y. Bengio. 2015. Show, attend and tell: Neural image caption generation with visual attention. In ICML.
44. C. Yang, L. Bai, C. Zhang, Q. Yuan, and J. Han. 2017. Bridging Collaborative Filtering and Semi-Supervised Learning: A Neural Approach for POI Recommendation. In ACM SIGKDD.
45. D. Yang, J. He, H. Qin, Y. Xiao, and W. Wang. 2015. A graph-based recommendation across heterogeneous domains. In ACM CIKM.
46. Z. Yang, R. Salakhutdinov, and W. Cohen. 2017. Transfer learning for sequence tagging with hierarchical recurrent networks. ICLR.
47. J. Yosinski, J. Clune, Y. Bengio, and H. Lipson. 2014. How transferable are features in deep neural networks? In NIPS.
48. Y. Zhang and Q. Yang. 2017. A survey on multi-task learning. arXiv:1707.08114.
49. L. Zhao, S. Pan, E. Xiang, E. Zhong, Z. Lu, and Q. Yang. 2013. Active transfer learning for cross-system recommendation. In AAAI.

Index Terms

• Information systems

  • Information systems applications

    • Data mining