ABSTRACT
Recommender systems research often requires the creation and execution of large numbers of algorithmic experiments to determine the sensitivity of results to the values of various hyperparameters. Existing recommender systems platforms fail to provide a basis for systematic experimentation of this type. In this paper, we describe librec-auto, a wrapper for the well-known LibRec library, which provides an environment that supports automated experimentation.
- Lars Buitinck, Gilles Louppe, Mathieu Blondel, Fabian Pedregosa, Andreas Mueller, Olivier Grisel, Vlad Niculae, Peter Prettenhofer, Alexandre Gramfort, Jaques Grobler, Robert Layton, Jake VanderPlas, Arnaud Joly, Brian Holt, and Gaël Varoquaux. 2013. API design for machine learning software: experiences from the scikit-learn project. In ECML PKDD Workshop: Languages for Data Mining and Machine Learning. 108--122.Google Scholar
- Michael D. Ekstrand, Michael Ludwig, Jack Kolb, and John T. Riedl. 2011. LensKit: a modular recommender framework. In Proceedings of the fifth ACM conference on Recommender systems. 349--350. Google ScholarDigital Library
- Zeno Gantner, Steffen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2011. My Media Lite: a free recommender system library. In Proceedings of the fifth ACM conference on Recommender systems. 305--308. Google ScholarDigital Library
- Guibing Guo, Jie Zhang, Zhu Sun, and Neil Yorke-Smith. 2015. LibRec: A Java Library for Recommender Systems. In UMAP Workshops.Google Scholar
- Carlos E. Seminario and David C. Wilson. 2012. Case Study Evaluation of Mahout as a Recommender Platform. In RUE@ RecSys. 45--50.Google Scholar
Recommendations
Fairness-aware Recommendation with librec-auto
RecSys '20: Proceedings of the 14th ACM Conference on Recommender SystemsComparative experimentation is important for studying reproducibility in recommender systems. This is particularly true in areas without well-established methodologies, such as fairness-aware recommendation. In this paper, we describe fairness-aware ...
librec-auto: A Tool for Recommender Systems Experimentation
CIKM '21: Proceedings of the 30th ACM International Conference on Information & Knowledge ManagementRecommender systems are complex. They integrate the individual needs of users with the characteristics of particular domains of application which may span items from large and potentially heterogeneous collections. Extensive experimentation is required ...
Towards reproducibility in recommender-systems research
Numerous recommendation approaches are in use today. However, comparing their effectiveness is a challenging task because evaluation results are rarely reproducible. In this article, we examine the challenge of reproducibility in recommender-system ...
Comments