Showing 1–1 of 1 results for author: Kopp, O

Online Evaluations for Everyone: Mr. DLib's Living Lab for Scholarly Recommendations

Authors: Joeran Beel, Andrew Collins, Oliver Kopp, Linus W. Dietz, Petr Knoth

Abstract: We introduce the first 'living lab' for scholarly recommender systems. This lab allows recommender-system researchers to conduct online evaluations of their novel algorithms for scholarly recommendations, i.e., recommendations for research papers, citations, conferences, research grants, etc. Recommendations are delivered through the living lab's API to platforms such as reference management softw… ▽ More We introduce the first 'living lab' for scholarly recommender systems. This lab allows recommender-system researchers to conduct online evaluations of their novel algorithms for scholarly recommendations, i.e., recommendations for research papers, citations, conferences, research grants, etc. Recommendations are delivered through the living lab's API to platforms such as reference management software and digital libraries. The living lab is built on top of the recommender-system as-a-service Mr. DLib. Current partners are the reference management software JabRef and the CORE research team. We present the architecture of Mr. DLib's living lab as well as usage statistics on the first sixteen months of operating it. During this time, 1,826,643 recommendations were delivered with an average click-through rate of 0.21%. △ Less

Submitted 22 May, 2019; v1 submitted 19 July, 2018; originally announced July 2018.

Comments: Published at the 41st European Conference on Information Retrieval (ECIR) 2019