ABSTRACT
Expertise retrieval has been the subject of intense research over the past decade, particularly with the public availability of benchmark test collections for expertise retrieval in enterprises. Another domain which has seen comparatively less research on expertise retrieval is academic search. In this paper, we describe the Lattes Expertise Retrieval (LExR) test collection for research on academic expertise retrieval. LExR has been designed to provide a large-scale benchmark for two complementary expertise retrieval tasks, namely, expert profiling and expert finding. Unlike currently available test collections, which fully support only one of these tasks, LExR provides graded relevance judgments performed by expert judges separately for each task. In addition, LExR is both cross-organization and cross-area, encompassing candidate experts from all areas of knowledge working in research institutions all over Brazil. As a result, it constitutes a valuable resource for fostering new research directions on expertise retrieval in an academic setting.
- P. Bailey, N. Craswell, I. Soboroff, and A. P. de Vries. The CSIRO enterprise search test collection. SIGIR Forum, 41(2):42--45, 2007. Google ScholarDigital Library
- K. Balog, T. Bogers, L. Azzopardi, M. de Rijke, and A. van den Bosch. Broad expertise retrieval in sparse data environments. In Proc. of SIGIR, pages 551--558, 2007. Google ScholarDigital Library
- K. Balog, Y. Fang, M. de Rijke, P. Serdyukov, and L. Si. Expertise retrieval. Found. Trends Inf. Retr., 6(2-3):127--256, 2012. Google ScholarDigital Library
- R. Berendsen, M. de Rijke, K. Balog, T. Bogers, and A. van den Bosch. On the assessment of expertise profiles. J. Am. Soc. Inf. Sci. Technol., 64(10):2024--2044, 2013.Google ScholarCross Ref
- N. Craswell, A. P. de Vries, and I. Soboroff. Overview of the TREC 2005 Enterprise track. In Proc. of TREC, 2005.Google Scholar
- J. Lane. Let's make science metrics more scientific. Nature, 464(7288):488--489, 2010.Google ScholarCross Ref
- V. Mangaravite and R. L. T. Santos. On information-theoretic document-person associations for expert search in academia. In Proc. of SIGIR, 2016. Google ScholarDigital Library
- I. S. Ribeiro, R. L. T. Santos, M. A. Gonçalves, and A. H. F. Laender. On tag recommendation for expertise profiling: A case study in the scientific domain. In Proc. of WSDM, pages 189--198, 2015. Google ScholarDigital Library
- M. Sanderson. Test collection based evaluation of information retrieval systems. Found. Trends Inf. Retr., 4(4):247--375, 2010.Google ScholarCross Ref
- J. Tang, J. Zhang, L. Yao, J. Li, L. Zhang, and Z. Su. ArnetMiner: extraction and mining of academic social networks. In Proc. of KDD, pages 990--998, 2008. Google ScholarDigital Library
Index Terms
- The LExR Collection for Expertise Retrieval in Academia
Recommendations
Automated Expertise Retrieval: A Taxonomy-Based Survey and Open Issues
Understanding people’s expertise is not a trivial task since it is time-consuming when manually executed. Automated approaches have become a topic of research in recent years in various scientific fields, such as information retrieval, databases, and ...
Expertise retrieval in bibliographic network: a topic dominance learning approach
CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge ManagementExpert finding in bibliographic networks has received increased interests in recent years. This task concerns with finding relevant researchers for a given topic. Motivated by the observation that rarely do all coauthors contribute to a paper equally, ...
On Information-Theoretic Document-Person Associations for Expert Search in Academia
SIGIR '16: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information RetrievalState-of-the-art expert search approaches rely on document-person associations to infer the expertise of a candidate person for a given query. Such associations have traditionally been modeled as boolean variables, indicating whether or not a candidate ...
Comments