How to Get Them a Dream Job?: Entity-Aware Features for Personalized Job Search Ranking

ABSTRACT

This paper proposes an approach to applying standardized entity data to improve job search quality and to make search results more personalized. Specifically, we explore three types of entity-aware features and incorporate them into the job search ranking function. The first is query-job matching features which extract and standardize entities mentioned in queries and documents, then semantically match them based on these entities. The second type, searcher-job expertise homophily, aims to capture the fact that job searchers tend to be interested in the jobs requiring similar expertise as theirs. To measure the similarity, we use standardized skills in job descriptions and searchers' profiles as well as skills that we infer searchers might have but not explicitly list in their profiles. Third, we propose a concept of entity-faceted historical click-through-rates (CTRs) to capture job document quality. Faceting jobs by their standardized companies, titles, locations, etc., and computing historical CTRs at the facet level instead of individual job level alleviate sparseness issue in historical action data. This is particularly important in job search where job lifetime is typically short. Both offline and online experiments confirm the effectiveness of the features. In offline experiment, using the entity-aware features gives improvements of +20%, +12.1% and +8.3% on Precision@1, MRR and NDCG@25, respectively. Online A/B test shows that a new model with these features is +11.3% and +5.3% better than the baseline in terms of click-through-rate and apply rate.

References

1. D. Arya, V. Ha-Thuc, and S. Sinha. Personalized federated search at linkedin. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management (CIKM), pages 1699--1702, 2015.
2. D. Buscaldi and P. Rosso. Using geowordnet for geographical information retrieval. In Evaluating Systems for Multilingual and Multimodal Information Access, pages 863--866, 2008.
3. O. Chapelle and Y. Chang. Yahoo! learning to rank challenge overview. In Proceedings of the Yahoo Learning to Rank Challenge, held at ICML, pages 1--24, 2011.
4. O. Corby, R. Dieng-Kuntz, and C. Faron-Zucker. Querying the semantic web with corese search engine. In Proceedings of the 16th European Conference on Artificial Intelligence, pages 705--709, 2005.
5. J. Dalton, L. Dietz, and J. Allan. Entity query feature expansion using knowledge base links. In The 37th ACM SIGIR Conference on Research and Development in Information Retrieval, pages 365--374, 2014.
6. B. Fazzinga and T. Lukasiewicz. Semantic search on the web. Semantic Web, 1(1--2):89--96, 2010.
7. M. Fernandez, V. Lopez, M. Sabou, V. Uren, D. Vallet, E. Motta, and P. Castells. Semantic search meets the web. In 2008 IEEE International Conference on Semantic Computing (ICSC), pages 253--260, 2008.
8. T. W. Finin, L. Ding, R. Pan, A. Joshi, P. Kolari, A. Java, and Y. Peng. Swoogle: Searching for knowledge on the semantic web. In Proceedings of the Twentieth National Conference on Artificial Intelligence, pages 1682--1683, 2005.
9. R. Guha, R. McCool, and E. Miller. Semantic search. In Proceedings of the 12th ACM International Conference on World Wide Web (WWW), pages 700--709, 2003.
10. V. Ha-Thuc, G. Venkataraman, M. Rodriguez, S. Sinha, S. Sundaram, and L. Guo. Personalized expertise search at linkedin. In Proceedings of the 4th IEEE International Conference Big Data, 2015.
11. V. Ha-Thuc, Y. Xu, S. P. Kanduri, X. Wu, V. Dialani, Y. Yan, A. Gupta, and S. Sinha. Search by ideal candidates: Next generation of talent search at linkedin. In Proceedings of the 25th International Conference on World Wide Web (WWW), pages 195--198, 2016.
12. J. Heflin, J. A. Hendler, and S. Luke. SHOE: A blueprint for the semantic web. In Spinning the Semantic Web: Bringing the World Wide Web to Its Full Potential, pages 29--63, 2003.
13. T. Joachims. Optimizing search engines using clickthrough data. In Proceedings of the eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 133--142, 2002.
14. P. F. Lazarsfeld and R. K. Merton. Friendship as a social process: A substantive and methodological analysis. Freedom and control in modern society, 18:18--66, 1954.
15. H. Li. A short introduction to learning to rank. IEICE Transactions, 94-D(10):1854--1862, 2011.
16. T. Liu, T. Joachims, H. Li, and C. Zhai. Introduction to special issue on learning to rank for information retrieval. Information Retrieval, 13(3):197--200, 2010.
17. M. McPherson, L. Smith-Lovin, and J. M. Cook. Birds of a feather: Homophily in social networks. Annual Review of Sociology, 27(1):415--444, 2001.
18. D. Metzler and W. B. Croft. Linear feature-based models for information retrieval. Information Retrieval, 10(3):257--274, 2007.
19. E. Prud'Hommeaux, A. Seaborne, et al. Sparql query language for rdf. W3C recommendation, 15, 2008.
20. X. Shen, B. Tan, and C. Zhai. Implicit user modeling for personalized search. In Proceedings of the ACM International Conference on Information and Knowledge Management (CIKM), pages 824--831, 2005.
21. D. Sontag, K. Collins-Thompson, P. N. Bennett, R. W. White, S. Dumais, and B. Billerbeck. Probabilistic models for personalizing web search. In Proceedings of the fifth ACM International Conference on Web Search and Data Mining (WSDM), pages 433--442, 2012.
22. K. Sugiyama, K. Hatano, and M. Yoshikawa. Adaptive web search based on user profile constructed without any effort from users. In Proceedings of the 13th ACM International Conference on World Wide Web (WWW), pages 675--684, 2004.
23. B. Tan and F. Peng. Unsupervised query segmentation using generative language models and wikipedia. In Proceedings of the 17th ACM International Conference on World Wide Web (WWW), pages 347--356, 2008.
24. V. S. Uren, Y. Lei, and E. Motta. Semsearch: Refining semantic search. In The Semantic Web: Research and Applications, 5th European Semantic Web Conference, pages 874--878, 2008.
25. R. W. White, P. N. Bennett, and S. T. Dumais. Predicting short-term interests using activity-based search context. In Proceedings of the 19th ACM International Conference on Information and Knowledge Management (CIKM), pages 1009--1018, 2010.
26. Y. Xu, N. Chen, A. Fernandez, O. Sinno, and A. Bhasin. From infrastructure to culture: A/B testing challenges in large scale social networks. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 2227--2236, 2015.
27. J. Yan, W. Chu, and R. W. White. Cohort modeling for enhanced personalized search. In Proceedings of the 37th ACM SIGIR Conference on Research and Development in Information Retrieval, pages 505--514, 2014.
28. J. Zhong, H. Zhu, J. Li, and Y. Yu. Conceptual graph matching for semantic search. In Conceptual Structures: Integration and Interfaces, 10th International Conference on Conceptual Structures, pages 92--196, 2002.

Index Terms

• Information systems

  • Information retrieval

  • World Wide Web

    • Web searching and information discovery

      • Personalization

      • Web search engines