MELO: An Evaluation Benchmark for Multilingual Entity Linking of Occupations
Not on the map. Why?
Abstract (arXiv)
We present the Multilingual Entity Linking of Occupations (MELO) Benchmark, a new collection of 48 datasets for evaluating the linking of entity mentions in 21 languages to the ESCO Occupations multilingual taxonomy. MELO was built using high-quality, pre-existent human annotations. We conduct experiments with simple lexical models and general-purpose sentence encoders, evaluated as bi-encoders in a zero-shot setup, to establish baselines for future research. The datasets and source code for standardized evaluation are publicly available at https://github.com/Avature/melo-benchmark
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 23 of its 50 references that are in the map. First posted on arXiv 10 Oct 2024.
Builds on
23 of 50 references.
References · 23
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
- 2023Improving Text Embeddings with Large Language Modelscited by 303
- 2019Multilingual Universal Sentence Encoder for Semantic Retrievalcited by 193
- 2019Zero-Shot Entity Linking by Reading Entity Descriptionscited by 124
- 2020Entity Linking in 100 Languagescited by 52
- 2022SkillSpan: Hard and Soft Skill Extraction from English Job Postingscited by 43
- 2024GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuningcited by 40
- 2021JobBERT: Understanding Job Titles through Skillscited by 29
- 2023Extreme Multi-Label Skill Extraction Training using Large Language Modelscited by 17
- 2022Design of Negative Sampling Strategies for Distantly Supervised Skill Extractioncited by 16
11 more
- 2023ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domaincited by 14
- 2022Kompetencer: Fine-grained Skill Classification in Danish Job Postings via Distant Supervision and Transfer Learningcited by 13
- 2022Skill Extraction from Job Postings using Weak Supervisioncited by 13
- 2023Career Path Prediction using Resume Representation Learning and Skill-based Matchingcited by 12
- 2021Job Posting-Enriched Knowledge Graph for Skills-based Matchingcited by 8
- 2023Learn to Not Link: Exploring NIL Prediction in Entity Linkingcited by 7
- 2023VacancySBERT: the approach for representation of titles and skills for semantic similarity search in the recruitment domaincited by 7
- 2024Entity Linking in the Job Market Domaincited by 7
- 2022JAMES: Normalizing Job Titles with Multi-Aspect Graph Embeddings and Reasoningcited by 4
- 2023Enhancing PLM Performance on Labour Market Tasks via Instruction-based Finetuning and Prompt-tuning with Rulescited by 2
- 2022Flexible Job Classification with Zero-Shot Learningcited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025Overview of the TalentCLEF 2025: Skill and Job Title Intelligence for Human Capital Managementcited by 3
- 2026WorkRB: A Community-Driven Evaluation Framework for AI in the Work Domaincited by 2
- 2025Unified Work Embeddings: Contrastive Learning of a Bidirectional Multi-task Rankercited by 1
- 2025NLPnorth @ TalentCLEF 2025: Comparing Discriminative, Contrastive, and Prompt-Based Methods for Job Title and Skill Matchingcited by 0
- 2026Overview of the TalentCLEF 2026: Skill and Job Title Intelligence for Human Capital Managementcited by 0
- 2026TalentCLEF at CLEF2026: Skill and Job Title Intelligence for Human Capital Managementcited by 0
- 2026TalentCLEF at CLEF2026: Skill and Job Title Intelligence for Human Capital Management22 Jul 2026
- 2026Overview of the TalentCLEF 2026: Skill and Job Title Intelligence for Human Capital Management30 Jun 2026
- 2026WorkRB: A Community-Driven Evaluation Framework for AI in the Work Domain17 Mar 2026
- 2025Unified Work Embeddings: Contrastive Learning of a Bidirectional Multi-task Ranker11 Nov 2025
- 2025Overview of the TalentCLEF 2025: Skill and Job Title Intelligence for Human Capital Management17 Jul 2025
- 2025NLPnorth @ TalentCLEF 2025: Comparing Discriminative, Contrastive, and Prompt-Based Methods for Job Title and Skill Matching23 Jun 2025