mlsanityData to 14 Oct 2026

Universal NER v2: Towards a Massively Multilingual Named Entity Recognition Benchmark

arXiv 2604.12744 ↗First posted 14 Apr 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

While multilingual language models promise to bring the benefits of LLMs to speakers of many languages, gold-standard evaluation benchmarks in most languages to interrogate these assumptions remain scarce. The Universal NER project, now entering its fourth year, is dedicated to building gold-standard multilingual Named Entity Recognition (NER) benchmark datasets. Inspired by existing massively multilingual efforts for other core NLP tasks (e.g., Universal Dependencies), the project uses a general tagset and thorough annotation guidelines to collect standardized, cross-lingual annotations of named entity spans. The first installment (UNER v1) was released in 2024, and the project has continued and expanded since then, with various organizers, annotators, and collaborators in an active community.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 38 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

16 of 38 references.

References · 16

  1. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  2. 2024Large Language Models for Data Annotation and Synthesis: A Surveycited by 205
  3. 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 177
  4. 2020Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Languagecited by 37
  5. 2024NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Datacited by 34
  6. 2022Frustratingly Easy Label Projection for Cross-lingual Transfercited by 33
  7. 2025Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMscited by 29
  8. 2023Universal NER: A Gold-Standard Multilingual Named Entity Recognition Benchmarkcited by 26
  9. 2019NorNE: Annotating Named Entities for Norwegiancited by 18
  10. 2024Retrofitting Large Language Models with Dynamic Tokenizationcited by 16
  11. 2023Translation and Fusion Improves Zero-shot Cross-lingual Information Extractioncited by 15
  12. 2025Multilingual Pretraining for Pixel Language Modelscited by 12
4 more
  1. 2023Improving Large Language Models for Clinical Named Entity Recognition via Prompt Engineeringcited by 7
  2. 2024The Privileged Students: On the Value of Initialization in Multilingual Knowledge Distillationcited by 4
  3. 2025skLEP: A Slovak General Language Understanding Benchmarkcited by 3
  4. 2025Meta-Pretraining for Zero-Shot Cross-Lingual Named Entity Recognition in Low-Resource Philippine Languagescited by 3

Built on by

Not cited yet.