Universal NER: A Gold-Standard Multilingual Named Entity Recognition Benchmark
Not on the map. Why?
Abstract (arXiv)
We introduce Universal NER (UNER), an open, community-driven project to develop gold-standard NER benchmarks in many languages. The overarching goal of UNER is to provide high-quality, cross-lingually consistent annotations to facilitate and standardize multilingual NER research. UNER v1 contains 18 datasets annotated with named entities in a cross-lingual consistent schema across 12 diverse languages. In this paper, we detail the dataset creation and composition of UNER; we also provide initial modeling baselines on both in-language and cross-lingual learning settings. We release the data, code, and fitted models to the public.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 16 of its 69 references that are in the map. First posted on arXiv 15 Nov 2023.
Builds on
16 of 69 references.
References · 16
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2016Neural Architectures for Named Entity Recognitioncited by 550
- 2020Universal Dependencies v2: An Evergrowing Multilingual Treebank Collectioncited by 271
- 2020Are All Languages Created Equal in Multilingual BERT?cited by 207
- 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
- 2018UniMorph 2.0: Universal Morphologycited by 42
- 2020Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Languagecited by 37
- 2022Frustratingly Easy Label Projection for Cross-lingual Transfercited by 33
- 2020UniTrans: Unifying Model Transfer and Data Transfer for Cross-Lingual Named Entity Recognition with Unlabeled Datacited by 24
- 2021DaN+: Danish Nested Named Entities and Lexical Normalizationcited by 19
- 2019NorNE: Annotating Named Entities for Norwegiancited by 18
- 2022Toward More Meaningful Resources for Lower-resourced Languagescited by 14
4 more
- 2020Neural Cross-Lingual Transfer and Limited Annotated Data for Named Entity Recognition in Danishcited by 5
- 2023Enriching the NArabizi Treebank: A Multifaceted Approach to Supporting an Under-Resourced Languagecited by 4
- 2020UNER: Universal Named-Entity RecognitionFrameworkcited by 2
- 2019Low-Resource Sequence Labeling via Unsupervised Multilingual Contextualized Representationscited by 1
Built on by
Citing papers per year: 2024: 4; 2025: 12; 2026: 10.
26 papers.
Sort:
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 177
- 2025Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMscited by 29
- 2024Retrofitting Large Language Models with Dynamic Tokenizationcited by 16
- 2025Should We Still Pretrain Encoders with Masked Language Modeling?cited by 16
- 2025Multilingual Pretraining for Pixel Language Modelscited by 12
- 2025M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysiscited by 9
- 2025skLEP: A Slovak General Language Understanding Benchmarkcited by 3
- 2025Learning Dynamics of Meta-Learning in Small Model Pretrainingcited by 3
- 2025FilBench: Can LLMs Understand and Generate Filipino?cited by 3
- 2025Meta-Pretraining for Zero-Shot Cross-Lingual Named Entity Recognition in Low-Resource Philippine Languagescited by 3
- 2024OpenNER 1.0: Standardized Open-Access Named Entity Recognition Datasets in 50+ Languagescited by 2
- 2025Enhancing NER Performance in Low-Resource Pakistani Languages using Cross-Lingual Data Augmentationcited by 2
14 more
- 2026Strategies for Span Labeling with Large Language Modelscited by 2
- 2025NameTag 3: A Tool and a Service for Multilingual/Multitagset NERcited by 1
- 2024SandboxAQ's submission to MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrievalcited by 0
- 2025Improving Low-Resource Sequence Labeling with Knowledge Fusion and Contextual Label Explanationscited by 0
- 2025Does Synthetic Data Help Named Entity Recognition for Low-Resource Languages?cited by 0
- 2026What Matters When Building Universal Multilingual Named Entity Recognition Models?cited by 0
- 2026Efficient Multilingual Name Type Classification Using Convolutional Networkscited by 0
- 2026Avey-Bcited by 0
- 2026CzechTopic: A Benchmark for Zero-Shot Topic Localization in Historical Czech Documentscited by 0
- 2026Just Use XML: Revisiting Joint Translation and Label Projectioncited by 0
- 2026Universal NER v2: Towards a Massively Multilingual Named Entity Recognition Benchmarkcited by 0
- 2026BenCSSmark: Making the Social Sciences Count in LLM Researchcited by 0
- 2026Pad=artha: Ontology-Grounded Fine-Grained NER Benchmark for Classical Sanskritcited by 0
- 2026A Scalable Framework for Automated NER Annotation Correction in Low-Resource Languagescited by 0
- 2026A Scalable Framework for Automated NER Annotation Correction in Low-Resource Languages16 Sep 2026
- 2026Pad=artha: Ontology-Grounded Fine-Grained NER Benchmark for Classical Sanskrit29 Aug 2026
- 2026BenCSSmark: Making the Social Sciences Count in LLM Research6 May 2026
- 2026Universal NER v2: Towards a Massively Multilingual Named Entity Recognition Benchmark14 Apr 2026
- 2026Just Use XML: Revisiting Joint Translation and Label Projection12 Mar 2026
- 2026CzechTopic: A Benchmark for Zero-Shot Topic Localization in Historical Czech Documents4 Mar 2026
- 2026Avey-B17 Feb 2026
- 2026Strategies for Span Labeling with Large Language Models23 Jan 2026
- 2026Efficient Multilingual Name Type Classification Using Convolutional Networks16 Jan 2026
- 2026What Matters When Building Universal Multilingual Named Entity Recognition Models?9 Jan 2026
- 2025Meta-Pretraining for Zero-Shot Cross-Lingual Named Entity Recognition in Low-Resource Philippine Languages2 Sep 2025
- 2025FilBench: Can LLMs Understand and Generate Filipino?5 Aug 2025
14 more
- 2025Learning Dynamics of Meta-Learning in Small Model Pretraining4 Aug 2025
- 2025Should We Still Pretrain Encoders with Masked Language Modeling?1 Jul 2025
- 2025skLEP: A Slovak General Language Understanding Benchmark26 Jun 2025
- 2025NameTag 3: A Tool and a Service for Multilingual/Multitagset NER6 Jun 2025
- 2025Multilingual Pretraining for Pixel Language Models27 May 2025
- 2025Does Synthetic Data Help Named Entity Recognition for Low-Resource Languages?22 May 2025
- 2025Enhancing NER Performance in Low-Resource Pakistani Languages using Cross-Lingual Data Augmentation7 Apr 2025
- 2025Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs20 Feb 2025
- 2025M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis17 Feb 2025
- 2025Improving Low-Resource Sequence Labeling with Knowledge Fusion and Contextual Label Explanations31 Jan 2025
- 2024OpenNER 1.0: Standardized Open-Access Named Entity Recognition Datasets in 50+ Languages12 Dec 2024
- 2024Retrofitting Large Language Models with Dynamic Tokenization27 Nov 2024
- 2024SandboxAQ's submission to MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrieval28 Oct 2024
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning9 Feb 2024
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 177
- 2025Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMscited by 29
- 2024Retrofitting Large Language Models with Dynamic Tokenizationcited by 16
- 2025Should We Still Pretrain Encoders with Masked Language Modeling?cited by 16
- 2025Multilingual Pretraining for Pixel Language Modelscited by 12
- 2025M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysiscited by 9
- 2025skLEP: A Slovak General Language Understanding Benchmarkcited by 3
- 2025Learning Dynamics of Meta-Learning in Small Model Pretrainingcited by 3
- 2025FilBench: Can LLMs Understand and Generate Filipino?cited by 3
- 2025Meta-Pretraining for Zero-Shot Cross-Lingual Named Entity Recognition in Low-Resource Philippine Languagescited by 3
- 2024OpenNER 1.0: Standardized Open-Access Named Entity Recognition Datasets in 50+ Languagescited by 2
- 2025Enhancing NER Performance in Low-Resource Pakistani Languages using Cross-Lingual Data Augmentationcited by 2
12 most cited of 26 All 26 (JSON)
- 2026A Scalable Framework for Automated NER Annotation Correction in Low-Resource Languages16 Sep 2026
- 2026Pad=artha: Ontology-Grounded Fine-Grained NER Benchmark for Classical Sanskrit29 Aug 2026
- 2026BenCSSmark: Making the Social Sciences Count in LLM Research6 May 2026
- 2026Universal NER v2: Towards a Massively Multilingual Named Entity Recognition Benchmark14 Apr 2026
- 2026Just Use XML: Revisiting Joint Translation and Label Projection12 Mar 2026
- 2026CzechTopic: A Benchmark for Zero-Shot Topic Localization in Historical Czech Documents4 Mar 2026
- 2026Avey-B17 Feb 2026
- 2026Strategies for Span Labeling with Large Language Models23 Jan 2026
- 2026Efficient Multilingual Name Type Classification Using Convolutional Networks16 Jan 2026
- 2026What Matters When Building Universal Multilingual Named Entity Recognition Models?9 Jan 2026
- 2025Meta-Pretraining for Zero-Shot Cross-Lingual Named Entity Recognition in Low-Resource Philippine Languages2 Sep 2025
- 2025FilBench: Can LLMs Understand and Generate Filipino?5 Aug 2025
12 newest of 26 All 26 (JSON)