mlsanityData to 7 Oct 2026

ParaNames 1.0: Creating an Entity Name Corpus for 400+ Languages using Wikidata

arXiv 2405.09496 ↗First posted 15 May 2024cs.CL cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

We introduce ParaNames, a massively multilingual parallel name resource consisting of 140 million names spanning over 400 languages. Names are provided for 16.8 million entities, and each entity is mapped from a complex type hierarchy to a standard type (PER/LOC/ORG). Using Wikidata as a source, we create the largest resource of this type to date. We describe our approach to filtering and standardizing the data to provide the best quality possible. ParaNames is useful for multilingual language processing, both in defining tasks for name translation/transliteration and as supplementary data for tasks such as named entity recognition and linking. We demonstrate the usefulness of ParaNames on two tasks. First, we perform canonical name translation between English and 17 other languages. Second, we use it as a gazetteer for multilingual named entity recognition, obtaining performance improvements on all 10 languages evaluated.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 9 of its 22 references that are in the map. First posted on arXiv 15 May 2024.

Builds on

9 of 22 references.

References · 9

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  3. 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
  4. 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
  5. 2020Soft Gazetteers for Low-Resource Named Entity Recognitioncited by 20
  6. 2022HiNER: A Large Hindi Named Entity Recognition Datasetcited by 12
  7. 2018Design Challenges in Named Entity Transliterationcited by 11
  8. 2013JRC-Names: A freely available, highly multilingual named entity resourcecited by 6
  9. 2022Statistical and Neural Methods for Cross-lingual Entity Label Mapping in Knowledge Graphscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 3.

5 papers.