mlsanityData to 14 Oct 2026

Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languages

arXiv 2212.10168 ↗First posted 20 Dec 2022cs.CLcited by 28

Not on the map. Why?

Abstract (arXiv)

We present, Naamapadam, the largest publicly available Named Entity Recognition (NER) dataset for the 11 major Indian languages from two language families. The dataset contains more than 400k sentences annotated with a total of at least 100k entities from three standard entity categories (Person, Location, and, Organization) for 9 out of the 11 languages. The training dataset has been automatically created from the Samanantar parallel corpus by projecting automatically tagged entities from an English sentence to the corresponding Indian language translation. We also create manually annotated testsets for 9 languages. We demonstrate the utility of the obtained dataset on the Naamapadam-test dataset. We also release IndicNER, a multilingual IndicBERT model fine-tuned on Naamapadam training set. IndicNER achieves an F1 score of more than 80 for 7 out of 9 test languages. The dataset and models are available under open-source licences at https://ai4bharat.iitm.ac.in/naamapadam.

Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 24 of its 51 references that are in the map. First posted on arXiv 20 Dec 2022.

Builds on

24 of 51 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  3. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
  4. 2019How multilingual is Multilingual BERT?cited by 645
  5. 2016Neural Architectures for Named Entity Recognitioncited by 550
  6. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  7. 2019Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERTcited by 301
  8. 2021Word Alignment by Fine-tuning Embeddings on Parallel Corporacited by 186
  9. 2019Dice Loss for Data-imbalanced NLP Taskscited by 182
  10. 2019Cross-Lingual Ability of Multilingual BERT: An Empirical Studycited by 182
  11. 2021MuRIL: Multilingual Representations for Indian Languagescited by 179
  12. 2021XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluationcited by 168
12 more
  1. 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 136
  2. 2020Automated Concatenation of Embeddings for Structured Predictioncited by 86
  3. 2022Data Scaling Laws in NMT: The Effect of Noise and Architecturecited by 55
  4. 2018Neural Cross-Lingual Named Entity Recognition with Minimal Resourcescited by 44
  5. 2022IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languagescited by 42
  6. 2020Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Languagecited by 37
  7. 2019Entity Projection via Machine Translation for Cross-Lingual NERcited by 32
  8. 2019NNE: A Dataset for Nested Named Entity Recognition in English Newswirecited by 25
  9. 2021Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languagescited by 24
  10. 2022L3Cube-MahaNER: A Marathi Named Entity Recognition Dataset and BERT modelscited by 21
  11. 2022HiNER: A Large Hindi Named Entity Recognition Datasetcited by 12
  12. 2022AsNER -- Annotated Dataset and Baseline for Assamese Named Entity recognitioncited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 5; 2024: 5; 2025: 11; 2026: 7.

28 papers.

Sort:

By area:

  1. 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 152
  2. 2024IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languagescited by 56
  3. 2023Romanization-based Large-scale Adaptation of Multilingual Language Modelscited by 21
  4. 2023A Material Lens on Coloniality in NLPcited by 21
  5. 2023BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language Modelscited by 18
  6. 2025Tokenization Matters: Improving Zero-Shot NER for Indic Languagescited by 12
  7. 2025Multilingual Pretraining for Pixel Language Modelscited by 12
  8. 2023A Comprehensive Analysis of Adapter Efficiencycited by 8
  9. 2024A Three-Pronged Approach to Cross-Lingual Adaptation with Multilingual LLMscited by 6
  10. 2025Overcoming Vocabulary Constraints with Pixel-level Fallbackcited by 6
  11. 2026Mending the Holes: Mitigating Reward Hacking in Reinforcement Learning for Multilingual Translationcited by 4
  12. 2025Pragyaan: Designing and Curating High-Quality Cultural Post-Training Datasets for Indian Languagescited by 3
16 more
  1. 2024Fine-tuning Pre-trained Named Entity Recognition Models For Indian Languagescited by 2
  2. 2024IndicSentEval: How Effectively do Multilingual Transformer Models encode Linguistic Properties for Indic Languages?cited by 2
  3. 2025BanglaByT5: Byte-Level Modelling for Banglacited by 2
  4. 2024Long Range Named Entity Recognition for Marathi Documentscited by 1
  5. 2025TriNER: A Series of Named Entity Recognition Models For Hindi, Bengali & Marathicited by 1
  6. 2025Leveraging the Cross-Domain & Cross-Linguistic Corpus for Low Resource NMT: A Case Study On Bhili-Hindi-English Parallel Corpuscited by 1
  7. 2025BHRAM-IL: A Benchmark for Hallucination Recognition and Assessment in Multiple Indian Languagescited by 1
  8. 2026Polite on the Surface, Broken in Practice: A Curated Dataset for Fixing Generation and Register Failures in Low-Resource Bangla Text Generationcited by 1
  9. 2025Does Synthetic Data Help Named Entity Recognition for Low-Resource Languages?cited by 0
  10. 2025Zero-shot Cross-lingual NER via Mitigating Language Difference: An Entity-aligned Translation Perspectivecited by 0
  11. 2025Revisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian Languagescited by 0
  12. 2026AWED-PIPER: Agents, Web Applications & Expert Detectors for Personally Identifiable Information Protection & Fine-grained Named Entity Recognition across 36 languages for 6.6 Billion Speakerscited by 0
  13. 2026INDIC DIALECT: A Multi Task Benchmark to Evaluate and Translate in Indian Language Dialectscited by 0
  14. 2026BhashaSetu: Cross-Lingual Knowledge Transfer from High-Resource to Extreme Low-Resource Languagescited by 0
  15. 2026HomoEnsNER: Does Language Alignment Outperform Architectural Complexity in Gujarati Named Entity Recognition?cited by 0
  16. 2026Named Entity Recognition using Sliding Window Approachcited by 0