mlsanityData to 7 Oct 2026

A Multi-way Parallel Named Entity Annotated Corpus for English, Tamil and Sinhala

arXiv 2412.02056 ↗First posted 3 Dec 2024cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper presents a multi-way parallel English-Tamil-Sinhala corpus annotated with Named Entities (NEs), where Sinhala and Tamil are low-resource languages. Using pre-trained multilingual Language Models (mLMs), we establish new benchmark Named Entity Recognition (NER) results on this dataset for Sinhala and Tamil. We also carry out a detailed investigation on the NER capabilities of different types of mLMs. Finally, we demonstrate the utility of our NER system on a low-resource Neural Machine Translation (NMT) task. Our dataset is publicly released: https://github.com/suralk/multiNER.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 67 references that are in the map. First posted on arXiv 3 Dec 2024.

Builds on

25 of 67 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  6. 2016Neural Architectures for Named Entity Recognitioncited by 548
  7. 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
  8. 2018A Survey on Deep Learning for Named Entity Recognitioncited by 281
  9. 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
  10. 2019A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelscited by 117
  11. 2019Portuguese Named Entity Recognition using BERT-CRFcited by 73
  12. 2023BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfercited by 68
13 more
  1. 2022Some Languages are More Equal than Others: Probing Deeper into the Linguistic Disparity in the NLP Worldcited by 55
  2. 2019Survey on Publicly Available Sinhala Natural Language Processing Tools and Researchcited by 45
  3. 2020A Set of Recommendations for Assessing Human-Machine Parity in Language Translationcited by 34
  4. 2019NNE: A Dataset for Nested Named Entity Recognition in English Newswirecited by 25
  5. 2020Soft Gazetteers for Low-Resource Named Entity Recognitioncited by 20
  6. 2022MultiCoNER: A Large-scale Multilingual dataset for Complex Named Entity Recognitioncited by 19
  7. 2022CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translationcited by 17
  8. 2020Data Augmentation and Terminology Integration for Domain-Specific Sinhala-English-Tamil Statistical Machine Translationcited by 16
  9. 2021DEEP: DEnoising Entity Pre-training for Neural Machine Translationcited by 15
  10. 2022BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classificationcited by 15
  11. 2017SLING: A framework for frame semantic parsingcited by 12
  12. 2021Cross-Lingual Named Entity Recognition Using Parallel Corpus: A New Approach Using XLM-RoBERTa Alignmentcited by 9
  13. 2014An HMM Based Named Entity Recognition System for Indian Languages: The JU System at ICON 2013cited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Linguistic Entity Masking to Improve Cross-Lingual Representation of Multilingual Language Models for Low-Resource Languagescited by 1