mlsanityData to 14 Oct 2026

HomoEnsNER: Does Language Alignment Outperform Architectural Complexity in Gujarati Named Entity Recognition?

arXiv 2608.03105 ↗First posted 4 Aug 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Named Entity Recognition (NER) for Gujarati remains underexplored, hindered by the absence of capitalization cues, rich morphology, lexical ambiguity, and free word order. Prior ensemble work has emphasized architectural diversity by combining heterogeneous classifiers, multilingual encoders, or classical sequence models, rather than exploiting language-aligned monolingual pretraining. This study asks whether, for a low-resource, morphologically rich language like Gujarati, a homogeneous ensemble of a single monolingual encoder outperforms such architectural diversity. We propose HomoEnsNER, a homogeneous ensemble of five independently fine-tuned GujaratiBERT models combined via majority voting, evaluated against a single GujaratiBERT baseline and six heterogeneous alternatives, including combinations with MuRIL-base, MuRIL-large, IndicBERT, mBERT, BiLSTM, CRF, and a stacked BiLSTM-CRF-GujaratiBERT architecture. All eight models were trained under a consistent budget and evaluated using entity-level F1 on the Naamapadam Gujarati test split. HomoEnsNER achieved the highest F1 (0.8442), surpassing the baseline (0.8347) and every heterogeneous alternative (lowest: 0.7855), indicating that language alignment is a more effective, budget-conscious ensembling strategy than architectural complexity for low-resource Indian language NER.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 24 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

9 of 24 references.

References · 9

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  4. 2021MuRIL: Multilingual Representations for Indian Languagescited by 179
  5. 2022L3Cube-MahaCorpus and MahaBERT: Marathi Monolingual Corpus, Marathi BERT Language Models, and Resourcescited by 51
  6. 2022L3Cube-HindBERT and DevBERT: Pre-Trained BERT Transformer models for Devanagari based Hindi and Marathi Languagescited by 35
  7. 2022Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languagescited by 28
  8. 2024Fine-tuning Pre-trained Named Entity Recognition Models For Indian Languagescited by 2
  9. 2025EL4NER: Ensemble Learning for Named Entity Recognition via Multiple Small-Parameter Large Language Modelscited by 2

Built on by

Not cited yet.