A Hybrid Method for Low-Resource Named Entity Recognition
Not on the map. Why?
Abstract (arXiv)
Named Entity Recognition (NER) is a critical component of Natural Language Processing with diverse applications in information extraction and conversational AI. However, NER in specific domains for low-resource languages faces challenges such as limited annotated data and heterogeneous label sets. This study addresses these issues by proposing a hybrid neurosymbolic framework that integrates rule-based processing with deep learning models for Vietnamese NER. The core idea involves a two-stage pipeline: first, a rule-based component reduces label complexity by grouping relational and special categories; second, pre-trained language models are fine-tuned for high-precision extraction. A post-processing module is then utilized to restore fine-grained labels, preserving expressiveness for application-level usability. To mitigate data scarcity, a scalable data augmentation strategy leveraging Large Language Models (LLMs) is introduced to expand the label set without full re-annotation, which is a significant novelty of this work. The effectiveness of this method was evaluated across five specific-domain datasets, including logistics, wildlife, and healthcare. Experimental results demonstrate substantial improvements over strong RoBERTa-based baselines. Specifically, the proposed system achieved F1 scores of 90 percent in Customer Service, up from 83 percent; 84 percent in GAM, up from 73 percent; 83 percent in AI Fluent, up from 80 percent; 94 percent in PhoNER_Covid19, up from 91 percent; and 60 percent in Rare Wildlife, up from 36 percent. These findings confirm that the hybrid approach effectively captures the linguistic complexity of Vietnamese and contextual nuances in specialized domains, offering a robust contribution to low-resource NER research.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 28 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
18 of 28 references.
References · 18
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2018A Survey on Deep Learning for Named Entity Recognitioncited by 281
- 2020PhoBERT: Pre-trained language models for Vietnamesecited by 148
- 2019A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelscited by 117
- 2024Layer-Condensed KV Cache for Efficient Inference of Large Language Modelscited by 58
- 2018Cross-type Biomedical Named Entity Recognition with Deep Multi-Task Learningcited by 28
- 2021COVID-19 Named Entity Recognition for Vietnamesecited by 19
6 more
- 2023FiNER-ORD: Financial Named Entity Recognition Open Research Datasetcited by 17
- 2025Rethinking the Role of Prompting Strategies in LLM Test-Time Scaling: A Perspective of Probability Theorycited by 10
- 2024CORM: Cache Optimization with Recent Message for Large Language Model Inferencecited by 7
- 2025Financial Named Entity Recognition: How Far Can LLM Go?cited by 7
- 2018A Feature-Rich Vietnamese Named-Entity Recognition Modelcited by 2
- 2019On the Vietnamese Name Entity Recognition: A Deep Learning Method Approachcited by 1
Built on by
Not cited yet.