PANER: A Paraphrase-Augmented Framework for Low-Resource Named Entity Recognition
Not on the map. Why?
Abstract (arXiv)
Named Entity Recognition (NER) is a critical task that requires substantial annotated data, making it challenging in low-resource scenarios where label acquisition is expensive. While zero-shot and instruction-tuned approaches have made progress, they often fail to generalize to domain-specific entities and do not effectively utilize limited available data. We present a lightweight few-shot NER framework that addresses these challenges through two key innovations: (1) a new instruction tuning template with a simplified output format that combines principles from prior IT approaches to leverage the large context window of recent state-of-the-art LLMs; (2) introducing a strategic data augmentation technique that preserves entity information while paraphrasing the surrounding context, thereby expanding our training data without compromising semantic relationships. Experiments on benchmark datasets show that our method achieves performance comparable to state-of-the-art models on few-shot and zero-shot tasks, with our few-shot approach attaining an average F1 score of 80.1 on the CrossNER datasets. Models trained with our paraphrasing approach show consistent improvements in F1 scores of up to 17 points over baseline versions, offering a promising solution for groups with limited NER training data and compute power.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 20 Oct 2025.
Builds on
20 of 33 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
- 2018A Survey on Deep Learning for Named Entity Recognitioncited by 282
- 2024MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialoguescited by 250
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 170
- 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 119
- 2020CrossNER: Evaluating Cross-Domain Named Entity Recognitioncited by 104
8 more
- 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformercited by 88
- 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 72
- 2021MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NERcited by 42
- 2024Rethinking Negative Instances for Generative Named Entity Recognitioncited by 13
- 2024LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognitioncited by 11
- 2021Data Augmentation for Low-Resource Named Entity Recognition Using Backtranslationcited by 10
- 2024Show Less, Instruct More: Enriching Prompts with Definitions and Guidelines for Zero-Shot NERcited by 5
- 2024BUSTER: a "BUSiness Transaction Entity Recognition" datasetcited by 2
Built on by
Not cited yet.