LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition
Not on the map. Why?
Abstract (arXiv)
Despite the impressive capabilities of large language models (LLMs), their performance on information extraction tasks is still not entirely satisfactory. However, their remarkable rewriting capabilities and extensive world knowledge offer valuable insights to improve these tasks. In this paper, we propose LLM-DA, a novel data augmentation technique based on LLMs for the few-shot NER task. To overcome the limitations of existing data augmentation methods that compromise semantic integrity and address the uncertainty inherent in LLM-generated text, we leverage the distinctive characteristics of the NER task by augmenting the original data at both the contextual and entity levels. Our approach involves employing 14 contextual rewriting strategies, designing entity replacements of the same type, and incorporating noise injection to enhance robustness. Extensive experiments demonstrate the effectiveness of our approach in enhancing NER model performance with limited data. Furthermore, additional analyses provide further evidence supporting the assertion that the quality of the data we generate surpasses that of other existing methods.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 22 Feb 2024.
Builds on
24 of 38 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,057
- 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
12 more
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
- 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 244
- 2019Not Enough Data? Deep Learning to the Rescue!cited by 174
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
- 2021Template-Based Named Entity Recognition Using BARTcited by 153
- 2021Few-NERD: A Few-Shot Named Entity Recognition Datasetcited by 150
- 2020An Analysis of Simple Data Augmentation for Named Entity Recognitioncited by 75
- 2021Template-free Prompt Tuning for Few-shot NERcited by 73
- 2018Few-shot classification in Named Entity Recognition Taskcited by 64
- 2023How Robust is GPT-3.5 to Predecessors? A Comprehensive Study on Language Understanding Taskscited by 58
- 2021MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NERcited by 42
- 2020Few-Shot Named Entity Recognition: A Comprehensive Studycited by 41
Built on by
Citing papers per year: 2024: 3; 2025: 5; 2026: 3.
11 papers.
- 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 34
- 2024Leveraging LLM-Respondents for Item Evaluation: a Psychometric Analysiscited by 31
- 2024Evaluating the Performance and Robustness of LLMs in Materials Science Q&A and Property Predictionscited by 9
- 2025Labeling Free-text Data using Language Model Ensemblescited by 5
- 2025Measuring Diversity in Synthetic Datasetscited by 5
- 2024Exploring ChatGPT-based Augmentation Strategies for Contrastive Aspect-based Sentiment Analysiscited by 2
- 2025Named Entity Recognition in COVID-19 tweets with Entity Knowledge Augmentationcited by 0
- 2025PANER: A Paraphrase-Augmented Framework for Low-Resource Named Entity Recognitioncited by 0
- 2026Adaptive Data Augmentation with Multi-armed Bandit: Sample-Efficient Embedding Calibration for Implicit Pattern Recognitioncited by 0
- 2026Imbalanced Data Clustering via Targeted Data Augmentation Using GMM and LLMcited by 0
- 2026URA-NER: A Unified Retrieval-Augmented Framework with Retrieval Alignment and Uncertainty Reduction for Low-Resource NERcited by 0
- 2026URA-NER: A Unified Retrieval-Augmented Framework with Retrieval Alignment and Uncertainty Reduction for Low-Resource NER21 Sep 2026
- 2026Imbalanced Data Clustering via Targeted Data Augmentation Using GMM and LLM19 May 2026
- 2026Adaptive Data Augmentation with Multi-armed Bandit: Sample-Efficient Embedding Calibration for Implicit Pattern Recognition22 Feb 2026
- 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulators22 Dec 2025
- 2025PANER: A Paraphrase-Augmented Framework for Low-Resource Named Entity Recognition20 Oct 2025
- 2025Named Entity Recognition in COVID-19 tweets with Entity Knowledge Augmentation5 Oct 2025
- 2025Measuring Diversity in Synthetic Datasets12 Feb 2025
- 2025Labeling Free-text Data using Language Model Ensembles14 Jan 2025
- 2024Evaluating the Performance and Robustness of LLMs in Materials Science Q&A and Property Predictions22 Sep 2024
- 2024Exploring ChatGPT-based Augmentation Strategies for Contrastive Aspect-based Sentiment Analysis17 Sep 2024
- 2024Leveraging LLM-Respondents for Item Evaluation: a Psychometric Analysis15 Jul 2024