mlsanityData to 7 Oct 2026

LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition

arXiv 2402.14568 ↗First posted 22 Feb 2024cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

Despite the impressive capabilities of large language models (LLMs), their performance on information extraction tasks is still not entirely satisfactory. However, their remarkable rewriting capabilities and extensive world knowledge offer valuable insights to improve these tasks. In this paper, we propose LLM-DA, a novel data augmentation technique based on LLMs for the few-shot NER task. To overcome the limitations of existing data augmentation methods that compromise semantic integrity and address the uncertainty inherent in LLM-generated text, we leverage the distinctive characteristics of the NER task by augmenting the original data at both the contextual and entity levels. Our approach involves employing 14 contextual rewriting strategies, designing entity replacements of the same type, and incorporating noise injection to enhance robustness. Extensive experiments demonstrate the effectiveness of our approach in enhancing NER model performance with limited data. Furthermore, additional analyses provide further evidence supporting the assertion that the quality of the data we generate surpasses that of other existing methods.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 22 Feb 2024.

Builds on

24 of 38 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  9. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  10. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  11. 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,057
  12. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
12 more
  1. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
  2. 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 244
  3. 2019Not Enough Data? Deep Learning to the Rescue!cited by 174
  4. 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
  5. 2021Template-Based Named Entity Recognition Using BARTcited by 153
  6. 2021Few-NERD: A Few-Shot Named Entity Recognition Datasetcited by 150
  7. 2020An Analysis of Simple Data Augmentation for Named Entity Recognitioncited by 75
  8. 2021Template-free Prompt Tuning for Few-shot NERcited by 73
  9. 2018Few-shot classification in Named Entity Recognition Taskcited by 64
  10. 2023How Robust is GPT-3.5 to Predecessors? A Comprehensive Study on Language Understanding Taskscited by 58
  11. 2021MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NERcited by 42
  12. 2020Few-Shot Named Entity Recognition: A Comprehensive Studycited by 41

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 5; 2026: 3.

11 papers.