Curriculum-style Data Augmentation for LLM-based Metaphor Detection
Not on the map. Why?
Abstract (arXiv)
Recently, utilizing large language models (LLMs) for metaphor detection has achieved promising results. However, these methods heavily rely on the capabilities of closed-source LLMs, which come with relatively high inference costs and latency. To address this, we propose a method for metaphor detection by fine-tuning open-source LLMs, effectively reducing inference costs and latency with a single inference step. Furthermore, metaphor detection suffers from a severe data scarcity problem, which hinders effective fine-tuning of LLMs. To tackle this, we introduce Curriculum-style Data Augmentation (CDA). Specifically, before fine-tuning, we evaluate the training data to identify correctly predicted instances for fine-tuning, while incorrectly predicted instances are used as seed data for data augmentation. This approach enables the model to quickly learn simpler knowledge and progressively acquire more complex knowledge, thereby improving performance incrementally. Experimental results demonstrate that our method achieves state-of-the-art performance across all baselines. Additionally, we provide detailed ablation studies to validate the effectiveness of CDA.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 53 references that are in the map. First posted on arXiv 4 Dec 2024.
Builds on
19 of 53 references.
References · 19
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 839
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
7 more
- 2022Generating Training Data with Language Models: Towards Zero-Shot Language Understandingcited by 199
- 2021MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theoriescited by 46
- 2023MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoningcited by 45
- 2018Neural Metaphor Detection in Contextcited by 34
- 2023MinPrompt: Graph-based Minimal Prompt Data Augmentation for Few-shot Question Answeringcited by 12
- 2017Grasping the Finer Point: A Supervised Similarity Network for Metaphor Detectioncited by 7
- 2023Adversarial Multi-task Learning for End-to-end Metaphor Detectioncited by 7
Built on by
Citing papers per year: 2025: 1.
1 paper.