mlsanityData to 7 Oct 2026

Enhancing Metaphor Detection through Soft Labels and Target Word Prediction

arXiv 2403.18253 ↗First posted 27 Mar 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Metaphors play a significant role in our everyday communication, yet detecting them presents a challenge. Traditional methods often struggle with improper application of language rules and a tendency to overlook data sparsity. To address these issues, we integrate knowledge distillation and prompt learning into metaphor detection. Our approach revolves around a tailored prompt learning framework specifically designed for metaphor detection. By strategically masking target words and providing relevant prompt data, we guide the model to accurately predict the contextual meanings of these words. This approach not only mitigates confusion stemming from the literal meanings of the words but also ensures effective application of language rules for metaphor detection. Furthermore, we've introduced a teacher model to generate valuable soft labels. These soft labels provide a similar effect to label smoothing and help prevent the model from becoming over confident and effectively addresses the challenge of data sparsity. Experimental results demonstrate that our model has achieved state-of-the-art performance, as evidenced by its remarkable results across various datasets.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 32 references that are in the map. First posted on arXiv 27 Mar 2024.

Builds on

10 of 32 references.

References · 10

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  5. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
  6. 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 299
  7. 2021Template-Based Named Entity Recognition Using BARTcited by 153
  8. 2020Explaining Knowledge Distillation by Quantifying the Knowledgecited by 65
  9. 2021MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theoriescited by 46
  10. 2018Neural Metaphor Detection in Contextcited by 34

Built on by

Not cited yet.