MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theories
Not on the map. Why?
Abstract (arXiv)
Automated metaphor detection is a challenging task to identify metaphorical expressions of words in a sentence. To tackle this problem, we adopt pre-trained contextualized models, e.g., BERT and RoBERTa. To this end, we propose a novel metaphor detection model, namely metaphor-aware late interaction over BERT (MelBERT). Our model not only leverages contextualized word representation but also benefits from linguistic metaphor identification theories to distinguish between the contextual and literal meaning of words. Our empirical results demonstrate that MelBERT outperforms several strong baselines on four benchmark datasets, i.e., VUA-18, VUA-20, MOH-X, and TroFi.
Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). Builds on 11 of its 45 references that are in the map. First posted on arXiv 28 Apr 2021.
Builds on
11 of 45 references.
References · 11
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2018Deep contextualized word representationscited by 2,285
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
- 2019Document Expansion by Query Predictioncited by 225
- 2018Neural Metaphor Detection in Contextcited by 34
- 2017Grasping the Finer Point: A Supervised Similarity Network for Metaphor Detectioncited by 7
Built on by
Citing papers per year: 2021: 2; 2022: 7; 2023: 11; 2024: 13; 2025: 6; 2026: 7.
46 papers.
Sort:
By area:
- 2023MemeCap: A Dataset for Captioning and Interpreting Memescited by 46
- 2021MathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Educationcited by 37
- 2022Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languagescited by 30
- 2024Metaphor Understanding Challenge Dataset for LLMscited by 30
- 2022MetaCLUE: Towards Comprehensive Visual Metaphors Researchcited by 28
- 2022Hierarchical Attention Network for Explainable Depression Detection on Twitter Aided by Metaphor Concept Mappingscited by 23
- 2023FrameBERT: Conceptual Metaphor Detection with Frame Embedding Learningcited by 18
- 2023Metaphor Detection with Effective Context Denoisingcited by 13
- 2023Metaphor Detection via Explicit Basic Meanings Modellingcited by 12
- 2023A Match Made in Heaven: A Multi-task Framework for Hyperbole and Metaphor Detectioncited by 10
- 2025Cultural Bias Matters: A Cross-Cultural Benchmark Dataset and Sentiment-Enriched Model for Understanding Multimodal Metaphorscited by 10
- 2022MiQA: A Benchmark for Inference on Metaphorical Questionscited by 9
34 more
- 2023Adversarial Multi-task Learning for End-to-end Metaphor Detectioncited by 7
- 2024Unveiling the Invisible: Captioning Videos with Metaphorscited by 7
- 2022Metaphorical Polysemy Detection: Conventional Metaphor meets Word Sense Disambiguationcited by 6
- 2022Leveraging a New Spanish Corpus for Multilingual and Crosslingual Metaphor Detectioncited by 5
- 2024Survey in Characterizing Semantic Changecited by 5
- 2024Meta4XNLI: A Crosslingual Parallel Corpus for Metaphor Detection and Interpretationcited by 5
- 2025Probing Semantic Alignment, Lexical Invariance, and Syntactic Influence in LLM Metaphor Processingcited by 5
- 2024Semantic Change Characterization with LLMs using Rhetoricscited by 4
- 2025When People are Floods: Analyzing Dehumanizing Metaphors in Immigration Discourse with Large Language Modelscited by 4
- 2023Multilingual Multi-Figurative Language Detectioncited by 3
- 2024Finding Challenging Metaphors that Confuse Pretrained Language Modelscited by 3
- 2025Towards Multimodal Metaphor Understanding: A Chinese Dataset and Model for Metaphor Mapping Identificationcited by 3
- 2023ContrastWSD: Enhancing Metaphor Detection with Word Sense Disambiguation Following the Metaphor Identification Procedurecited by 2
- 2023An Expectation-Realization Model for Metaphor Detectioncited by 2
- 2024A Dual-Perspective Metaphor Detection Framework Using Large Language Modelscited by 2
- 2026Interpretable Chinese Metaphor Identification via LLM-Assisted MIPVU Rule Script Generation: A Comparative Protocol Studycited by 2
- 2026Not all ANIMALs are equal: metaphorical framing through source domains and semantic framescited by 2
- 2023OYXOY: A Modern NLP Test Suite for Modern Greekcited by 1
- 2024Verifying Claims About Metaphors with Large-Scale Automatic Metaphor Identificationcited by 1
- 2024NYK-MS: A Well-annotated Multi-modal Metaphor and Sarcasm Understanding Benchmark on Cartoon-Caption Datasetcited by 1
- 2024Curriculum-style Data Augmentation for LLM-based Metaphor Detectioncited by 1
- 2025Exploring Task Performance with Interpretable Models via Sparse Auto-Encoderscited by 1
- 2021Classifying Math KCs via Task-Adaptive Pre-Trained BERTcited by 0
- 2022HYU at SemEval-2022 Task 2: Effective Idiomaticity Detection with Consideration at Different Levels of Contextualizationcited by 0
- 2023Deep Learning-Based Knowledge Injection for Metaphor Detection: A Comprehensive Reviewcited by 0
- 2024A Dataset for Metaphor Detection in Early Medieval Hebrew Poetrycited by 0
- 2024Enhancing Metaphor Detection through Soft Labels and Target Word Predictioncited by 0
- 2024Figuratively Speaking: Authorship Attribution via Multi-Task Figurative Language Modelingcited by 0
- 2025The Medical Metaphors Corpus (MCC)cited by 0
- 2026Learning the Cue or Learning the Word? Analyzing Generalization in Metaphor Detection for Verbscited by 0
- 2026A Reproducible Multi-Architecture Baseline for Token-Level Chinese Metaphor Identification under the MIPVU Frameworkcited by 0
- 2026Post-Hoc Understanding of Metaphor Processing in Decoder-Only Language Models via Conditional Scale Entropycited by 0
- 2026CAMMAR: Culture-Aware Matryoshka for Metaphorical Arabic Representationscited by 0
- 2026Cross-Dataset Stability of Expert-Informed Skill Prompting and Fine-Tuning for Chinese Metaphor Identificationcited by 0
- 2026Cross-Dataset Stability of Expert-Informed Skill Prompting and Fine-Tuning for Chinese Metaphor Identification26 Aug 2026
- 2026CAMMAR: Culture-Aware Matryoshka for Metaphorical Arabic Representations17 Jul 2026
- 2026Post-Hoc Understanding of Metaphor Processing in Decoder-Only Language Models via Conditional Scale Entropy20 May 2026
- 2026A Reproducible Multi-Architecture Baseline for Token-Level Chinese Metaphor Identification under the MIPVU Framework8 May 2026
- 2026Not all ANIMALs are equal: metaphorical framing through source domains and semantic frames22 Apr 2026
- 2026Learning the Cue or Learning the Word? Analyzing Generalization in Metaphor Detection for Verbs15 Apr 2026
- 2026Interpretable Chinese Metaphor Identification via LLM-Assisted MIPVU Rule Script Generation: A Comparative Protocol Study11 Mar 2026
- 2025Probing Semantic Alignment, Lexical Invariance, and Syntactic Influence in LLM Metaphor Processing5 Oct 2025
- 2025The Medical Metaphors Corpus (MCC)11 Aug 2025
- 2025Exploring Task Performance with Interpretable Models via Sparse Auto-Encoders8 Jul 2025
- 2025Cultural Bias Matters: A Cross-Cultural Benchmark Dataset and Sentiment-Enriched Model for Understanding Multimodal Metaphors8 Jun 2025
- 2025When People are Floods: Analyzing Dehumanizing Metaphors in Immigration Discourse with Large Language Models18 Feb 2025
34 more
- 2025Towards Multimodal Metaphor Understanding: A Chinese Dataset and Model for Metaphor Mapping Identification5 Jan 2025
- 2024A Dual-Perspective Metaphor Detection Framework Using Large Language Models23 Dec 2024
- 2024Curriculum-style Data Augmentation for LLM-based Metaphor Detection4 Dec 2024
- 2024NYK-MS: A Well-annotated Multi-modal Metaphor and Sarcasm Understanding Benchmark on Cartoon-Caption Dataset2 Sep 2024
- 2024Semantic Change Characterization with LLMs using Rhetorics23 Jul 2024
- 2024Figuratively Speaking: Authorship Attribution via Multi-Task Figurative Language Modeling12 Jun 2024
- 2024Unveiling the Invisible: Captioning Videos with Metaphors7 Jun 2024
- 2024Meta4XNLI: A Crosslingual Parallel Corpus for Metaphor Detection and Interpretation10 Apr 2024
- 2024Verifying Claims About Metaphors with Large-Scale Automatic Metaphor Identification1 Apr 2024
- 2024Enhancing Metaphor Detection through Soft Labels and Target Word Prediction27 Mar 2024
- 2024Metaphor Understanding Challenge Dataset for LLMs18 Mar 2024
- 2024Survey in Characterizing Semantic Change29 Feb 2024
- 2024A Dataset for Metaphor Detection in Early Medieval Hebrew Poetry27 Feb 2024
- 2024Finding Challenging Metaphors that Confuse Pretrained Language Models29 Jan 2024
- 2023An Expectation-Realization Model for Metaphor Detection7 Nov 2023
- 2023OYXOY: A Modern NLP Test Suite for Modern Greek13 Sep 2023
- 2023ContrastWSD: Enhancing Metaphor Detection with Word Sense Disambiguation Following the Metaphor Identification Procedure6 Sep 2023
- 2023Deep Learning-Based Knowledge Injection for Metaphor Detection: A Comprehensive Review8 Aug 2023
- 2023Multilingual Multi-Figurative Language Detection31 May 2023
- 2023A Match Made in Heaven: A Multi-task Framework for Hyperbole and Metaphor Detection27 May 2023
- 2023Metaphor Detection via Explicit Basic Meanings Modelling26 May 2023
- 2023Adversarial Multi-task Learning for End-to-end Metaphor Detection26 May 2023
- 2023MemeCap: A Dataset for Captioning and Interpreting Memes23 May 2023
- 2023Metaphor Detection with Effective Context Denoising11 Feb 2023
- 2023FrameBERT: Conceptual Metaphor Detection with Frame Embedding Learning9 Feb 2023
- 2022MetaCLUE: Towards Comprehensive Visual Metaphors Research19 Dec 2022
- 2022Metaphorical Polysemy Detection: Conventional Metaphor meets Word Sense Disambiguation16 Dec 2022
- 2022Leveraging a New Spanish Corpus for Multilingual and Crosslingual Metaphor Detection19 Oct 2022
- 2022MiQA: A Benchmark for Inference on Metaphorical Questions14 Oct 2022
- 2022Hierarchical Attention Network for Explainable Depression Detection on Twitter Aided by Metaphor Concept Mappings15 Sep 2022
- 2022HYU at SemEval-2022 Task 2: Effective Idiomaticity Detection with Consideration at Different Levels of Contextualization1 Jun 2022
- 2022Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages26 Mar 2022
- 2021MathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Education2 Jun 2021
- 2021Classifying Math KCs via Task-Adaptive Pre-Trained BERT24 May 2021
- 2024Metaphor Understanding Challenge Dataset for LLMscited by 30
- 2024Metaphor Understanding Challenge Dataset for LLMs18 Mar 2024
- 2023MemeCap: A Dataset for Captioning and Interpreting Memescited by 46
- 2021MathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Educationcited by 37
- 2022Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languagescited by 30
- 2022MetaCLUE: Towards Comprehensive Visual Metaphors Researchcited by 28
- 2022Hierarchical Attention Network for Explainable Depression Detection on Twitter Aided by Metaphor Concept Mappingscited by 23
- 2023FrameBERT: Conceptual Metaphor Detection with Frame Embedding Learningcited by 18
- 2023Metaphor Detection with Effective Context Denoisingcited by 13
- 2023Metaphor Detection via Explicit Basic Meanings Modellingcited by 12
- 2023A Match Made in Heaven: A Multi-task Framework for Hyperbole and Metaphor Detectioncited by 10
- 2025Cultural Bias Matters: A Cross-Cultural Benchmark Dataset and Sentiment-Enriched Model for Understanding Multimodal Metaphorscited by 10
- 2022MiQA: A Benchmark for Inference on Metaphorical Questionscited by 9
- 2023Adversarial Multi-task Learning for End-to-end Metaphor Detectioncited by 7
12 most cited of 45 All 45 (JSON)
- 2026Cross-Dataset Stability of Expert-Informed Skill Prompting and Fine-Tuning for Chinese Metaphor Identification26 Aug 2026
- 2026CAMMAR: Culture-Aware Matryoshka for Metaphorical Arabic Representations17 Jul 2026
- 2026Post-Hoc Understanding of Metaphor Processing in Decoder-Only Language Models via Conditional Scale Entropy20 May 2026
- 2026A Reproducible Multi-Architecture Baseline for Token-Level Chinese Metaphor Identification under the MIPVU Framework8 May 2026
- 2026Not all ANIMALs are equal: metaphorical framing through source domains and semantic frames22 Apr 2026
- 2026Learning the Cue or Learning the Word? Analyzing Generalization in Metaphor Detection for Verbs15 Apr 2026
- 2026Interpretable Chinese Metaphor Identification via LLM-Assisted MIPVU Rule Script Generation: A Comparative Protocol Study11 Mar 2026
- 2025Probing Semantic Alignment, Lexical Invariance, and Syntactic Influence in LLM Metaphor Processing5 Oct 2025
- 2025The Medical Metaphors Corpus (MCC)11 Aug 2025
- 2025Exploring Task Performance with Interpretable Models via Sparse Auto-Encoders8 Jul 2025
- 2025Cultural Bias Matters: A Cross-Cultural Benchmark Dataset and Sentiment-Enriched Model for Understanding Multimodal Metaphors8 Jun 2025
- 2025When People are Floods: Analyzing Dehumanizing Metaphors in Immigration Discourse with Large Language Models18 Feb 2025
12 newest of 45 All 45 (JSON)