MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System
Not on the map. Why?
Abstract (arXiv)
Multi-modal sarcasm detection has attracted much recent attention. Nevertheless, the existing benchmark (MMSD) has some shortcomings that hinder the development of reliable multi-modal sarcasm detection system: (1) There are some spurious cues in MMSD, leading to the model bias learning; (2) The negative samples in MMSD are not always reasonable. To solve the aforementioned issues, we introduce MMSD2.0, a correction dataset that fixes the shortcomings of MMSD, by removing the spurious cues and re-annotating the unreasonable samples. Meanwhile, we present a novel framework called multi-view CLIP that is capable of leveraging multi-grained cues from multiple perspectives (i.e., text, image, and text-image interaction view) for multi-modal sarcasm detection. Extensive experiments show that MMSD2.0 is a valuable benchmark for building reliable multi-modal sarcasm detection systems and multi-view CLIP can significantly outperform the previous best baselines.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 13 of its 29 references that are in the map. First posted on arXiv 14 Jul 2023.
Builds on
13 of 29 references.
References · 13
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
- 2022CLIP-Art: Contrastive Pre-training for Fine-Grained Art Classificationcited by 65
- 2016Detecting Sarcasm in Multimodal Social Platformscited by 44
- 2022Multimodal Fake News Detection via CLIP-Guided Learningcited by 42
- 2016A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networkscited by 33
- 2022Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancementcited by 27
1 more
Built on by
Citing papers per year: 2023: 1; 2024: 8; 2025: 13; 2026: 9.
31 papers.
Sort:
By area:
- 2024Large Language Models Meet NLP: A Surveycited by 103
- 2023MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Expertscited by 21
- 2024SarcasmBench: Towards Evaluating Large Language Models on Sarcasm Understandingcited by 20
- 2024A Survey of Multimodal Sarcasm Detectioncited by 19
- 2024Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Surveycited by 16
- 2024CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal Modelscited by 8
- 2025Beyond Spurious Signals: Debiasing Multimodal Large Language Models via Counterfactual Inference and Adaptive Expert Routingcited by 5
- 2024InterCLIP-MEP: Interactive CLIP and Memory-Enhanced Predictor for Multi-modal Sarcasm Detectioncited by 4
- 2024Multi-View Incongruity Learning for Multimodal Sarcasm Detectioncited by 4
- 2024RCLMuFN: Relational Context Learning and Multiplex Fusion Network for Multimodal Sarcasm Detectioncited by 4
- 2025Seeing Sarcasm Through Different Eyes: Analyzing Multimodal Sarcasm Perception in Large Vision-Language Modelscited by 4
- 2025Commander-GPT: Fully Unleashing the Sarcasm Detection Capability of Multi-Modal Large Language Modelscited by 3
19 more
- 2025IRONIC: Coherence-Aware Reasoning Chains for Multi-Modal Sarcasm Detectioncited by 3
- 2025Evaluating Open-Source Vision-Language Models for Multimodal Sarcasm Detectioncited by 3
- 2025SatireDecoder: Visual Cascaded Decoupling for Enhancing Satirical Image Comprehensioncited by 3
- 2025Are MLMs Trapped in the Visual Room?cited by 2
- 2025Commander-GPT: Dividing and Routing for Multimodal Sarcasm Detectioncited by 2
- 2025Evaluating Multimodal Large Language Models on Spoken Sarcasm Understandingcited by 2
- 2026CFMS: Towards Explainable and Fine-Grained Chinese Multimodal Sarcasm Detection Benchmarkcited by 2
- 2025Adapter-state Sharing CLIP for Parameter-efficient Multimodal Sarcasm Detectioncited by 1
- 2025MuSaG: A Multimodal German Sarcasm Dataset with Full-Modal Annotationscited by 1
- 2026GDCNet: Generative Discrepancy Comparison Network for Multimodal Sarcasm Detectioncited by 1
- 2026Small Cues, Big Consequences: Learning Pivotal Cues for Multimodal Meme Classificationcited by 1
- 2025ViSP: A PPO-Driven Framework for Sarcasm Generation with Contrastive Learningcited by 0
- 2025Teaching Sarcasm: Few-Shot Multimodal Sarcasm Detection via Distillation to a Parameter-Efficient Studentcited by 0
- 2026ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detectioncited by 0
- 2026Beyond the Literal: Decomposing Pragmatic Intent in Multimodal Meme Understandingcited by 0
- 2026HCIG: A Hierarchical Cross-Modal Incongruity Graph Network for Multimodal Sarcasm and Cyberbullying Detectioncited by 0
- 2026MoCA: Implicit Social Context Analysiscited by 0
- 2026PragMatch: Separating Pragmatic Incongruity from Cross-Modal Mismatch in Large Vision-Language Modelscited by 0
- 2026Dynamic Gated Cross-Modal Fusion with Sarcastic-aware Contrastive Regularization for Multimodal Sarcasm Detectioncited by 0
- 2026Small Cues, Big Consequences: Learning Pivotal Cues for Multimodal Meme Classification22 Sep 2026
- 2026Dynamic Gated Cross-Modal Fusion with Sarcastic-aware Contrastive Regularization for Multimodal Sarcasm Detection20 Aug 2026
- 2026PragMatch: Separating Pragmatic Incongruity from Cross-Modal Mismatch in Large Vision-Language Models10 Aug 2026
- 2026MoCA: Implicit Social Context Analysis6 Aug 2026
- 2026HCIG: A Hierarchical Cross-Modal Incongruity Graph Network for Multimodal Sarcasm and Cyberbullying Detection17 Jul 2026
- 2026Beyond the Literal: Decomposing Pragmatic Intent in Multimodal Meme Understanding2 Jun 2026
- 2026ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detection20 May 2026
- 2026CFMS: Towards Explainable and Fine-Grained Chinese Multimodal Sarcasm Detection Benchmark23 Mar 2026
- 2026GDCNet: Generative Discrepancy Comparison Network for Multimodal Sarcasm Detection28 Jan 2026
- 2025SatireDecoder: Visual Cascaded Decoupling for Enhancing Satirical Image Comprehension29 Nov 2025
- 2025Teaching Sarcasm: Few-Shot Multimodal Sarcasm Detection via Distillation to a Parameter-Efficient Student29 Oct 2025
- 2025MuSaG: A Multimodal German Sarcasm Dataset with Full-Modal Annotations28 Oct 2025
19 more
- 2025Evaluating Open-Source Vision-Language Models for Multimodal Sarcasm Detection13 Oct 2025
- 2025Evaluating Multimodal Large Language Models on Spoken Sarcasm Understanding18 Sep 2025
- 2025Beyond Spurious Signals: Debiasing Multimodal Large Language Models via Counterfactual Inference and Adaptive Expert Routing18 Sep 2025
- 2025ViSP: A PPO-Driven Framework for Sarcasm Generation with Contrastive Learning13 Jul 2025
- 2025Adapter-state Sharing CLIP for Parameter-efficient Multimodal Sarcasm Detection6 Jul 2025
- 2025Commander-GPT: Dividing and Routing for Multimodal Sarcasm Detection24 Jun 2025
- 2025Are MLMs Trapped in the Visual Room?29 May 2025
- 2025IRONIC: Coherence-Aware Reasoning Chains for Multi-Modal Sarcasm Detection22 May 2025
- 2025Commander-GPT: Fully Unleashing the Sarcasm Detection Capability of Multi-Modal Large Language Models24 Mar 2025
- 2025Seeing Sarcasm Through Different Eyes: Analyzing Multimodal Sarcasm Perception in Large Vision-Language Models15 Mar 2025
- 2024RCLMuFN: Relational Context Learning and Multiplex Fusion Network for Multimodal Sarcasm Detection17 Dec 2024
- 2024Multi-View Incongruity Learning for Multimodal Sarcasm Detection1 Dec 2024
- 2024A Survey of Multimodal Sarcasm Detection24 Oct 2024
- 2024SarcasmBench: Towards Evaluating Large Language Models on Sarcasm Understanding21 Aug 2024
- 2024InterCLIP-MEP: Interactive CLIP and Memory-Enhanced Predictor for Multi-modal Sarcasm Detection24 Jun 2024
- 2024Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey12 Jun 2024
- 2024Large Language Models Meet NLP: A Survey21 May 2024
- 2024CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal Models1 May 2024
- 2023MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts16 Nov 2023
- 2025Seeing Sarcasm Through Different Eyes: Analyzing Multimodal Sarcasm Perception in Large Vision-Language Modelscited by 4
- 2025Evaluating Open-Source Vision-Language Models for Multimodal Sarcasm Detectioncited by 3
- 2025Evaluating Multimodal Large Language Models on Spoken Sarcasm Understandingcited by 2
- 2026Beyond the Literal: Decomposing Pragmatic Intent in Multimodal Meme Understandingcited by 0
- 2026PragMatch: Separating Pragmatic Incongruity from Cross-Modal Mismatch in Large Vision-Language Modelscited by 0
- 2026PragMatch: Separating Pragmatic Incongruity from Cross-Modal Mismatch in Large Vision-Language Models10 Aug 2026
- 2026Beyond the Literal: Decomposing Pragmatic Intent in Multimodal Meme Understanding2 Jun 2026
- 2025Evaluating Open-Source Vision-Language Models for Multimodal Sarcasm Detection13 Oct 2025
- 2025Evaluating Multimodal Large Language Models on Spoken Sarcasm Understanding18 Sep 2025
- 2025Seeing Sarcasm Through Different Eyes: Analyzing Multimodal Sarcasm Perception in Large Vision-Language Models15 Mar 2025
- 2025Beyond Spurious Signals: Debiasing Multimodal Large Language Models via Counterfactual Inference and Adaptive Expert Routingcited by 5
- 2025IRONIC: Coherence-Aware Reasoning Chains for Multi-Modal Sarcasm Detectioncited by 3
- 2026ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detectioncited by 0
- 2026ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detection20 May 2026
- 2025Beyond Spurious Signals: Debiasing Multimodal Large Language Models via Counterfactual Inference and Adaptive Expert Routing18 Sep 2025
- 2025IRONIC: Coherence-Aware Reasoning Chains for Multi-Modal Sarcasm Detection22 May 2025
- 2024Large Language Models Meet NLP: A Surveycited by 103
- 2023MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Expertscited by 21
- 2024SarcasmBench: Towards Evaluating Large Language Models on Sarcasm Understandingcited by 20
- 2024A Survey of Multimodal Sarcasm Detectioncited by 19
- 2024Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Surveycited by 16
- 2024CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal Modelscited by 8
- 2024InterCLIP-MEP: Interactive CLIP and Memory-Enhanced Predictor for Multi-modal Sarcasm Detectioncited by 4
- 2024Multi-View Incongruity Learning for Multimodal Sarcasm Detectioncited by 4
- 2024RCLMuFN: Relational Context Learning and Multiplex Fusion Network for Multimodal Sarcasm Detectioncited by 4
- 2025Commander-GPT: Fully Unleashing the Sarcasm Detection Capability of Multi-Modal Large Language Modelscited by 3
- 2025SatireDecoder: Visual Cascaded Decoupling for Enhancing Satirical Image Comprehensioncited by 3
- 2025Are MLMs Trapped in the Visual Room?cited by 2
12 most cited of 22 All 22 (JSON)
- 2026Small Cues, Big Consequences: Learning Pivotal Cues for Multimodal Meme Classification22 Sep 2026
- 2026Dynamic Gated Cross-Modal Fusion with Sarcastic-aware Contrastive Regularization for Multimodal Sarcasm Detection20 Aug 2026
- 2026MoCA: Implicit Social Context Analysis6 Aug 2026
- 2026HCIG: A Hierarchical Cross-Modal Incongruity Graph Network for Multimodal Sarcasm and Cyberbullying Detection17 Jul 2026
- 2026CFMS: Towards Explainable and Fine-Grained Chinese Multimodal Sarcasm Detection Benchmark23 Mar 2026
- 2026GDCNet: Generative Discrepancy Comparison Network for Multimodal Sarcasm Detection28 Jan 2026
- 2025SatireDecoder: Visual Cascaded Decoupling for Enhancing Satirical Image Comprehension29 Nov 2025
- 2025MuSaG: A Multimodal German Sarcasm Dataset with Full-Modal Annotations28 Oct 2025
- 2025ViSP: A PPO-Driven Framework for Sarcasm Generation with Contrastive Learning13 Jul 2025
- 2025Adapter-state Sharing CLIP for Parameter-efficient Multimodal Sarcasm Detection6 Jul 2025
- 2025Commander-GPT: Dividing and Routing for Multimodal Sarcasm Detection24 Jun 2025
- 2025Are MLMs Trapped in the Visual Room?29 May 2025
12 newest of 22 All 22 (JSON)