mlsanityData to 7 Oct 2026

GDCNet: Generative Discrepancy Comparison Network for Multimodal Sarcasm Detection

arXiv 2601.20618 ↗First posted 28 Jan 2026cs.CV cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Multimodal sarcasm detection (MSD) aims to identify sarcasm within image-text pairs by modeling semantic incongruities across modalities. Existing methods often exploit cross-modal embedding misalignment to detect inconsistency but struggle when visual and textual content are loosely related or semantically indirect. While recent approaches leverage large language models (LLMs) to generate sarcastic cues, the inherent diversity and subjectivity of these generations often introduce noise. To address these limitations, we propose the Generative Discrepancy Comparison Network (GDCNet). This framework captures cross-modal conflicts by utilizing descriptive, factually grounded image captions generated by Multimodal LLMs (MLLMs) as stable semantic anchors. Specifically, GDCNet computes semantic and sentiment discrepancies between the generated objective description and the original text, alongside measuring visual-textual fidelity. These discrepancy features are then fused with visual and textual representations via a gated module to adaptively balance modality contributions. Extensive experiments on MSD benchmarks demonstrate GDCNet's superior accuracy and robustness, establishing a new state-of-the-art on the MMSD2.0 benchmark.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 28 Jan 2026.

Builds on

14 of 26 references.

References · 14

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  6. 2024GPT-4o System Cardcited by 4,467
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  8. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  9. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  10. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  11. 2023MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection Systemcited by 31
  12. 2022Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancementcited by 26
2 more
  1. 2024A Survey of Multimodal Sarcasm Detectioncited by 19
  2. 2024CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal Modelscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Evaluating Open-Source Vision-Language Models for Multimodal Sarcasm Detection
  2. 2025MMSD3.0: A Multi-Image Benchmark for Real-World Multimodal Sarcasm Detection
  3. 2026URMF: Uncertainty-aware Robust Multimodal Fusion for Multimodal Sarcasm Detection
  4. 2025Think Twice Before You Judge: Mixture of Dual Reasoning Experts for Multimodal Sarcasm Detection
  5. 2025Can Large Vision-Language Models Understand Multimodal Sarcasm?
  6. 2025Seeing Sarcasm Through Different Eyes: Analyzing Multimodal Sarcasm Perception in Large Vision-Language Models
  7. 2025Evaluating Multimodal Large Language Models on Spoken Sarcasm Understanding
  8. 2025MuSaG: A Multimodal German Sarcasm Dataset with Full-Modal Annotations