Focus on What You Need: Global-to-Local Dynamic Attention for Multimodal Sarcasm Detection
Not on the map. Why?
Abstract (arXiv)
Multimodal sarcasm detection has attracted increasing attention due to the widespread use of images and text on social media platforms. Existing studies generally treat the semantic or emotional inconsistency between images and text as a key cue for identifying sarcastic expressions. However, images in real-world scenarios often contain multiple visual objects, many of which are irrelevant to sarcasm-related semantics. Such redundant visual information may introduce noise during cross-modal interaction, distracting models from focusing on critical sarcasm cues and potentially leading to inaccurate predictions. To address this issue, we propose GLDA (Global-to-Local Dynamic Attention), a multimodal sarcasm detection framework that models cross-modal interactions from a global-to-local perspective. Specifically, GLDA first employs a global multimodal fusion module to capture high-level semantic interactions between visual and textual modalities, enabling the model to identify coarse-grained cross-modal inconsistencies. To further reduce the influence of irrelevant objects, GLDA introduces a local gated cross-modal attention mechanism that dynamically filters redundant visual and textual features and refines multimodal representations at a finer granularity. In addition, a multi-branch learning objective is designed to jointly optimize unimodal and multimodal representations. Experimental results demonstrate that GLDA effectively improves sarcasm detection performance and achieves competitive results compared with existing approaches. The code will be available at https://anonymous.4open.science/r/GLDA-DBE6.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 43 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
16 of 43 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Predictioncited by 118
- 2022Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformercited by 101
- 2016Detecting Sarcasm in Multimodal Social Platformscited by 44
- 2021Multimodal Learning using Optimal Transport for Sarcasm and Humor Detectioncited by 37
- 2025Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Reportcited by 31
- 2022Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancementcited by 27
- 2024Stepping Stones: A Progressive Training Strategy for Audio-Visual Semantic Segmentationcited by 23
- 2024SEA: Supervised Embedding Alignment for Token-Level Visual-Textual Integration in MLLMscited by 19
4 more
- 2024Law of Vision Representation in MLLMscited by 18
- 2023Debiasing Multimodal Sarcasm Detection with Contrastive Learningcited by 13
- 2024Advancing Fine-Grained Visual Understanding with Multi-Scale Alignment in Multi-Modal Modelscited by 11
- 2025Analyzing Fine-Grained Alignment and Enhancing Vision Understanding in Multimodal Language Modelscited by 9
Built on by
Not cited yet.