mlsanityData to 7 Oct 2026

Dual Modality-Aware Gated Prompt Tuning for Few-Shot Multimodal Sarcasm Detection

arXiv 2507.04468 ↗First posted 6 Jul 2025cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

The widespread use of multimodal content on social media has heightened the need for effective sarcasm detection to improve opinion mining. However, existing models rely heavily on large annotated datasets, making them less suitable for real-world scenarios where labeled data is scarce. This motivates the need to explore the problem in a few-shot setting. To this end, we introduce DMDP (Deep Modality-Disentangled Prompt Tuning), a novel framework for few-shot multimodal sarcasm detection. Unlike prior methods that use shallow, unified prompts across modalities, DMDP employs gated, modality-specific deep prompts for text and visual encoders. These prompts are injected across multiple layers to enable hierarchical feature learning and better capture diverse sarcasm types. To enhance intra-modal learning, we incorporate a prompt-sharing mechanism across layers, allowing the model to aggregate both low-level and high-level semantic cues. Additionally, a cross-modal prompt alignment module enables nuanced interactions between image and text representations, improving the model's ability to detect subtle sarcastic intent. Experiments on two public datasets demonstrate DMDP's superior performance in both few-shot and extremely low-resource settings. Further cross-dataset evaluations show that DMDP generalizes well across domains, consistently outperforming baseline methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 54 references that are in the map. First posted on arXiv 6 Jul 2025.

Builds on

21 of 54 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  6. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  7. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  8. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  9. 2023CLIP goes 3D: Leveraging Prompt Tuning for Language Grounded 3D Recognitioncited by 77
  10. 2023E^2VPT: An Effective and Efficient Approach for Visual Prompt Tuningcited by 70
  11. 2023Prompting for Multimodal Hateful Meme Classificationcited by 68
  12. 2023Improving Visual Prompt Tuning for Self-supervised Vision Transformerscited by 57
9 more
  1. 2016Detecting Sarcasm in Multimodal Social Platformscited by 43
  2. 2016A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networkscited by 33
  3. 2016Modelling Context with User Embeddings for Sarcasm Detection in Social Mediacited by 26
  4. 2022Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancementcited by 26
  5. 2017The Role of Conversation Context for Sarcasm Detection in Online Interactionscited by 16
  6. 2023Seeing in Flowing: Adapting CLIP for Action Recognition with Motion Prompts Learningcited by 16
  7. 2016Are Word Embedding-based Features Useful for Sarcasm Detection?cited by 14
  8. 2021A Dual-Channel Framework for Sarcasm Recognition by Detecting Sentiment Conflictcited by 14
  9. 2021"Laughing at you or with you": The Role of Sarcasm in Shaping the Disagreement Spacecited by 5

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.