mlsanityData to 14 Oct 2026

MVCL-DAF++: Enhancing Multimodal Intent Recognition via Prototype-Aware Contrastive Alignment and Coarse-to-Fine Dynamic Attention Fusion

arXiv 2509.17446 ↗First posted 22 Sep 2025cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Multimodal intent recognition (MMIR) suffers from weak semantic grounding and poor robustness under noisy or rare-class conditions. We propose MVCL-DAF++, which extends MVCL-DAF with two key modules: (1) Prototype-aware contrastive alignment, aligning instances to class-level prototypes to enhance semantic consistency; and (2) Coarse-to-fine attention fusion, integrating global modality summaries with token-level features for hierarchical cross-modal interaction. On MIntRec and MIntRec2.0, MVCL-DAF++ achieves new state-of-the-art results, improving rare-class recognition by +1.05% and +4.18% WF1, respectively. These results demonstrate the effectiveness of prototype-guided learning and coarse-to-fine fusion for robust multimodal understanding. The source code is available at https://github.com/chr1s623/MVCL-DAF-PlusPlus.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 21 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

18 of 21 references.

References · 18

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  3. 2020Supervised Contrastive Learningcited by 2,829
  4. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
  5. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
  6. 2021Attention Bottlenecks for Multimodal Fusioncited by 361
  7. 2021Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysiscited by 131
  8. 2021Can contrastive learning avoid shortcut solutions?cited by 114
  9. 2023Factorized Contrastive Learning: Going Beyond Multi-view Redundancycited by 75
  10. 2022Dynamic Multimodal Fusioncited by 55
  11. 2023HiCLIP: Contrastive Language-Image Pretraining with Hierarchy-aware Attentioncited by 44
  12. 2022Towards Visual-Prompt Temporal Answering Grounding in Medical Instructional Videocited by 43
6 more
  1. 2022MIntRec: A New Dataset for Multimodal Intent Recognitioncited by 41
  2. 2025Visual Document Understanding and Reasoning: A Multi-Agent Collaboration Framework with Agent-Wise Adaptive Test-Time Scalingcited by 30
  3. 2025Temporal Working Memory: Query-Guided Segment Refinement for Enhanced Multimodal Understandingcited by 28
  4. 2024MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent Recognition and Out-of-scope Detection in Conversationscited by 26
  5. 2023Token-Level Contrastive Learning with Modality-Aware Prompting for Multimodal Intent Recognitioncited by 18
  6. 2025Deep Learning Approaches for Multimodal Intent Recognition: A Surveycited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Modality Agreement- and Conflict-Aware Prototype Hypergraph Learning for Multimodal Intent Understandingcited by 0