mlsanityData to 14 Oct 2026

WDMIR: Wavelet-Driven Multimodal Intent Recognition

arXiv 2506.10011 ↗First posted 27 May 2025cs.MM cs.AI cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Multimodal intent recognition (MIR) seeks to accurately interpret user intentions by integrating verbal and non-verbal information across video, audio and text modalities. While existing approaches prioritize text analysis, they often overlook the rich semantic content embedded in non-verbal cues. This paper presents a novel Wavelet-Driven Multimodal Intent Recognition(WDMIR) framework that enhances intent understanding through frequency-domain analysis of non-verbal information. To be more specific, we propose: (1) a wavelet-driven fusion module that performs synchronized decomposition and integration of video-audio features in the frequency domain, enabling fine-grained analysis of temporal dynamics; (2) a cross-modal interaction mechanism that facilitates progressive feature enhancement from bimodal to trimodal integration, effectively bridging the semantic gap between verbal and non-verbal information. Extensive experiments on MIntRec demonstrate that our approach achieves state-of-the-art performance, surpassing previous methods by 1.13% on accuracy. Ablation studies further verify that the wavelet-driven fusion module significantly improves the extraction of semantic information from non-verbal sources, with a 0.41% increase in recognition accuracy when analyzing subtle emotional cues.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 15 of its 33 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

15 of 33 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
  5. 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 433
  6. 2020MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysiscited by 265
  7. 2022MIntRec: A New Dataset for Multimodal Intent Recognitioncited by 41
  8. 2023Token-Level Contrastive Learning with Modality-Aware Prompting for Multimodal Intent Recognitioncited by 18
  9. 2022Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysiscited by 10
  10. 2022Robust Time Series Denoising with Learnable Wavelet Packet Transformcited by 10
  11. 2022Divide and Conquer: Text Semantic Matching with Disentangled Keywords and Intentscited by 9
  12. 2023SDIF-DA: A Shallow-to-Deep Interaction Framework with Data Augmentation for Multi-modal Intent Detectioncited by 7
3 more
  1. 2022Graph Adaptive Semantic Transfer for Cross-domain Sentiment Classificationcited by 6
  2. 2024Leveraging Entity Information for Cross-Modality Correlation Learning: The Entity-Guided Multimodal Summarizationcited by 4
  3. 2025DASKT: A Dynamic Affect Simulation Method for Knowledge Tracingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.