mlsanityData to 7 Oct 2026

Modality-Invariant Bidirectional Temporal Representation Distillation Network for Missing Multimodal Sentiment Analysis

arXiv 2501.05474 ↗First posted 7 Jan 2025cs.CL cs.AI cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Multimodal Sentiment Analysis (MSA) integrates diverse modalities(text, audio, and video) to comprehensively analyze and understand individuals' emotional states. However, the real-world prevalence of incomplete data poses significant challenges to MSA, mainly due to the randomness of modality missing. Moreover, the heterogeneity issue in multimodal data has yet to be effectively addressed. To tackle these challenges, we introduce the Modality-Invariant Bidirectional Temporal Representation Distillation Network (MITR-DNet) for Missing Multimodal Sentiment Analysis. MITR-DNet employs a distillation approach, wherein a complete modality teacher model guides a missing modality student model, ensuring robustness in the presence of modality missing. Simultaneously, we developed the Modality-Invariant Bidirectional Temporal Representation Learning Module (MIB-TRL) to mitigate heterogeneity.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 7 Jan 2025.

Builds on

15 of 28 references.

References · 15

  1. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  2. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  3. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
  4. 2020MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysiscited by 262
  5. 2016MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videoscited by 193
  6. 2021Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysiscited by 179
  7. 2023Decoupled Multimodal Distilling for Emotion Recognitioncited by 76
  8. 2022Sound Adversarial Audio-Visual Navigationcited by 46
  9. 2023Measuring Acoustics with Collaborative Multiple Agentscited by 21
  10. 2022Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysiscited by 20
  11. 2022Pay Self-Attention to Audio-Visual Navigationcited by 17
  12. 2022SRTNet: Time Domain Speech Enhancement Via Stochastic Refinementcited by 12
3 more
  1. 2020Cross-Modal Retrieval and Synthesis (X-MRS): Closing the Modality Gap in Shared Representation Learningcited by 9
  2. 2024MFHCA: Enhancing Speech Emotion Recognition Via Multi-Spatial Fusion and Hierarchical Cooperative Attentioncited by 6
  3. 2024PCQ: Emotion Recognition in Speech via Progressive Channel Queryingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

  1. 2026ML-SAN: Multi-Level Speaker-Adaptive Network for Emotion Recognition in Conversationscited by 0
  2. 2026MRUF: Multi-granularity Routing with Uncertainty-Aware Fusion for Robust Multimodal Sentiment Analysiscited by 0
  3. 2026HRO: Hierarchical Room-to-Object Framework for Zero-Shot Object Goal Navigation with Large Language Modelscited by 0
  4. 2026CTAN: Cycle-Temporal Attention Network for Embodied Audio-Visual Navigationcited by 0
  5. 2026Transformer-Based Token Fusion and Dynamic Graph Planning for Audio-Visual Navigationcited by 0
  6. 2026Talking Head Synthesis with Facial Landmark Guidance via 3D Gaussian Splattingcited by 0
  7. 2026WS-NeRF: A Mamba-Driven World-State-Aware Adaptive Deblurring Neural Radiance Fieldcited by 0