mlsanityData to 14 Oct 2026

ACR-Net: Mitigating Semantic Dominance via Contrastive Acoustic-Semantic Decoupling

arXiv 2610.20114 ↗First posted 14 Oct 2026cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Speech Emotion Recognition (SER) models and Audio LLMs fail when vocal tone contradicts textual semantics. Extensive training on congruent data engenders a rigid semantic prior, causing "Semantic Dominance", a severe text bias during cross-modal conflicts. We introduce the ASPIRE benchmark of adversarial audio-text pairs across four conflict types, alongside two metrics: Semantic Overconfidence Penalty (SOP) and Latent Decoupling Degree (LDD). Unlike fusion methods that merely re-weight collapsed features, our Acoustic Conflict Resolution Network (ACR-Net) uses Cross-Modal Attention and Contrastive Decoupling Loss to disentangle contradictory representations into orthogonal latent spaces. Experiments show existing models fail under polarity conflicts due to extreme semantic overconfidence. Conversely, ACR-Net preserves acoustic fidelity, maintaining high LDD to drive SOP near zero, achieving superior Acoustic Accuracy (ACC) in both adversarial and standard scenarios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

16 of 29 references.

References · 16

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2020Supervised Contrastive Learningcited by 2,829
  4. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  5. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  6. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
  7. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 608
  8. 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 433
  9. 2019What Makes Training Multi-Modal Classification Networks Hard?cited by 344
  10. 2023AudioPaLM: A Large Language Model That Can Speak and Listencited by 343
  11. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 264
  12. 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 205
4 more
  1. 2019Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)cited by 174
  2. 2024Towards Multimodal Sentiment Analysis Debiasing via Bias Purificationcited by 27
  3. 2026When Tone and Words Disagree: Towards Robust Speech Emotion Recognition under Acoustic-Semantic Conflictcited by 4
  4. 2025Calibrating Multimodal Consensus for Emotion Recognitioncited by 2

Built on by

Not cited yet.