Do SpeechLMs Hear Their Own Opinions? Diagnosing and Mitigating Previous-Belief Contamination in Streaming Emotion Understanding
Not on the map. Why?
Abstract (arXiv)
Streaming emotion understanding uses historical state while continuously interpreting current audio, often feeding the model's previous prediction back as context. We show that this history conditioning can distort current perception. On a balanced CREMA-D-Stream counterfactual diagnostic, changing only the injected previous emotion label while holding the audio fixed reduces current-audio accuracy from 72.50% to 30.42% and flips 65.69% of predictions. The effect is strongly label-asymmetric, with prior pull ranging from 4.76% to 98.20%, revealing a failure we call previous-belief contamination (PBC). To address PBC, we introduce EmoUpdate, a training-free framework that separates current-audio perception from historical state revision through three components: (1) a prior-blind acoustic firewall that prevents historical state from entering perception; (2) an evidence-shrunk causal belief filter that introduces history only after observation formation and retains label-asymmetric transition structure only when supported by observed evidence; and (3) a closed-form decontamination operator derived from the same counterfactual measurements for serving stacks where firewalling is unavailable. Across four SpeechLMs and two streaming emotion benchmarks, EmoUpdate achieves the best step accuracy and state-balanced accuracy in all eight model--benchmark settings, improving S-BAcc by up to 69.71 points and step accuracy by up to 38.41 points over the strongest controlled baselines.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
36 of 46 references.
References · 36
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
24 more
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 803
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
- 2015Sequence Level Training with Recurrent Neural Networkscited by 576
- 2024Qwen2-Audio Technical Reportcited by 560
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
- 2018Detecting and Correcting for Label Shift with Black Box Predictorscited by 366
- 2016Professor Forcing: A New Algorithm for Training Recurrent Networkscited by 216
- 2023Listen, Think, and Understandcited by 209
- 2020On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translationcited by 127
- 2019Generalization in Generation: A closer look at Exposure Biascited by 123
- 2019Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advancescited by 119
- 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 109
- 2022Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generationcited by 108
- 2024Context-Parametric Inversion: Why Instruction Finetuning Can Worsen Context Reliancecited by 10
- 2023EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversationcited by 7
- 2026Do Audio LLMs Listen or Read? Analyzing and Mitigating Paralinguistic Failures with VoxParadoxcited by 7
- 2024Emotion Neural Transducer for Fine-Grained Speech Emotion Recognitioncited by 3
- 2026VowelPrompt: Hearing Speech Emotions from Text via Vowel-level Prosodic Augmentationcited by 3
- 2026HumDial-EIBench: A Human-Recorded Multi-Turn Emotional Intelligence Benchmark for Audio Language Modelscited by 2
- 2026Learning When to Think While Listening in Large Audio-Language Modelscited by 2
- 2026SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversationscited by 2
- 2026EmoS: A High-Fidelity Multimodal Benchmark for Fine-grained Streaming Emotional Understandingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026AMemOps: Evaluating Memory Updates in Long Audio Streamscited by 0
- 2026AMemOps: Evaluating Memory Updates in Long Audio Streams13 Oct 2026