Multilingual Emotion Neurons in Large Audio-Language Models
Not on the map. Why?
Abstract (arXiv)
Emotion is central to human communication, and its expression varies across languages. Large audio-language models (LALMs) achieve strong performance on multilingual speech tasks, yet it remains unclear whether they encode emotion through language-specific correlations or language-agnostic representations. We present the first neuron-level interpretability study of this question. We define Multilingual Emotion Neurons (MLENs) as functional units exhibiting stable emotional selectivity and aligned causal effects across languages, and introduce Consistency-Regularized Fusion (CR-Fusion) to identify them. Across four modern LALMs and 12 typologically diverse languages, emotion-sensitive neurons identified independently per language show minimal overlap, and additional monolingual identification data saturates quickly without isolating more transferable units, motivating identification from pooled cross-lingual evidence. Causal interventions demonstrate that MLENs identified by CR-Fusion provide more precise and transferable affective control than monolingual neuron sets in both zero-shot and low-resource settings. Leave-one-out ablations further reveal asymmetric transfer: individual identification languages, including low-resource ones, contribute non-redundant evidence, while several low-resource languages benefit most from the resulting cross-lingual transfer. Together, our findings provide the first causal, neuron-level account of how LALMs encode emotion across languages, and establish multilingual neuron identification as an effective mechanism for understanding cross-lingual affective behavior.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 56 references that are in the map. First posted on arXiv 9 Aug 2026.
Builds on
25 of 56 references.
References · 25
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 708
- 2017Six Challenges for Neural Machine Translationcited by 335
- 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 288
- 2018Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesiscited by 259
- 2020Understanding the Role of Individual Units in a Deep Neural Networkcited by 255
- 2018Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotroncited by 173
- 2018What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Modelscited by 124
- 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuningcited by 121
- 2018Identifying and Controlling Important Neurons in Neural Machine Translationcited by 111
- 2024Universal Neurons in GPT2 Language Modelscited by 102
- 2023Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speechcited by 101
13 more
- 2023Neurons in Large Language Models: Dead, N-gram, Positionalcited by 88
- 2024EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmarkcited by 40
- 2020Expressive TTS Training with Frame and Style Reconstruction Losscited by 30
- 2020Fine-grained Emotion Strength Transfer, Control and Prediction for Emotional Speech Synthesiscited by 29
- 2025EmoSteer-TTS: Fine-Grained and Training-Free Emotion-Controllable Text-to-Speech via Activation Steeringcited by 23
- 2019ShEMO -- A Large-Scale Validated Database for Persian Speech Emotion Detectioncited by 21
- 2019End-to-End Emotional Speech Synthesis Using Style Tokens and Semi-Supervised Trainingcited by 19
- 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Surveycited by 19
- 2025Do LLMs "Feel"? Emotion Circuits Discovery and Controlcited by 17
- 2018Cross-lingual and Multilingual Speech Emotion Recognition on English and Frenchcited by 10
- 2022A New Amharic Speech Emotion Dataset and Classification Benchmarkcited by 5
- 2024nEMO: Dataset of Emotional Speech in Polishcited by 3
- 2024Cross-Lingual Speech Emotion Recognition: Humans vs. Self-Supervised Modelscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.