mlsanityData to 14 Oct 2026

Multilingual Emotion Neurons in Large Audio-Language Models

arXiv 2608.08772 ↗First posted 9 Aug 2026cs.CL eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

Emotion is central to human communication, and its expression varies across languages. Large audio-language models (LALMs) achieve strong performance on multilingual speech tasks, yet it remains unclear whether they encode emotion through language-specific correlations or language-agnostic representations. We present the first neuron-level interpretability study of this question. We define Multilingual Emotion Neurons (MLENs) as functional units exhibiting stable emotional selectivity and aligned causal effects across languages, and introduce Consistency-Regularized Fusion (CR-Fusion) to identify them. Across four modern LALMs and 12 typologically diverse languages, emotion-sensitive neurons identified independently per language show minimal overlap, and additional monolingual identification data saturates quickly without isolating more transferable units, motivating identification from pooled cross-lingual evidence. Causal interventions demonstrate that MLENs identified by CR-Fusion provide more precise and transferable affective control than monolingual neuron sets in both zero-shot and low-resource settings. Leave-one-out ablations further reveal asymmetric transfer: individual identification languages, including low-resource ones, contribute non-redundant evidence, while several low-resource languages benefit most from the resulting cross-lingual transfer. Together, our findings provide the first causal, neuron-level account of how LALMs encode emotion across languages, and establish multilingual neuron identification as an effective mechanism for understanding cross-lingual affective behavior.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 56 references that are in the map. First posted on arXiv 9 Aug 2026.

Builds on

25 of 56 references.

References · 25

  1. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  2. 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 708
  3. 2017Six Challenges for Neural Machine Translationcited by 335
  4. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 288
  5. 2018Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesiscited by 259
  6. 2020Understanding the Role of Individual Units in a Deep Neural Networkcited by 255
  7. 2018Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotroncited by 173
  8. 2018What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Modelscited by 124
  9. 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuningcited by 121
  10. 2018Identifying and Controlling Important Neurons in Neural Machine Translationcited by 111
  11. 2024Universal Neurons in GPT2 Language Modelscited by 102
  12. 2023Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speechcited by 101
13 more
  1. 2023Neurons in Large Language Models: Dead, N-gram, Positionalcited by 88
  2. 2024EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmarkcited by 40
  3. 2020Expressive TTS Training with Frame and Style Reconstruction Losscited by 30
  4. 2020Fine-grained Emotion Strength Transfer, Control and Prediction for Emotional Speech Synthesiscited by 29
  5. 2025EmoSteer-TTS: Fine-Grained and Training-Free Emotion-Controllable Text-to-Speech via Activation Steeringcited by 23
  6. 2019ShEMO -- A Large-Scale Validated Database for Persian Speech Emotion Detectioncited by 21
  7. 2019End-to-End Emotional Speech Synthesis Using Style Tokens and Semi-Supervised Trainingcited by 19
  8. 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Surveycited by 19
  9. 2025Do LLMs "Feel"? Emotion Circuits Discovery and Controlcited by 17
  10. 2018Cross-lingual and Multilingual Speech Emotion Recognition on English and Frenchcited by 10
  11. 2022A New Amharic Speech Emotion Dataset and Classification Benchmarkcited by 5
  12. 2024nEMO: Dataset of Emotional Speech in Polishcited by 3
  13. 2024Cross-Lingual Speech Emotion Recognition: Humans vs. Self-Supervised Modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.