mlsanityData to 14 Oct 2026

Tracing a Sparse Emotion-Control Circuit in LLM-Based Text-to-Speech

arXiv 2610.05080 ↗First posted 4 Oct 2026cs.SD cs.AIcited by 0

On the map: Mechanistic interpretability → Activation steering methods

Abstract (arXiv)

LLM-based text-to-speech (TTS) models can generate emotionally expressive speech, but how reference emotion is routed through the model and realized in decoded speech remains unclear. We introduce two emotion-sensitive metrics for matched neutral and emotional syntheses---a codec trajectory score and a late residual direction score---and use them to score activation-patching interventions. Under controlled matched-reference conditions, this analysis identifies a sparse source-to-readout component-level circuit: 23--27 attention heads and MLPs per emotion, roughly 5% of the components considered, recover or suppress 74--88% of the late emotion-readout shift on held-out cases. The circuit combines a shared component backbone with emotion-specific components; cross-emotion activation swaps reduce the target readout in 47 of 48 cases. In decoded speech, the same intervention produces consistent changes in pitch, energy, and spectral brightness over 24 matched pairs per emotion. A readout-matched residual-direction baseline produces only 17--27% of the intervention's pitch effect, showing that internal readout movement alone does not explain the decoded acoustic changes. These results trace a compact causal route from reference-derived prefix information to emotion-relevant properties of generated speech.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Activation steering methods, one of 13 directions in Mechanistic interpretability. Builds on 18 of its 28 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

18 of 28 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Learning Interpretable Features in Audio Latent Spaces via Sparse Autoencoders27 Oct
  2. 2025EmoSteer-TTS: Fine-Grained and Training-Free Emotion-Controllable Text-to-Speech via Activation Steering5 Aug
  3. 2024AtP*: An efficient and scalable method for localizing LLM behaviour to components1 Mar

Other references · 15

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  2. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  3. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
  4. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  5. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
  6. 2024How to use and interpret activation patchingcited by 214
  7. 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 205
  8. 2023Localizing Model Behavior with Path Patchingcited by 195
  9. 2022PromptTTS: Controllable Text-to-Speech with Text Descriptionscited by 110
  10. 2023InstructTTS: Modelling Expressive TTS in Discrete Latent Space with Natural Language Style Promptcited by 92
  11. 2025IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speechcited by 90
  12. 2025EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Promptingcited by 34
3 more
  1. 2025Beyond Transcription: Mechanistic Interpretability in ASRcited by 13
  2. 2025EMORL-TTS: Reinforcement Learning for Fine-Grained Emotion Control in LLM-based TTScited by 4
  3. 2025PROEMO: Prompt-Driven Text-to-Speech Synthesis Based on Emotion and Intensity Controlcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Sparse Autoencoders for Interpretable Emotion Control in Text-to-Speech
  2. 2026CoCoEmo: Composable and Controllable Human-Like Emotional TTS via Activation Steering
  3. 2024Hierarchical Control of Emotion Rendering in Speech Synthesis
  4. 2026DUET: Unified Dual-Space Emotion Control for Diffusion and Flow-Matching Driven Text-to-Speech
  5. 2026A Geometric Perspective on Composable Emotion Steering in Text-to-Speech Models
  6. 2025Do LLMs "Feel"? Emotion Circuits Discovery and Control
  7. 2026Steerspeech: Activation Steering For Emotion Control In Generated Speech
  8. 2025TTS-CtrlNet: Time varying emotion aligned text-to-speech generation with ControlNet