mlsanityData to 14 Oct 2026

Read-Best Is Not Steer-Best: A Probing--Steering Layer Dissociation in Omni-Modal Large Language Models

arXiv 2609.22135 ↗First posted 24 Aug 2026cs.CLcited by 1

On the map: Mechanistic interpretability → Activation steering methods

Abstract (arXiv)

Omni-modal large language models integrate text, audio, and image signals into a shared residual stream, where concepts such as emotion can be linearly decoded and causally modified by activation steering. A common but rarely tested assumption is that the layer with the highest probing accuracy is also the best layer for steering, so injection layers are often selected by probe performance. We provide the first causal test of this assumption across three independently developed omni-modal models and find that it fails. Reading and intervention rely on different layers, a phenomenon we call the probing-steering layer dissociation. Using emotion as a controlled testbed, we measure layer-wise readability and steerability across text, audio, and image inputs. Probe-best layers vary widely across architectures, while steering-effective layers consistently fall within a narrow mid-to-late range of normalized depth. Paired random-direction controls show an approximately 26-fold causal gap, ruling out random perturbation and direction quality as explanations. Logit-lens analysis reveals a staged forward process: causal handle, probing saturation, and vocabulary commitment, and motivates a two-factor account in which steering effectiveness depends on both representational readability and downstream plasticity. These results show that probing accuracy is a poor heuristic for selecting intervention layers and suggest a cross-architecture mid-to-late selection criterion. We also identify a cross-modal emotion subspace organized by valence and arousal, with joy acting as a stable anchor across models. Code and data: https://github.com/YiboWang2002/Read-Best-Is-Not-Steer-Best.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Activation steering methods, one of 13 directions in Mechanistic interpretability. Builds on 50 of its 69 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

50 of 69 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026The Effectiveness of Style Vectors for Steering Large Language Models: A Human Evaluation29 Jan
  2. 2025Mechanistic Interpretability of Emotion Inference in Large Language Models8 Feb
  3. 2024Analyzing the Generalization and Reliability of Steering Vectors17 Jul
  4. 2023Steering Llama 2 via Contrastive Activation Addition9 Dec
  5. 2023Steering Language Models With Activation Engineering20 Aug

Other references · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2024Qwen2.5 Technical Reportcited by 4,942
  6. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  7. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  8. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  9. 2016Pointer Sentinel Mixture Modelscited by 3,096
  10. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  11. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  12. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
33 more
  1. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  2. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  3. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  4. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  5. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  6. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  7. 2022Toy Models of Superpositioncited by 971
  8. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  9. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
  10. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
  11. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  12. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
  13. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
  14. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
  15. 2024Qwen2-Audio Technical Reportcited by 560
  16. 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 532
  17. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
  18. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 486
  19. 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 378
  20. 2023Function Vectors in Large Language Modelscited by 308
  21. 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 245
  22. 2024Programming Refusal with Conditional Activation Steeringcited by 206
  23. 2024The Geometry of Categorical and Hierarchical Concepts in Large Language Modelscited by 159
  24. 2019Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognitioncited by 127
  25. 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
  26. 2024Style Vectors for Steering Generative Large Language Modelcited by 56
  27. 2020Revealing the Invisible with Model and Data Shrinking for Composite-database Micro-expression Recognitioncited by 31
  28. 2021Stimuli-Aware Visual Emotion Analysiscited by 26
  29. 2021SOLVER: Scene-Object Interrelated Visual Emotion Reasoning Networkcited by 18
  30. 2025Emotions Where Art Thou: Understanding and Characterizing the Emotional Latent Space of Large Language Modelscited by 18
  31. 2025Do LLMs "Feel"? Emotion Circuits Discovery and Controlcited by 17
  32. 2025From Rational Answers to Emotional Resonance: The Role of Controllable Emotion Generation in Language Modelscited by 6
  33. 2022Seeking Subjectivity in Visual Emotion Distribution Learningcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026AMPS: Adaptive Modality Preference Steering via Functional Entropy
  2. 2026Some Emotions Run Deeper: Layer-wise Probing and Causal Intervention in Large Language Models
  3. 2024OmniBench: Towards The Future of Universal Omni-Language Models
  4. 2026Beyond Text-Dominance: Understanding Modality Preference of Omni-modal Large Language Models
  5. 2026Chain of Modality: From Static Fusion to Dynamic Orchestration in Omni-MLLMs
  6. 2026Sensitivity, Causality, and Repair Dissociate: A Layer-Wise Analysis of Perturbation Robustness and Its Scaling
  7. 2026Instruction Anchor: Dissecting the Mechanistic Dynamics of Modality Arbitration
  8. 2026The Cost of Language: Centroid Erasure Exposes and Exploits Modal Competition in Multimodal Language Models