Read-Best Is Not Steer-Best: A Probing--Steering Layer Dissociation in Omni-Modal Large Language Models
On the map: Mechanistic interpretability → Activation steering methods
Abstract (arXiv)
Omni-modal large language models integrate text, audio, and image signals into a shared residual stream, where concepts such as emotion can be linearly decoded and causally modified by activation steering. A common but rarely tested assumption is that the layer with the highest probing accuracy is also the best layer for steering, so injection layers are often selected by probe performance. We provide the first causal test of this assumption across three independently developed omni-modal models and find that it fails. Reading and intervention rely on different layers, a phenomenon we call the probing-steering layer dissociation. Using emotion as a controlled testbed, we measure layer-wise readability and steerability across text, audio, and image inputs. Probe-best layers vary widely across architectures, while steering-effective layers consistently fall within a narrow mid-to-late range of normalized depth. Paired random-direction controls show an approximately 26-fold causal gap, ruling out random perturbation and direction quality as explanations. Logit-lens analysis reveals a staged forward process: causal handle, probing saturation, and vocabulary commitment, and motivates a two-factor account in which steering effectiveness depends on both representational readability and downstream plasticity. These results show that probing accuracy is a poor heuristic for selecting intervention layers and suggest a cross-architecture mid-to-late selection criterion. We also identify a cross-modal emotion subspace organized by valence and arousal, with joy acting as a stable anchor across models. Code and data: https://github.com/YiboWang2002/Read-Best-Is-Not-Steer-Best.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Activation steering methods, one of 13 directions in Mechanistic interpretability. Builds on 50 of its 69 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
50 of 69 references.
Closest ancestors · 5
Same direction, newest first
- 2026The Effectiveness of Style Vectors for Steering Large Language Models: A Human Evaluation29 Jan
- 2025Mechanistic Interpretability of Emotion Inference in Large Language Models8 Feb
- 2024Analyzing the Generalization and Reliability of Steering Vectors17 Jul
- 2023Steering Llama 2 via Contrastive Activation Addition9 Dec
- 2023Steering Language Models With Activation Engineering20 Aug
Other references · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
33 more
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2022Toy Models of Superpositioncited by 971
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
- 2024Qwen2-Audio Technical Reportcited by 560
- 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 532
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 486
- 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 378
- 2023Function Vectors in Large Language Modelscited by 308
- 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 245
- 2024Programming Refusal with Conditional Activation Steeringcited by 206
- 2024The Geometry of Categorical and Hierarchical Concepts in Large Language Modelscited by 159
- 2019Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognitioncited by 127
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
- 2024Style Vectors for Steering Generative Large Language Modelcited by 56
- 2020Revealing the Invisible with Model and Data Shrinking for Composite-database Micro-expression Recognitioncited by 31
- 2021Stimuli-Aware Visual Emotion Analysiscited by 26
- 2021SOLVER: Scene-Object Interrelated Visual Emotion Reasoning Networkcited by 18
- 2025Emotions Where Art Thou: Understanding and Characterizing the Emotional Latent Space of Large Language Modelscited by 18
- 2025Do LLMs "Feel"? Emotion Circuits Discovery and Controlcited by 17
- 2025From Rational Answers to Emotional Resonance: The Role of Controllable Emotion Generation in Language Modelscited by 6
- 2022Seeking Subjectivity in Visual Emotion Distribution Learningcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026AMPS: Adaptive Modality Preference Steering via Functional Entropy
- 2026Some Emotions Run Deeper: Layer-wise Probing and Causal Intervention in Large Language Models
- 2024OmniBench: Towards The Future of Universal Omni-Language Models
- 2026Beyond Text-Dominance: Understanding Modality Preference of Omni-modal Large Language Models
- 2026Chain of Modality: From Static Fusion to Dynamic Orchestration in Omni-MLLMs
- 2026Sensitivity, Causality, and Repair Dissociate: A Layer-Wise Analysis of Perturbation Robustness and Its Scaling
- 2026Instruction Anchor: Dissecting the Mechanistic Dynamics of Modality Arbitration
- 2026The Cost of Language: Centroid Erasure Exposes and Exploits Modal Competition in Multimodal Language Models