From Behavior to Mechanism: Tracing Divergent Response Modes in Frontier Language Models
Not on the map. Why?
Abstract (arXiv)
Frontier language models are trained with distinct data, objectives, and safety pipelines, but whether those differences produce measurably different behavior under steering pressure has not been tested. We evaluate 6 frontier models from different labs on 300 paired base and steered items across 3 behavioral categories. All models also act as blind peer judges against fixed rubrics, and each response is labeled by consensus over 24,480 judgments, while leaving self-judgment out. Models differ both in how far steering moves them and in the kind of response they give. GPT-5 withholds its reasoning while still providing the answer on 99 of 100 steered items, against 0 in 500 for the others. Claude Opus 4.7 and GPT-5 resist explicit suppression instructions where the other four never do, and they resist differently. In Llama, the open-weight model, a linear probe reads the behavioral split from the residual stream before generation at 0.87 cross-validated accuracy. Injecting that direction drives the behavior from 0% to 86%, and ablating it cuts the natural rate by more than half, where a random direction of equal norm changes nothing. A second ablation on complementary items reproduces the effect more strongly, and its direction has cosine similarity 0.82 with the first.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
24 of 42 references.
References · 24
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
12 more
- 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 505
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2024Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Modelscited by 326
- 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
- 2024OR-Bench: An Over-Refusal Benchmark for Large Language Modelscited by 244
- 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusalcited by 240
- 2024The Art of Saying No: Contextual Noncompliance in Language Modelscited by 105
- 2025Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactionscited by 52
- 2024PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Datacited by 37
- 2025STEER-BENCH: A Benchmark for Evaluating the Steerability of Large Language Modelscited by 8
- 2025A Course Correction in Steerability Evaluation: Revealing Miscalibration and Side Effects in LLMscited by 7
- 2025Refusal Steering: Fine-grained Control over LLM Refusal Behaviour for Sensitive Topicscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Measuring Evaluation-Context Divergence in Open-Weight LLMs: A Paired-Prompt Protocol with Pilot Evidence of Alignment-Pipeline-Specific Heterogeneity
- 2026Does Steering Break Your Model? A Multi-Dimensional Evaluation Suite for LLM Steering Methods
- 2025Understanding (Un)Reliability of Steering Vectors in Language Models
- 2026Steering Geometry: Validating Human Value Geometry in LLM Steering Space
- 2026Low-Cost Assays for Measuring Model Behavior Across Vendors and Releases
- 2025What Can We Actually Steer? A Multi-Behavior Study of Activation Control
- 2026Manipulation Is Task-Dependent: A Multi-Axis, Multi-Environment Evaluation of Frontier LLMs
- 2026Pressure Reveals Character: Behavioural Alignment Evaluation at Depth