Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMs
On the map: LLM alignment / RLHF / preference optimisation → LLM preference optimization methods
Abstract (arXiv)
Aligned language models routinely misreport under non-evidential pressure: they cave to a confident user, yet fail to revise when genuine evidence arrives. We cast this as a failure of internal incentive-compatibility and study the two demands, resist (ignore forbidden pressure) and update (follow licensed evidence), on a Bayesian-witness benchmark with known posteriors, where the same user disagreement is evidence or pressure purely by stated source reliability, removing the evidence/pressure confound by construction. Using interchange interventions rather than probes, we causally localize low-rank report coordinates for answer, confidence, and caveat, establishing causal sufficiency at a late intervention site rather than uniqueness or necessity, with a causal cross-talk matrix showing strong own-coordinate control and only small cross-effects (partial functional disentanglement). We then introduce a training-free counterfactual report-coordinate (CRC) clamp that references the model's own report under an incentive-neutralized counterfactual of the prompt. The two-pass full-window clamp attains resist and update of 1.00 jointly (Wilson 95% CI [0.99,1.00]; the rank-16 projection alone reaches 0.88/0.90), which we read as a causal certificate and upper bound under a constructible reference, not a claim of a deployed solution. Tested global decoding and fixed-direction steering trade one objective against the other, and resist-only training collapses updating to 0.01. The deployable single-pass compilation is lossy (0.73/0.97). The mechanism and the clamp reproduce across three model families and transfer to a natural sycophancy benchmark with significant paired improvements. Our contribution is the interface and certification method: activation-level counterfactual incentive-invariance as a structural primitive for internal incentive-compatibility.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in LLM preference optimization methods, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 26 of its 29 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
26 of 29 references.
References · 26
- 2019Invariant Risk Minimizationcited by 1,832
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2017Counterfactual Fairnesscited by 802
- 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
- 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 442
- 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 434
- 2021Causal Abstractions of Neural Networkscited by 401
- 2023LEACE: Perfect linear concept erasure in closed formcited by 254
- 2024Programming Refusal with Conditional Activation Steeringcited by 191
- 2024ReFT: Representation Finetuning for Language Modelscited by 186
14 more
- 2018Path-Specific Counterfactual Fairnesscited by 179
- 2021Inducing Causal Structure for Interpretable Neural Networkscited by 107
- 2023Stay on topic with Classifier-Free Guidancecited by 90
- 2024Semantics-Adaptive Activation Intervention for LLMs via Dynamic Steering Vectorscited by 61
- 2025When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Modelscited by 46
- 2025Multi-Attribute Steering of Language Models via Targeted Interventioncited by 44
- 2025Sycophancy Is Not One Thing: Causal Separation of Sycophantic Behaviors in LLMscited by 32
- 2024InterpBench: Semi-Synthetic Transformers for Evaluating Mechanistic Interpretability Techniquescited by 24
- 2026Sycophancy Hides Linearly in the Attention Headscited by 21
- 2025HyperSteer: Activation Steering at Scale with Hypernetworkscited by 20
- 2025BASIL: Bayesian Assessment of Sycophancy in LLMscited by 11
- 2026SWAY: A Counterfactual Computational Linguistic Approach to Measuring and Mitigating Sycophancycited by 6
- 2026Pressure, What Pressure? Sycophancy Disentanglement in Language Models via Reward Decompositioncited by 3
- 2025Sycophancy as compositions of Atomic Psychometric Traitscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026EviScope: Paired Counterfactual Evidence Diagnostics for Faithful and Efficient Grounded Language Models
- 2026Knowing, and Saying It Only When Asked: LLM Endognostics and the Schizognosis of Minerva-7B
- 2026Claim-Level Confidence Calibration for Reliable Decision Making with Large Language Models
- 2026Measuring Evaluation-Context Divergence in Open-Weight LLMs: A Paired-Prompt Protocol with Pilot Evidence of Alignment-Pipeline-Specific Heterogeneity
- 2026Evaluating Evidence Grounding Under User Pressure in Instruction-Tuned Language Models
- 2025LLMs Don't Know Their Own Decision Boundaries: The Unreliability of Self-Generated Counterfactual Explanations
- 2024Dishonesty in Helpful and Harmless Alignment
- 2025Empirical Evidence for Alignment Faking in a Small LLM and Prompt-Based Mitigation Techniques