mlsanityData to 7 Oct 2026

Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMs

arXiv 2607.12985 ↗First posted 14 Jul 2026cs.AIcited by 1

On the map: LLM alignment / RLHF / preference optimisation → LLM preference optimization methods

Abstract (arXiv)

Aligned language models routinely misreport under non-evidential pressure: they cave to a confident user, yet fail to revise when genuine evidence arrives. We cast this as a failure of internal incentive-compatibility and study the two demands, resist (ignore forbidden pressure) and update (follow licensed evidence), on a Bayesian-witness benchmark with known posteriors, where the same user disagreement is evidence or pressure purely by stated source reliability, removing the evidence/pressure confound by construction. Using interchange interventions rather than probes, we causally localize low-rank report coordinates for answer, confidence, and caveat, establishing causal sufficiency at a late intervention site rather than uniqueness or necessity, with a causal cross-talk matrix showing strong own-coordinate control and only small cross-effects (partial functional disentanglement). We then introduce a training-free counterfactual report-coordinate (CRC) clamp that references the model's own report under an incentive-neutralized counterfactual of the prompt. The two-pass full-window clamp attains resist and update of 1.00 jointly (Wilson 95% CI [0.99,1.00]; the rank-16 projection alone reaches 0.88/0.90), which we read as a causal certificate and upper bound under a constructible reference, not a claim of a deployed solution. Tested global decoding and fixed-direction steering trade one objective against the other, and resist-only training collapses updating to 0.01. The deployable single-pass compilation is lossy (0.73/0.97). The mechanism and the clamp reproduce across three model families and transfer to a natural sycophancy benchmark with significant paired improvements. Our contribution is the interface and certification method: activation-level counterfactual incentive-invariance as a structural primitive for internal incentive-compatibility.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in LLM preference optimization methods, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 26 of its 29 references that are in the map. First posted on arXiv 14 Jul 2026.

Builds on

26 of 29 references.

References · 26

  1. 2019Invariant Risk Minimizationcited by 1,832
  2. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  3. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  4. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  5. 2017Counterfactual Fairnesscited by 802
  6. 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
  7. 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 442
  8. 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 434
  9. 2021Causal Abstractions of Neural Networkscited by 401
  10. 2023LEACE: Perfect linear concept erasure in closed formcited by 254
  11. 2024Programming Refusal with Conditional Activation Steeringcited by 191
  12. 2024ReFT: Representation Finetuning for Language Modelscited by 186
14 more
  1. 2018Path-Specific Counterfactual Fairnesscited by 179
  2. 2021Inducing Causal Structure for Interpretable Neural Networkscited by 107
  3. 2023Stay on topic with Classifier-Free Guidancecited by 90
  4. 2024Semantics-Adaptive Activation Intervention for LLMs via Dynamic Steering Vectorscited by 61
  5. 2025When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Modelscited by 46
  6. 2025Multi-Attribute Steering of Language Models via Targeted Interventioncited by 44
  7. 2025Sycophancy Is Not One Thing: Causal Separation of Sycophantic Behaviors in LLMscited by 32
  8. 2024InterpBench: Semi-Synthetic Transformers for Evaluating Mechanistic Interpretability Techniquescited by 24
  9. 2026Sycophancy Hides Linearly in the Attention Headscited by 21
  10. 2025HyperSteer: Activation Steering at Scale with Hypernetworkscited by 20
  11. 2025BASIL: Bayesian Assessment of Sycophancy in LLMscited by 11
  12. 2026SWAY: A Counterfactual Computational Linguistic Approach to Measuring and Mitigating Sycophancycited by 6
  13. 2026Pressure, What Pressure? Sycophancy Disentanglement in Language Models via Reward Decompositioncited by 3
  14. 2025Sycophancy as compositions of Atomic Psychometric Traitscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026EviScope: Paired Counterfactual Evidence Diagnostics for Faithful and Efficient Grounded Language Models
  2. 2026Knowing, and Saying It Only When Asked: LLM Endognostics and the Schizognosis of Minerva-7B
  3. 2026Claim-Level Confidence Calibration for Reliable Decision Making with Large Language Models
  4. 2026Measuring Evaluation-Context Divergence in Open-Weight LLMs: A Paired-Prompt Protocol with Pilot Evidence of Alignment-Pipeline-Specific Heterogeneity
  5. 2026Evaluating Evidence Grounding Under User Pressure in Instruction-Tuned Language Models
  6. 2025LLMs Don't Know Their Own Decision Boundaries: The Unreliability of Self-Generated Counterfactual Explanations
  7. 2024Dishonesty in Helpful and Harmless Alignment
  8. 2025Empirical Evidence for Alignment Faking in a Small LLM and Prompt-Based Mitigation Techniques