Knowing but Not Correcting: Routine Task Requests Suppress Factual Correction in LLMs
Not on the map. Why?
Abstract (arXiv)
LLMs reliably correct false claims when presented in isolation, yet when the same claims are embedded in task-oriented requests, they often comply rather than correct. We term this failure mode correction suppression and construct a benchmark of 300 false premises to systematically evaluate it across eight models. Suppression rates range from 19% to 90%, with four models exceeding 80%, establishing correction suppression as a prevalent and severe phenomenon. Mechanistic analysis reveals that suppression is not a knowledge failure: the model registers the error internally but task context diverts early-layer attention from the false claim as output intent crystallizes toward compliance at middle layers. We characterize this as knowing but not correcting -- suppression occurs at response selection rather than knowledge encoding. Guided by this mechanism, we propose two training-free interventions. Correction Direction Steering (CDS) estimates a correction-compliance direction from matched pairs and injects it at middle layers before output intent crystallizes. Dynamic Payload Amplification (DPA) localizes payload tokens via attention divergence between early and late layers and amplifies their representation at the final layer, requiring no calibration data. Experiments on Qwen3.5-9B and LLaMA3.1-8B show both methods substantially improve factual strictness. CDS achieves the highest correction rate on Qwen3.5-9B (0%→58.2%). DPA is the only method that preserves or improves reasoning capability on both models. These findings introduce factual strictness -- the willingness to uphold accuracy against contextual pressures -- as a new dimension of model reliability.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 32 of its 38 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
32 of 38 references.
References · 32
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
20 more
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 738
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
- 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 512
- 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 367
- 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
- 2024Programming Refusal with Conditional Activation Steeringcited by 191
- 2023Simple synthetic data reduces sycophancy in large language modelscited by 174
- 2023RAIN: Your Language Models Can Align Themselves without Finetuningcited by 149
- 2025AbstentionBench: Reasoning LLMs Fail on Unanswerable Questionscited by 129
- 2024ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretabilitycited by 100
- 2023When Large Language Models contradict humans? Large Language Models' Sycophantic Behaviourcited by 61
- 2023Won't Get Fooled Again: Answering Questions with False Premisescited by 47
- 2025Sycophancy Is Not One Thing: Causal Separation of Sycophantic Behaviors in LLMscited by 32
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026The Civilization Framework: Sovereign-Anchored Communication Between Personal Multi-Agent Systemscited by 0
- 2026Requirement-Bound Verified Commissioning: A Frozen Four-Billion-Parameter Local Model as a Candidate Generator under an External Acceptance Layer with Verification and Release Authoritycited by 0
- 2026Requirement-Bound Verified Commissioning: A Frozen Four-Billion-Parameter Local Model as a Candidate Generator under an External Acceptance Layer with Verification and Release Authority24 Sep 2026
- 2026The Civilization Framework: Sovereign-Anchored Communication Between Personal Multi-Agent Systems3 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2023LLMs cannot find reasoning errors, but can correct them given the error location
- 2026Beyond Accuracy: Decomposing the Reasoning Efficiency of LLMs
- 2024Understanding the Dark Side of LLMs' Intrinsic Self-Correction
- 2026Lexical Perturbations Disrupt LLM Reasoning: An Empirical Study of Attention Diversion
- 2025Layer of Truth: Probing Belief Shifts under Continual Pre-Training Poisoning
- 2026Diagnosing Correctness Probes under Self-Judgement Confounding
- 2026LLMs Know They're Wrong and Agree Anyway: The Shared Sycophancy-Lying Circuit
- 2025Unraveling Misinformation Propagation in LLM Reasoning