mlsanityData to 7 Oct 2026

Knowing but Not Correcting: Routine Task Requests Suppress Factual Correction in LLMs

arXiv 2605.05957 ↗First posted 7 May 2026cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

LLMs reliably correct false claims when presented in isolation, yet when the same claims are embedded in task-oriented requests, they often comply rather than correct. We term this failure mode correction suppression and construct a benchmark of 300 false premises to systematically evaluate it across eight models. Suppression rates range from 19% to 90%, with four models exceeding 80%, establishing correction suppression as a prevalent and severe phenomenon. Mechanistic analysis reveals that suppression is not a knowledge failure: the model registers the error internally but task context diverts early-layer attention from the false claim as output intent crystallizes toward compliance at middle layers. We characterize this as knowing but not correcting -- suppression occurs at response selection rather than knowledge encoding. Guided by this mechanism, we propose two training-free interventions. Correction Direction Steering (CDS) estimates a correction-compliance direction from matched pairs and injects it at middle layers before output intent crystallizes. Dynamic Payload Amplification (DPA) localizes payload tokens via attention divergence between early and late layers and amplifies their representation at the final layer, requiring no calibration data. Experiments on Qwen3.5-9B and LLaMA3.1-8B show both methods substantially improve factual strictness. CDS achieves the highest correction rate on Qwen3.5-9B (0%→58.2%). DPA is the only method that preserves or improves reasoning capability on both models. These findings introduce factual strictness -- the willingness to uphold accuracy against contextual pressures -- as a new dimension of model reliability.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 32 of its 38 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

32 of 38 references.

References · 32

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2024Qwen2.5 Technical Reportcited by 4,713
  4. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  5. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  6. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  7. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  8. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  9. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  10. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  11. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  12. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
20 more
  1. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  2. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  3. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  4. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
  5. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
  6. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 738
  7. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  8. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
  9. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
  10. 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 512
  11. 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 367
  12. 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
  13. 2024Programming Refusal with Conditional Activation Steeringcited by 191
  14. 2023Simple synthetic data reduces sycophancy in large language modelscited by 174
  15. 2023RAIN: Your Language Models Can Align Themselves without Finetuningcited by 149
  16. 2025AbstentionBench: Reasoning LLMs Fail on Unanswerable Questionscited by 129
  17. 2024ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretabilitycited by 100
  18. 2023When Large Language Models contradict humans? Large Language Models' Sycophantic Behaviourcited by 61
  19. 2023Won't Get Fooled Again: Answering Questions with False Premisescited by 47
  20. 2025Sycophancy Is Not One Thing: Causal Separation of Sycophantic Behaviors in LLMscited by 32

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023LLMs cannot find reasoning errors, but can correct them given the error location
  2. 2026Beyond Accuracy: Decomposing the Reasoning Efficiency of LLMs
  3. 2024Understanding the Dark Side of LLMs' Intrinsic Self-Correction
  4. 2026Lexical Perturbations Disrupt LLM Reasoning: An Empirical Study of Attention Diversion
  5. 2025Layer of Truth: Probing Belief Shifts under Continual Pre-Training Poisoning
  6. 2026Diagnosing Correctness Probes under Self-Judgement Confounding
  7. 2026LLMs Know They're Wrong and Agree Anyway: The Shared Sycophancy-Lying Circuit
  8. 2025Unraveling Misinformation Propagation in LLM Reasoning