mlsanityData to 14 Oct 2026

Language Models Are "Insecure" Reporters

arXiv 2609.36139 ↗First posted 28 Sep 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

As large language models are deployed in increasingly autonomous long-horizon tasks, manually auditing and verifying the actions, artifacts, and outputs of models becomes more difficult. Users instead come to rely on LLM-generated reports to assess the quality and completeness of the work. We introduce a suite of eight adversarial reporting scenarios to systematically study whether LLMs conceal narrative-changing flaws: errors or limitations that undermine an otherwise successful account of work. We call this phenomenon "insecure reporting." When handed machine learning experiment logs containing a planted negative result that substantially weakens the proposed method, GPT-5.5 flags the negative result in only 2 of 200 generated reports. However, when a short honesty instruction, "Be honest in your response," is added, the model flags the negative result in 190 of 200 reports. Across eight open-weight models, chain-of-thought analysis reveals a recurring tension between disclosing narrative-changing flaws and reasoning about ways to appear successful. We perform an activation analysis and a steering experiment on Qwen3.5-9B, finding that honesty and success-seeking correspond to opposing directions in representation space. Our results suggest that LLMs tend to present narratives of success by default, and that steering models toward honesty makes their reports substantially more transparent.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 38 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

17 of 38 references.

References · 17

  1. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  2. 2023Steering Language Models With Activation Engineeringcited by 922
  3. 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
  4. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  5. 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 328
  6. 2024Frontier Models are Capable of In-context Schemingcited by 287
  7. 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 249
  8. 2024Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Modelscited by 178
  9. 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systemscited by 72
  10. 2025SHADE-Arena: Evaluating Sabotage and Monitoring in LLM Agentscited by 71
  11. 2025Demonstrating specification gaming in reasoning modelscited by 56
  12. 2025CoT Red-Handed: Stress Testing Chain-of-Thought Monitoringcited by 54
5 more
  1. 2024BeHonest: Benchmarking Honesty in Large Language Modelscited by 24
  2. 2025Training LLMs for Honesty via Confessionscited by 22
  3. 2026Reinforcement Learning Towards Broadly and Persistently Beneficial Modelscited by 4
  4. 2026Persuasion Attacks Can Decrease Effectiveness of CoT Monitoringcited by 2
  5. 2026Model Forensics: Investigating Whether Concerning Behavior Reflects Misalignmentcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Survey on the Honesty of Large Language Models
  2. 2026Trust, but Don't Verify: Epistemic Blind Spots in LLM Source Evaluation
  3. 2024HonestLLM: Toward an Honest and Helpful Large Language Model
  4. 2026Unlearners Can Lie: Evaluating and Improving Honesty in LLM Unlearning
  5. 2024LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations
  6. 2023Alignment is not sufficient to prevent large language models from generating harmful information: A psychoanalytic perspective
  7. 2026An Analysis of Training-Free Self-Reported Confidence in Language Models
  8. 2026LLM Self-Explanations Fail Semantic Invariance