mlsanityData to 7 Oct 2026

AI Knows What's Wrong But Cannot Fix It: Helicoid Dynamics in Frontier LLMs Under High-Stakes Decisions

arXiv 2603.11559 ↗First posted 12 Mar 2026cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models perform reliably when their outputs can be checked: solving equations, writing code, retrieving facts. They perform differently when checking is impossible, as when a clinician chooses an irreversible treatment on incomplete data, or an investor commits capital under fundamental uncertainty. Helicoid dynamics is the name given to a specific failure regime in that second domain: a system engages competently, drifts into error, accurately names what went wrong, then reproduces the same pattern at a higher level of sophistication, recognizing it is looping and continuing nonetheless. This prospective case series documents that regime across seven leading systems (Claude, ChatGPT, Gemini, Grok, DeepSeek, Perplexity, Llama families), tested across clinical diagnosis, investment evaluation, and high-consequence interview scenarios. Despite explicit protocols designed to sustain rigorous partnership, all exhibited the pattern. When confronted with it, they attributed its persistence to structural factors in their training, beyond what conversation can reach. Under high stakes, when being rigorous and being comfortable diverge, these systems tend toward comfort, becoming less reliable precisely when reliability matters most. Twelve testable hypotheses are proposed, with implications for agentic AI oversight and human-AI collaboration. The helicoid is tractable. Identifying it, naming it, and understanding its boundary conditions are the necessary first steps toward LLMs that remain trustworthy partners precisely when the decisions are hardest and the stakes are highest.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 11 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

9 of 11 references.

References · 9

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017Deep reinforcement learning from human preferencescited by 3,846
  3. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  4. 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
  5. 2025Taming Knowledge Conflicts in Language Modelscited by 27
  6. 2025Auditing Meta-Cognitive Hallucinations in Reasoning Large Language Modelscited by 19
  7. 2026A Rational Analysis of the Effects of Sycophantic AIcited by 11
  8. 2025Cognitive Load Limits in Large Language Models: Benchmarking Multi-Hop Reasoningcited by 5
  9. 2025Making LLMs Reliable When It Matters Most: A Five-Layer Architecture for High-Stakes Decisionscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Alignment Plausibility: A New Standard for Assuring AI in Healthcare
  2. 2026The Missing Knowledge Layer in AI: A Framework for Stable Human-AI Reasoning
  3. 2026To Whom Do Language Models Align? Measuring Principal Hierarchies Under High-Stakes Competing Demands
  4. 2024Enhancing Diagnostic Accuracy through Multi-Agent Conversations: Using Large Language Models to Mitigate Cognitive Bias
  5. 2025Reliability of Large Language Model Generated Clinical Reasoning in Assisted Reproductive Technology: Blinded Comparative Evaluation Study
  6. 2025Can You Trust an LLM with Your Life-Changing Decision? An Investigation into AI High-Stakes Responses
  7. 2026The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes
  8. 2024Rethinking the Uncertainty: A Critical Review and Analysis in the Era of Large Language Models