System Switch: When Should a Fast Decision Model Stop and Think?
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Dual-process agents pair a fast policy with a slow deliberative model. In real-time settings the slow model usually runs continuously; in turn-based agents and robot planners it is invoked on events such as uncertainty or a detected failure. We study a fast learned actor that takes every decision and hands control to a reasoning vision-language model only when a gate opens, while the game keeps running. We use closed-loop Doom and the new open "System One" typed-decision models, served through a common llama.cpp interface. On 900 held-out questions, (i) zero-shot decision models from 0.15B to 9B parameters choose to collect items 1.6-1.8 times more often than chance among their errors, in any option order, although the order changes some models' accuracy; (ii) accuracy, calibration and sensitivity (how well confidence separates right from wrong answers) are distinct: models of similar accuracy differ widely in AUROC, and the confidence of the most sensitive one tracks which kinds of situation it fails, not which answers are wrong; (iii) offline, deferring the least confident 30% of decisions to a reasoning model gains over random deferral in proportion to the actor's AUROC (rank correlation 0.87); with actor and rate chosen on held-out games the gain is +0.13 [0.08, 0.18] with doomLaya's option order and +0.08 [0.02, 0.14] with shuffled options, and reasoning carries about half of it; (iv) in closed loop (33 games, three seeds) no variant reaches the exit. Committing to plans, the reasoner's or a fixed explore rule's, opens more doors and makes an actor that stands still play; with the rule the agent dies more often. Told that some doors need keys, the reasoner takes ordinary doors for locked ones, which the state cannot tell apart; without that knowledge it goes back to collecting. We release code, prompts, data and logs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 18 of its 37 references that are in the map. First posted on arXiv 7 Oct 2026.
Builds on
18 of 37 references.
Closest ancestors · 4
Same direction, newest first
- 2026Think Fast and Slow: Step-Level Cognitive Depth Adaptation for LLM Agents13 Feb
- 2025Real-Time Reasoning Agents in Evolving Environments7 Nov
- 2024Agents Thinking Fast and Slow: A Talker-Reasoner Architecture10 Oct
- 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks27 May
Other references · 14
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2017Selective Classification for Deep Neural Networkscited by 799
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2017Predict Responsibly: Improving Fairness and Accuracy by Learning to Defercited by 228
- 2016ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learningcited by 178
- 2020Thinking Fast and Slow in AIcited by 67
- 2025Pangu Embedded: An Efficient Dual-system LLM Reasoner with Metacognitioncited by 61
- 2023DoReMi: Grounding Language Model by Detecting and Recovering from Plan-Execution Misalignmentcited by 58
- 2024Visual Agents as Fast and Slow Thinkerscited by 53
- 2025Leveraging Dual Process Theory in Language Agent Framework for Real-time Simultaneous Human-AI Collaborationcited by 10
- 2026ReDAct: Uncertainty-Aware Deferral for LLM Agentscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Fast Models, Slow Evidence: A Paired and Self-Audited Evaluation of System-1 Decision Models for LLM Agent Harnesses
- 2025DSADF: Thinking Fast and Slow for Decision Making
- 2026Towards a Belief-Based World Model for LLM Agents
- 2025On the Reasoning Capacity of AI Models and How to Quantify It
- 2025Reasoning Capabilities of Large Language Models on Dynamic Tasks
- 2026Reasoning as a Double-Edged Sword: Architecture and Cross-Stage Robustness in Vision-Language-Action Models
- 2026Free Energy Heuristics: Fast-And-Frugal Cognition as Active Inference Under Uncertain Precision
- 2024DynaThink: Fast or Slow? A Dynamic Decision-Making Framework for Large Language Models