REPOT: Recoverable Program-of-Thought via Checkpoint Repair
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
One-shot Program-of-Thought (PoT) emits a Python program that prints a primitive-action plan; a single invalid action silently invalidates the trajectory. We introduce RePoT (Recoverable PoT): a deterministic verified replay that walks the plan through the environment to its first invalid transition, then one LLM call that resumes from the verified prefix. RePoT costs at most one extra LLM call on the ~14% of problems where PoT fails. RePoT beats PoT by +3 to +11pp across four closed-model configurations on PuzzleZoo-775 and peaks at 96.9% vs 86.3% on gpt-5.4-mini-medium; against the matched-budget PoT-retry baseline, RePoT wins decisively on Gemini (+3.8pp, 95% CI [+2.2,+5.4]), is within sampling noise on GPT-medium and Claude, and loses on GPT-mini -- a capability-scaling pattern we begin to address with Adaptive RePoT, a rule-based dispatcher that routes between suffix repair and a fresh PoT retry based on verified-prefix length (preliminary). We replicate on PlanBench Blocksworld (+1.1 to +11.4pp) and on four open-weights models (+3.3 to +20.0pp on three of four). On Derail-550, our controlled recovery benchmark, every condition with access to checkpoint information clears >=30% on GPT-medium and >=70% on Gemini, vs <=3.1% for error-only feedback -- showing that checkpoint information, not the specific verified-prefix tail, is the load-bearing recovery signal.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 23 of its 25 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
23 of 25 references.
Closest ancestors · 3
Same direction, newest first
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct
- 2023On the Planning Abilities of Large Language Models : A Critical Investigation25 May
- 2022PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Change21 Jun
Other references · 20
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Let's Verify Step by Stepcited by 3,789
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
- 2023Is Self-Repair a Silver Bullet for Code Generation?cited by 197
- 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 184
8 more
- 2025Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 104
- 2025SagaLLM: Context Management, Validation, and Transaction Guarantees for Multi-Agent LLM Planningcited by 60
- 2025ThinkSwitcher: When to Think Hard, When to Think Fastcited by 37
- 2026Atomix: Timely, Transactional Tool Use for Reliable Agentic Workflowscited by 30
- 2025SAFEFLOW: A Principled Protocol for Trustworthy and Transactional Autonomous Agent Systemscited by 25
- 2025Thinking Isn't an Illusion: Overcoming the Limitations of Reasoning Models via Tool Augmentationscited by 9
- 2025A Comment On "The Illusion of Thinking": Reframing the Reasoning Cliff as an Agentic Gapcited by 8
- 2024Metacognitive Myopia in Large Language Modelscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DART: Semantic Recoverability for Structured Tool Agents
- 2026RippleCP: Measuring Counterfactual Checkpoint Advantage in Coding Agents
- 2026Stage-Replay Divergence Follows the KV Cache: Fixed-Prefix Precision Controls and Bidirectional Cache Transplantation
- 2026ACRFence: Preventing Semantic Rollback Attacks in Agent Checkpoint-Restore
- 2026Trustworthy Runtime Error Healing in Real-World Repositories: A Benchmark and Guardrail
- 2026Why Retrying Fails: Context Contamination in LLM Agent Pipelines
- 2026TaPR: Test-Aware Policy Refinement for Feedback-Conditioned Code Generation
- 2026Signal Reshaping for GRPO in Weak-Feedback Agentic Code Repair