ENPIRE: Agentic Robot Policy Self-Improvement in the Real World
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Achieving dexterous robotic manipulation in the real world heavily relies on human supervision and algorithm engineering, which becomes a central bottleneck in the pursuit of general physical intelligence. Although emerging coding agents can generate code to automate algorithm search, their successes remain largely confined in digital environments. We conjecture that the missing abstraction to automate robotics research is a repeatable feedback loop for real-world policy improvement: reset the scene, execute a policy, verify the outcome, and refine the next iteration. To bridge this gap, we introduce ENPIRE, a harness framework for coding agents that instantiates this physical feedback routine with four core modules: an Environment module (EN) for automatic reset and verification, a Policy Improvement module (PI) that launches policy refinement, a Rollout module (R) to evaluate policies with one or multiple physical robots operating in parallel, and an Evolution module (E) in which coding agents analyze logs, consult literature, improve training infrastructure and algorithm code to address failure modes. This closed-loop system transforms real-world manipulation learning into a controllable optimization procedure, minimizing human effort while allowing fair ablations across training recipe and agent variants. Powered by ENPIRE, frontier coding agents can autonomously train a policy to achieve a 99% success rate on challenging, dexterous manipulation tasks, such as organizing a pin box, fastening a zip tie, and tool use, a process that further accelerates when we dispatch an agent team on a robot fleet. Our results suggest a practical and scalable path toward deploying coding agents to autonomously advancing robotics in the physical world.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 37 of its 51 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
37 of 51 references.
Closest ancestors · 2
Same direction, newest first
- 2026CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation23 Mar
- 2024AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents23 Jan
Other references · 35
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
23 more
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 542
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
- 2023Efficient Online Reinforcement Learning with Offline Datacited by 332
- 2023Language to Rewards for Robotic Skill Synthesiscited by 307
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
- 2018Learning to Walk via Deep Reinforcement Learningcited by 153
- 2023Text2Reward: Reward Shaping with Language Models for Reinforcement Learningcited by 153
- 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 153
- 2024SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learningcited by 113
- 2024DrEureka: Language Model Guided Sim-To-Real Transfercited by 78
- 2025Self-Improving Vision-Language-Action Models with Data Generation via Residual RLcited by 72
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
- 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 64
- 2025RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learningcited by 47
Built on by
Citing papers per year: 2026: 31.
31 papers.
Sort:
By area:
- 2026Towards the Harness of Embodied Agentscited by 7
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvementcited by 5
- 2026InSight: Self-Guided Skill Acquisition via Steerable VLAscited by 2
- 2026Agora: Git as Shared Memory for Collective AutoResearchcited by 2
- 2026EmbodiedSWE: Coding Agents for Long Horizon Dexterous Roboticscited by 2
- 2026You Don't Need To Stay in The Loop: An Agentic Robotics Loop for Robot-Policy Improvementcited by 1
- 2026RACaP: Agentic Reasoning, Acting, and Coding as Policies for Evolvable Robot Learningcited by 1
- 2026RLE-Bench: A Qualifying Exam for Coding Agents as Robot Learning Engineerscited by 1
- 2026Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agentscited by 1
- 2026Behavior Foundations for Quadruped Robots: ABot-C0 Technical Reportcited by 0
- 2026Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skillscited by 0
- 2026ReForge: Keeping ABR Algorithms Never Finished with Verified Large Language Model Editscited by 0
19 more
- 2026SUN: Agentic Robot Policy Learning with Persistent Task Programscited by 0
- 2026Continual Field-Adaptive Models (CFAMs) for Post-Deployment Physical AIcited by 0
- 2026WetRobo: A Reproducible Robot Kit for Coding Agents in Biological Laboratoriescited by 0
- 2026From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluationcited by 0
- 2026StageGuard: Learning Stage Transitions for Long-Horizon Robot Tasks via Agentic Distillationcited by 0
- 2026Coding Agents with an Obstacle-Aware Harness for Safe Robot Manipulationcited by 0
- 2026ARSTAG: An Agentic Real2Sim2Real System for Task-Specific Robot Data Generationcited by 0
- 2026Uncertainty-Gated Exploration Noise Suppresses Task Collapse in Online RL Fine-Tuning of a Flow-Matching Vision-Language-Action Policycited by 0
- 2026RAPID: Robot Agentic Programming from Demonstrationscited by 0
- 2026What Stops Recursive Self-Improvement in Robotics? Lessons from 123 Rounds of Agentic Skill Discoverycited by 0
- 2026RoboFoundry: System-as-Policy Evolution for Self-Learning Embodied Agentscited by 0
- 2026EMPIRIC: Experiment-Driven Learning of Residual World Models for Robot Planningcited by 0
- 2026Self-Evolving Coding Agents: From Digital Programs to Physical-World Intelligencecited by 0
- 2026Scale and Selection: What Makes Automatic Harness Evolution Work for Visual-Interface Robot Agentscited by 0
- 2026DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agentscited by 0
- 2026Iterative Policy Refinement through Semantic Rollout Analysiscited by 0
- 2026InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulationcited by 0
- 2026Agentic RSR: Real-to-Sim-to-Real through Scene Reconstruction and Execution-Grounded Robot Policiescited by 0
- 2026RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environmentscited by 0
- 2026RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environments8 Oct 2026
- 2026Agentic RSR: Real-to-Sim-to-Real through Scene Reconstruction and Execution-Grounded Robot Policies7 Oct 2026
- 2026Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agents1 Oct 2026
- 2026InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulation1 Oct 2026
- 2026Iterative Policy Refinement through Semantic Rollout Analysis1 Oct 2026
- 2026DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agents30 Sep 2026
- 2026Scale and Selection: What Makes Automatic Harness Evolution Work for Visual-Interface Robot Agents30 Sep 2026
- 2026Self-Evolving Coding Agents: From Digital Programs to Physical-World Intelligence28 Sep 2026
- 2026EMPIRIC: Experiment-Driven Learning of Residual World Models for Robot Planning28 Sep 2026
- 2026RLE-Bench: A Qualifying Exam for Coding Agents as Robot Learning Engineers28 Sep 2026
- 2026RoboFoundry: System-as-Policy Evolution for Self-Learning Embodied Agents26 Sep 2026
- 2026RAPID: Robot Agentic Programming from Demonstrations24 Sep 2026
19 more
- 2026RACaP: Agentic Reasoning, Acting, and Coding as Policies for Evolvable Robot Learning24 Sep 2026
- 2026What Stops Recursive Self-Improvement in Robotics? Lessons from 123 Rounds of Agentic Skill Discovery23 Sep 2026
- 2026Uncertainty-Gated Exploration Noise Suppresses Task Collapse in Online RL Fine-Tuning of a Flow-Matching Vision-Language-Action Policy23 Sep 2026
- 2026EmbodiedSWE: Coding Agents for Long Horizon Dexterous Robotics23 Sep 2026
- 2026ARSTAG: An Agentic Real2Sim2Real System for Task-Specific Robot Data Generation21 Sep 2026
- 2026Coding Agents with an Obstacle-Aware Harness for Safe Robot Manipulation17 Sep 2026
- 2026StageGuard: Learning Stage Transitions for Long-Horizon Robot Tasks via Agentic Distillation17 Sep 2026
- 2026From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluation16 Sep 2026
- 2026WetRobo: A Reproducible Robot Kit for Coding Agents in Biological Laboratories16 Sep 2026
- 2026Agora: Git as Shared Memory for Collective AutoResearch16 Sep 2026
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement10 Sep 2026
- 2026Continual Field-Adaptive Models (CFAMs) for Post-Deployment Physical AI3 Sep 2026
- 2026SUN: Agentic Robot Policy Learning with Persistent Task Programs31 Aug 2026
- 2026ReForge: Keeping ABR Algorithms Never Finished with Verified Large Language Model Edits15 Aug 2026
- 2026Towards the Harness of Embodied Agents3 Aug 2026
- 2026Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skills3 Aug 2026
- 2026You Don't Need To Stay in The Loop: An Agentic Robotics Loop for Robot-Policy Improvement2 Aug 2026
- 2026Behavior Foundations for Quadruped Robots: ABot-C0 Technical Report8 Jul 2026
- 2026InSight: Self-Guided Skill Acquisition via Steerable VLAs23 Jun 2026
- 2026Towards the Harness of Embodied Agentscited by 7
- 2026Agora: Git as Shared Memory for Collective AutoResearchcited by 2
- 2026EmbodiedSWE: Coding Agents for Long Horizon Dexterous Roboticscited by 2
- 2026You Don't Need To Stay in The Loop: An Agentic Robotics Loop for Robot-Policy Improvementcited by 1
- 2026RACaP: Agentic Reasoning, Acting, and Coding as Policies for Evolvable Robot Learningcited by 1
- 2026RLE-Bench: A Qualifying Exam for Coding Agents as Robot Learning Engineerscited by 1
- 2026Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agentscited by 1
- 2026WetRobo: A Reproducible Robot Kit for Coding Agents in Biological Laboratoriescited by 0
- 2026StageGuard: Learning Stage Transitions for Long-Horizon Robot Tasks via Agentic Distillationcited by 0
- 2026Coding Agents with an Obstacle-Aware Harness for Safe Robot Manipulationcited by 0
- 2026ARSTAG: An Agentic Real2Sim2Real System for Task-Specific Robot Data Generationcited by 0
- 2026RAPID: Robot Agentic Programming from Demonstrationscited by 0
12 most cited of 16 All 16 (JSON)
- 2026Agentic RSR: Real-to-Sim-to-Real through Scene Reconstruction and Execution-Grounded Robot Policies7 Oct 2026
- 2026Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agents1 Oct 2026
- 2026Scale and Selection: What Makes Automatic Harness Evolution Work for Visual-Interface Robot Agents30 Sep 2026
- 2026RLE-Bench: A Qualifying Exam for Coding Agents as Robot Learning Engineers28 Sep 2026
- 2026RoboFoundry: System-as-Policy Evolution for Self-Learning Embodied Agents26 Sep 2026
- 2026RAPID: Robot Agentic Programming from Demonstrations24 Sep 2026
- 2026RACaP: Agentic Reasoning, Acting, and Coding as Policies for Evolvable Robot Learning24 Sep 2026
- 2026What Stops Recursive Self-Improvement in Robotics? Lessons from 123 Rounds of Agentic Skill Discovery23 Sep 2026
- 2026EmbodiedSWE: Coding Agents for Long Horizon Dexterous Robotics23 Sep 2026
- 2026ARSTAG: An Agentic Real2Sim2Real System for Task-Specific Robot Data Generation21 Sep 2026
- 2026Coding Agents with an Obstacle-Aware Harness for Safe Robot Manipulation17 Sep 2026
- 2026StageGuard: Learning Stage Transitions for Long-Horizon Robot Tasks via Agentic Distillation17 Sep 2026
12 newest of 16 All 16 (JSON)
- 2026InSight: Self-Guided Skill Acquisition via Steerable VLAscited by 2
- 2026Uncertainty-Gated Exploration Noise Suppresses Task Collapse in Online RL Fine-Tuning of a Flow-Matching Vision-Language-Action Policycited by 0
- 2026Self-Evolving Coding Agents: From Digital Programs to Physical-World Intelligencecited by 0
- 2026Self-Evolving Coding Agents: From Digital Programs to Physical-World Intelligence28 Sep 2026
- 2026Uncertainty-Gated Exploration Noise Suppresses Task Collapse in Online RL Fine-Tuning of a Flow-Matching Vision-Language-Action Policy23 Sep 2026
- 2026InSight: Self-Guided Skill Acquisition via Steerable VLAs23 Jun 2026
- 2026Behavior Foundations for Quadruped Robots: ABot-C0 Technical Reportcited by 0
- 2026Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skillscited by 0
- 2026ReForge: Keeping ABR Algorithms Never Finished with Verified Large Language Model Editscited by 0
- 2026SUN: Agentic Robot Policy Learning with Persistent Task Programscited by 0
- 2026Continual Field-Adaptive Models (CFAMs) for Post-Deployment Physical AIcited by 0
- 2026From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluationcited by 0
- 2026DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agentscited by 0
- 2026InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulationcited by 0
- 2026RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environmentscited by 0
- 2026RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environments8 Oct 2026
- 2026InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulation1 Oct 2026
- 2026DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agents30 Sep 2026
- 2026From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluation16 Sep 2026
- 2026Continual Field-Adaptive Models (CFAMs) for Post-Deployment Physical AI3 Sep 2026
- 2026SUN: Agentic Robot Policy Learning with Persistent Task Programs31 Aug 2026
- 2026ReForge: Keeping ABR Algorithms Never Finished with Verified Large Language Model Edits15 Aug 2026
- 2026Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skills3 Aug 2026
- 2026Behavior Foundations for Quadruped Robots: ABot-C0 Technical Report8 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Nautilus: From One Prompt to Plug-and-Play Robot Learning
- 2026Learning and Transferring Closed-Loop Robot Software
- 2026ASPIRE: Agentic /Skills Discovery for Robotics
- 2026EmbodiRSI: Recursive Self-Improvement for Data-Efficient Robot Adaptation ↗
- 2026Zetta zeta: An Efficient Closed-Loop Embodied Harness for Self-Evolving Physical Intelligence
- 2026Act-Observe-Rewrite: Multimodal Coding Agents as In-Context Policy Learners for Robot Manipulation
- 2026RHO: Your Coding Agent is Secretly a Roboticist
- 2026Find Something You Can't Do: Agentic Real-World Reinforcement Learning for Self-Improving VLA Models