mlsanityData to 7 Oct 2026

RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environments

arXiv 2610.12424 ↗First posted 8 Oct 2026cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

A generalist robot should not only perform diverse tasks but also improve through experience, turning what it learns during execution into capabilities that later tasks can reuse. Robot agents that act through code can already repair programs from execution feedback, yet it remains a central challenge to organize this experience around the task structure that gives it meaning, so that each repair is attributed to the responsible capability, supported by execution evidence, and validated before it is reused. We introduce RoboRSI, a robot self-improvement system built on Top-Down Skill Refinement (TSR). TSR decomposes tasks into compound, atomic, and base skills with scoped responsibilities and explicit input--output contracts, attributes each execution outcome to the responsible branch, and confines revision to that branch. Building upon this structure, a Manager, Planner, Engineer, and Reviewer coordinate planning, execution, diagnosis, and the validated release of new skills, while people steer the process through objectives and corrections; stable skill sequences are further consolidated into reusable compound skills. On a mobile manipulator, RoboRSI develops multi-object household cleanup over 104 rounds. In simulation, it achieves the highest success rate on LIBERO, LIBERO-PRO, LIBERO-Plus, and RoboTwin, exceeding the strongest baseline by 2.7 to 11.0 percentage points.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 40 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

40 of 40 references.

References · 40

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  6. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  7. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  8. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  9. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  10. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  11. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  12. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
28 more
  1. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  2. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  3. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
  4. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
  5. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
  6. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
  7. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
  8. 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 171
  9. 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 118
  10. 2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfercited by 86
  11. 2026CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulationcited by 72
  12. 2024Code-as-Monitor: Constraint-aware Visual Programming for Reactive and Proactive Robotic Failure Detectioncited by 59
  13. 2023DoReMi: Grounding Language Model by Detecting and Recovering from Plan-Execution Misalignmentcited by 58
  14. 2026ASPIRE: Agentic /Skills Discovery for Roboticscited by 44
  15. 2026ENPIRE: Agentic Robot Policy Self-Improvement in the Real Worldcited by 31
  16. 2026EmbodiSkill: Skill-Aware Reflection for Self-Evolving Embodied Agentscited by 12
  17. 2025Maestro: Orchestrating Robotics Modules with Vision-Language Models for Zero-Shot Generalist Robotscited by 8
  18. 2026RoboHarness: Memory-Driven Orchestration of Heterogeneous Robot Policies for Long-Horizon Planningcited by 8
  19. 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalizationcited by 8
  20. 2026ETA: A New Agentic Paradigm for Embodied Taskscited by 6
  21. 2025UniDomain: Pretraining a Unified PDDL Domain from Real-World Demonstrations for Generalizable Robot Task Planningcited by 5
  22. 2026In-Context Robot Learning with VLM Agentscited by 4
  23. 2025Executable Analytic Concepts as the Missing Link Between VLM Insight and Precise Manipulationcited by 3
  24. 2026UniPlan: Vision-Language Task Planning for Mobile Manipulation with Unified PDDL Formulationcited by 3
  25. 2026RoboHarness: A Memory-Augmented Policy Harness for Vision-Language-Action Model Robustness via In-Context Adaptationcited by 3
  26. 2026RESOURCE2SKILL: Distilling Executable Agent Skills from Human-Created Multimodal Resourcescited by 2
  27. 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learningcited by 2
  28. 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agentscited by 1

Built on by

Not cited yet.