RoboBridge: A Self-Evolving Embodied Agent Framework for Sim-to-Real Transfer
New in Vision-language-action models; no direction yet. Vision-language-action models
Abstract (arXiv)
A key challenge in bringing embodied intelligence into the real world is transferring capabilities from simulation to reality and enabling agents to continually adapt after deployment. End-to-end vision-language-action policies provide strong manipulation capabilities, but their transfer to physical environments typically relies on calibrating simulated visual and dynamical conditions, collecting additional target-domain demonstrations, and optimizing the policy through further training. Tool-using embodied agents offer flexible task orchestration, yet existing systems primarily emphasize task execution and experience reuse within a given environment, with limited support for transferring procedural knowledge and continuously adapting it across simulation and reality. We propose RoboBridge, a framework that treats sim-to-real transfer as the continued adaptation of executable task skills. The agent represents task knowledge as procedures connecting task intent, observations, tool operations, and outcome verification. Interaction feedback is used to generate candidate skill revisions, which are evaluated before being persisted or rejected. A pretrained vision-language-action policy is exposed as a reusable action tool and enhanced with inference-time guidance, enabling fine-grained execution without retraining the underlying policy. RoboBridge grounds transferable skills in task semantics and interaction interfaces shared across simulation and reality. This representation preserves reusable task structure while allowing environment-dependent operations to be selectively revised through real-world execution feedback. We evaluate the framework on LIBERO-PRO and corresponding physical tasks, studying both skill evolution and post-transfer adaptation. Our framework provides a route from one-shot policy deployment to continual procedural learning across environments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). First posted on arXiv 2 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Explore, Execute, Evolve: A Skill Acquisition and Reuse Loop for Embodied Agents
- 2026CodeActionBench: Evaluating Agentic Code-as-Policy for Embodied Manipulation
- 2026Exploratory, Communicative, and Deployable: Vision-Driven Embodied Agents for Open-World Mobile Manipulation
- 2026Skill2Real: Agentic Skill Learning for Zero-Shot Sim-to-Real Robot Manipulation
- 2026Reconstruct, Practice, Go Real: Guided Self-Improvement for Embodied Agents
- 2026MagicSim: A Unified Infrastructure for Executable Embodied Interaction
- 2026Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulation
- 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence