mlsanityData to 7 Oct 2026

OpenRUA: Robot-Use Agents Are Zero-Shot Visuomotor Policies

arXiv 2610.02459 ↗First posted 1 Oct 2026cs.ROcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents also fits: Software engineering coding agents

Abstract (arXiv)

Coding agents are extending their reach into the physical world by writing and executing robot control programs. One might expect the agents to use the existing mature software stack that engineers have developed over decades to access sensors and control motion. Yet prior work primarily engineers complex custom harnesses to orchestrate agents for robot use, particularly by prescribing specialized workflows and providing bespoke interfaces. This raises the question: "Is such additional harness engineering necessary?" We introduce OpenRUA, a zero-abstraction harness that bypasses bespoke abstraction layers by providing off-the-shelf coding agents with only terminal access to the robot's native software interface ROS 2. OpenRUA employs a minimalist workspace-as-harness design, only offering ROS 2 documentation and basic tools while leaving the coding agent to organize its own work without orchestrating any agentic workflow. Within this workspace, OpenRUA recasts perception as file I/O and manipulation as coding. With Claude Code powered by Claude Opus 5, OpenRUA achieves success rates of 99.0% on CaP-Bench and 87.0% on LIBERO-PRO, demonstrating that an off-the-shelf coding agent can serve as a zero-shot visuomotor policy through the robot's native interface, without bespoke primitives or task-specific training. Under this minimalist design, further analysis reveals striking emergent behaviors of coding agents: (1) For perception, the agent spontaneously writes programs that process raw sensory inputs and derive metric measurements in 96.80% of episodes. (2) For manipulation, the agent spontaneously builds motion-control clients (e.g., gripper control) in 95.87% of episodes and closed-loop control programs (e.g., adjusting motion based on sensor feedback) in 50.13% of episodes. Our code is available at https://github.com/terminalworld/OpenRUA.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. First posted on arXiv 1 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards the Harness of Embodied Agents
  2. 2026CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation
  3. 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systems
  4. 2026RHO: Your Coding Agent is Secretly a Roboticist
  5. 2026ETA: A New Agentic Paradigm for Embodied Tasks
  6. 2026Self-Evolving Coding Agents: From Digital Programs to Physical-World Intelligence
  7. 2026ROSClaw: An OpenClaw ROS 2 Framework for Agentic Robot Control and Interaction
  8. 2026RLE-Bench: A Qualifying Exam for Coding Agents as Robot Learning Engineers