ROSClaw: An OpenClaw ROS 2 Framework for Agentic Robot Control and Interaction
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Foundation models can endow robots with open-ended reasoning, language understanding, and adaptive planning, yet connecting a model to a physical robot today requires bespoke integration that couples perception, actuation, and safety to a single model and platform. We present ROSClaw, a model-agnostic executive layer that integrates the OpenClaw agent runtime with ROS 2, enabling any foundation model to perceive, reason about, and act on any ROS-enabled robot through (i) dynamic capability discovery with standardized affordance injection, (ii) multimodal observation normalization, (iii) pre-execution action validation within a configurable safety envelope, and (iv) structured audit logging. Swapping model backends or robot platforms is a configuration change; tool schemas, safety enforcement, and provenance logging remain invariant. We deploy ROSClaw on three platforms (wheeled, quadruped, humanoid) with four foundation-model backends. Under this controlled substrate, models exhibit up to 4.8 x differences in out-of-policy action proposal rates (3.4 x among frontier models alone) and produce qualitatively distinct physical behaviors from identical commands. A cross-framework parity protocol against ROSA confirms that executive-layer design, not just prompt wording, significantly affects both task completion and safety behavior, establishing ROSClaw as both practical agentic-robot infrastructure and a reproducible measurement instrument for embodied AI.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 27 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
19 of 27 references.
Closest ancestors · 3
Same direction, newest first
- 2026Agentic AI for Robot Control: Flexible but still Fragile13 Feb
- 2024Enabling Novel Mission Operations and Interactions with ROSA: The Robot Operating System Agent9 Oct
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents18 Jan
Other references · 16
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Visual Instruction Tuningcited by 7,792
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 296
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
4 more
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 190
- 2017Behavior Trees in Robotics and AI: An Introductioncited by 105
- 2023GPT-4V(ision) for Robotics: Multimodal Task Planning from Human Demonstrationcited by 76
- 2024ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoningcited by 27
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026PhyAgentOS: A Self-Evolving Operating System for Embodied Agents with Decoupled Cognitive Planning and Physical Executioncited by 5
- 2026Octopus Protocol: One-Shot Hardware Discovery and Control for AI Agents via Infrastructure-as-Promptscited by 0
- 2026MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Interventioncited by 0
- 2026PhyAgentOS: A Self-Evolving Operating System for Embodied Agents with Decoupled Cognitive Planning and Physical Execution18 Jul 2026
- 2026MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention31 May 2026
- 2026Octopus Protocol: One-Shot Hardware Discovery and Control for AI Agents via Infrastructure-as-Prompts9 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Bridging Thought and Action: Taming Long-Horizon Instability in Open-Source LLM Agents with a MetaTool-Enhanced ROS Framework
- 2026ABot-Claw: A Foundation for Persistent, Cooperative, and Self-Evolving Robotic Agents
- 2026RACAS: Controlling Diverse Robots With a Single Agentic System
- 2025ROSBag MCP Server: Analyzing Robot Data with LLMs for Agentic Embodied AI Applications
- 2026ROSClaw: A Hierarchical Semantic-Physical Framework for Heterogeneous Multi-Agent Collaboration
- 2026IndustrialVLA-Bench: A Traceable Multi-Axis Evaluation of Open Robot Policy Models
- 2026OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systems
- 2025RoboNeuron: A Middle-Layer Infrastructure for Agent-Driven Orchestration in Embodied AI