RoboNeuron: A Middle-Layer Infrastructure for Agent-Driven Orchestration in Embodied AI
On the map: Vision-language-action models → Failure recovery and robustness
also in 1 more
Abstract (arXiv)
Vision-language-action (VLA) models and LLM agents have advanced rapidly, yet reliable deployment on physical robots is often hindered by an interface mismatch between agent tool APIs and robot middleware. Current implementations typically rely on ad-hoc wrappers that are difficult to reuse, and changes to the VLA backend or serving stack often necessitate extensive re-integration. We introduce RoboNeuron, a middleware layer that connects the Model Context Protocol (MCP) for LLM agents with robot middleware such as ROS2. RoboNeuron bridges these ecosystems by deriving agent-callable tools directly from ROS schemas, providing a unified execution abstraction that supports both direct commands and modular composition, and localizing backend, runtime, and acceleration-preset changes within a stable inference boundary. We evaluate RoboNeuron in simulation and on hardware through multi-platform base control, arm motion, and VLA-based grasping tasks, demonstrating that it enables modular system orchestration under a unified interface while supporting backend transitions without system rewiring. The full code implementation of this work is available at github repo: https://github.com/guanweifan/RoboNeuron
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 22 of its 32 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
22 of 32 references.
References · 22
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
10 more
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2025π*0.6: a VLA That Learns From Experiencecited by 303
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 199
- 2014Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Studycited by 89
- 2024AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agentscited by 87
- 2020The Marathon 2: A Navigation Systemcited by 70
- 2020A Survey of Behavior Trees in Robotics and AIcited by 55
- 2025RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaborationcited by 28
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Surveycited by 26
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025ROSBag MCP Server: Analyzing Robot Data with LLMs for Agentic Embodied AI Applications
- 2026Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots
- 2025Towards Embodied Agentic AI: Review and Classification of LLM- and VLM-Driven Robot Autonomy and Interaction
- 2025PhysiAgent: An Embodied Agent Framework in Physical World
- 2024ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoning
- 2026Demonstration-Free Robotic Control via LLM Agents
- 2026Towards Long-horizon Embodied Agents with Tool-Aligned Vision-Language-Action Models
- 2026EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents