SPINE: Bridging the Cyber-Physical Gap with Agentic AI
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Foundation models give robots powerful high-level reasoning, yet turning that intelligence into reliable physical action remains difficult: roboticists must still align device drivers, network interfaces, sensors, controllers, and safety constraints for each platform. This often-overlooked integration layer acts as the robot's spinal cord, translating high-level intent into coordinated physical behavior, and remains a primary bottleneck for scalable Embodied AI. Hence, we propose SPINE (Scalable Physical Integration with ageNtic Expertise), an agentic framework for systematically debugging and deploying bimanual robots for teleoperation. SPINE centers on two subagent-driven workflows: a profile builder that compiles robot-specific context and a debugger that uses that context to iterate through diagnosis, repair, and validation until teleoperation succeeds. Across two bimanual robot platforms and 12 debugging scenarios, novice-operated SPINE achieved more complete and efficient recovery than human operators using Claude Code. On DOBOT X-Trainer, SPINE improved success from 76% to 100% and reduced mean time-to-teleoperation by 30%; on AgileX PiPER, SPINE also achieved 100% success and reduced mean time-to-teleoperation by 38%. These results show that structured agentic debugging can address a key cyber-physical integration bottleneck in real-world robot deployment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 46 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
28 of 46 references.
Closest ancestors · 1
Same direction, newest first
- 2024Enabling Novel Mission Operations and Interactions with ROSA: The Robot Operating System Agent9 Oct
Other references · 27
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
15 more
- 2015End-to-End Training of Deep Visuomotor Policiescited by 847
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 190
- 2024RACER: Rich Language-Guided Failure Recovery Policies for Imitation Learningcited by 46
- 2023Distilling and Retrieving Generalizable Knowledge for Robot Manipulation via Language Correctionscited by 44
- 2023CoPAL: Corrective Planning of Robot Actions with Large Language Modelscited by 39
- 2024ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoningcited by 27
- 2025SciSciGPT: Advancing Human-AI Collaboration in the Science of Sciencecited by 26
- 2024SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Modelscited by 21
- 2023SARA-RT: Scaling up Robotics Transformers with Self-Adaptive Robust Attentioncited by 20
- 2024Automating Robot Failure Recovery Using Vision-Language Models With Optimized Promptscited by 16
- 2023Self-Recovery Prompting: Promptable General Purpose Service Robot System with Foundation Models and Self-Recoverycited by 6
- 2024RoboCrowd: Scaling Robot Data Collection through Crowdsourcingcited by 4
- 2024ROBUST: 221 Bugs in the Robot Operating Systemcited by 2
- 2025Robo-DM: Data Management For Large Robot Datasetscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Physical Agentic AI: An Architecture for Orchestrating a Robot Crew with LLMs
- 2026RACAS: Controlling Diverse Robots With a Single Agentic System
- 2026RoboQuest: Generalist Physical Agents that Search, Inspect and Test
- 2026ManipulationNet: An Infrastructure for Benchmarking Real-World Robot Manipulation with Physical Skill Challenges and Embodied Multimodal Reasoning
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory
- 2025PhysicalAgent: Towards General Cognitive Robotics with Foundation World Models
- 2026CodeActionBench: Evaluating Agentic Code-as-Policy for Embodied Manipulation
- 2026Towards the Harness of Embodied Agents