A Closed-Loop Multi-Agent Framework for Robust Multi-Robot Manipulation
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Multi-robot systems provide the parallelism and redundancy necessary for long-horizon tasks, while Large Language Models (LLMs) offer the reasoning capabilities to decompose these objectives into actionable plans. However, effectively grounding this high-level reasoning in physical multi-robot execution remains an open challenge. Existing LLM-based approaches fall mainly into two categories: Single-robot methods achieve robust contact-rich manipulation but lack the coordination mechanisms required for tasks spanning multiple workspaces. Current multi-robot frameworks focus on high-level planning, often treating manipulation as an idealized primitive that fails to account for real-world execution uncertainties. To address this, we propose a hierarchical closed-loop agentic LLM-based framework to ensure robust multi-robot manipulation. Our system consists of three specialized agents: the Planning Agent decomposes instructions into allocated sub-tasks, the Manipulation Agent for each robot executes actions via adaptive tool use, and the Verification Agent closes the loop by monitoring physical outcomes and feeding back semantic corrections. Extensive real-world experiments demonstrate that our framework achieves superior success rates, ensures robust adaptability ranging from single to cross workspace manipulation, and offers a generalizable approach for diverse manipulation tasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 49 of its 59 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
49 of 59 references.
Closest ancestors · 4
Same direction, newest first
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2024COHERENT: Collaboration of Heterogeneous Multi-Robot System with Large Language Models23 Sep
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation3 Sep
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Models12 Jul
Other references · 45
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Segment Anythingcited by 8,158
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2023Reasoning with Language Model is Planning with World Modelcited by 846
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
33 more
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 231
- 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 205
- 2022Language Models of Code are Few-Shot Commonsense Learnerscited by 160
- 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 151
- 2018PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planningcited by 147
- 2023Self-planning Code Generation with Large Language Modelscited by 121
- 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 104
- 2025A Survey on Code Generation with LLM-based Agentscited by 104
- 2024CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Modelscited by 97
- 2020FAST-LIO: A Fast, Robust LiDAR-inertial Odometry Package by Tightly-Coupled Iterated Kalman Filtercited by 70
- 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraintscited by 58
- 2024Grasp as You Say: Language-guided Dexterous Grasp Generationcited by 39
- 2024LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning with LM-Driven PDDL Plannercited by 31
- 2025Exploring the Limits of Vision-Language-Action Manipulations in Cross-task Generalizationcited by 31
- 2021Integrated Task Assignment and Path Planning for Capacitated Multi-Agent Pickup and Deliverycited by 29
- 2025Large Language Models for Multi-Robot Systems: A Surveycited by 26
- 2025AffordDexGrasp: Open-set Language-guided Dexterous Grasp with Generalizable-Instructive Affordancecited by 25
- 2025PyRoki: A Modular Toolkit for Robot Kinematic Optimizationcited by 25
- 2024LiP-LLM: Integrating Linear Programming and dependency graph with Large Language Models for multi-robot task planningcited by 23
- 2024Mitigating the Human-Robot Domain Discrepancy in Visual Pre-training for Robotic Manipulationcited by 22
- 2025Rethinking Bimanual Robotic Manipulation: Learning with Decoupled Interaction Frameworkcited by 11
- 2024A Survey of Language-Based Communication in Roboticscited by 10
- 2024Leveraging Large Language Model for Heterogeneous Ad Hoc Teamwork Collaborationcited by 7
- 2025CycleManip: Enabling Cyclic Task Manipulation via Effective Historical Perception and Understandingcited by 7
- 2025EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observationscited by 5
- 2026ReViP: Mitigating False Completion in Vision-Language-Action Models with Vision-Proprioception Rebalancecited by 5
- 2025Task-Oriented 6-DoF Grasp Pose Detection in Clutterscited by 4
- 2025OmniDexGrasp: Generalizable Dexterous Grasping via Foundation Model and Force Feedbackcited by 4
- 2025TypeTele: Releasing Dexterity in Teleoperation by Dexterous Manipulation Typescited by 3
- 2025CollaBot: Vision-Language Guided Simultaneous Collaborative Manipulationcited by 3
- 2025ReSemAct: Advancing Fine-Grained Robotic Manipulation via Semantic Structuring and Affordance Refinementcited by 2
- 2025PIP-LLM: Integrating PDDL-Integer Programming with LLMs for Coordinating Multi-Robot Teams Using Natural Languagecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024MALMM: Multi-Agent Large Language Models for Zero-Shot Robotics Manipulation
- 2026MALLVI: A Multi-Agent Framework for Integrated Generalized Robotics Manipulation
- 2026ALRM: Agentic LLM for Robotic Manipulation
- 2026HEART: Coordination of Heterogeneous Expert Agents for Physically Grounded Robotic Task Planning
- 2025Curriculum Guided Massive Multi Agent System Solving For Robust Long Horizon Tasks
- 2026Hierarchical LLM-Based Multi-Agent Framework with Prompt Optimization for Multi-Robot Task Planning
- 2025HMCF: A Human-in-the-loop Multi-Robot Collaboration Framework Based on Large Language Models
- 2026PLanAR: Planning-Language-Grounded Agentic Reasoning for Robot Manipulation