mlsanityData to 7 Oct 2026

A Closed-Loop Multi-Agent Framework for Robust Multi-Robot Manipulation

arXiv 2607.06990 ↗First posted 8 Jul 2026cs.ROcited by 1

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Multi-robot systems provide the parallelism and redundancy necessary for long-horizon tasks, while Large Language Models (LLMs) offer the reasoning capabilities to decompose these objectives into actionable plans. However, effectively grounding this high-level reasoning in physical multi-robot execution remains an open challenge. Existing LLM-based approaches fall mainly into two categories: Single-robot methods achieve robust contact-rich manipulation but lack the coordination mechanisms required for tasks spanning multiple workspaces. Current multi-robot frameworks focus on high-level planning, often treating manipulation as an idealized primitive that fails to account for real-world execution uncertainties. To address this, we propose a hierarchical closed-loop agentic LLM-based framework to ensure robust multi-robot manipulation. Our system consists of three specialized agents: the Planning Agent decomposes instructions into allocated sub-tasks, the Manipulation Agent for each robot executes actions via adaptive tool use, and the Verification Agent closes the loop by monitoring physical outcomes and feeding back semantic corrections. Extensive real-world experiments demonstrate that our framework achieves superior success rates, ensures robust adaptability ranging from single to cross workspace manipulation, and offers a generalizable approach for diverse manipulation tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 49 of its 59 references that are in the map. First posted on arXiv 8 Jul 2026.

Builds on

49 of 59 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  2. 2024COHERENT: Collaboration of Heterogeneous Multi-Robot System with Large Language Models23 Sep
  3. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation3 Sep
  4. 2022Inner Monologue: Embodied Reasoning through Planning with Language Models12 Jul

Other references · 45

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2023Segment Anythingcited by 8,158
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  7. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  8. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  9. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  10. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  11. 2023Reasoning with Language Model is Planning with World Modelcited by 846
  12. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
33 more
  1. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
  2. 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 231
  3. 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 205
  4. 2022Language Models of Code are Few-Shot Commonsense Learnerscited by 160
  5. 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 151
  6. 2018PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planningcited by 147
  7. 2023Self-planning Code Generation with Large Language Modelscited by 121
  8. 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 104
  9. 2025A Survey on Code Generation with LLM-based Agentscited by 104
  10. 2024CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Modelscited by 97
  11. 2020FAST-LIO: A Fast, Robust LiDAR-inertial Odometry Package by Tightly-Coupled Iterated Kalman Filtercited by 70
  12. 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraintscited by 58
  13. 2024Grasp as You Say: Language-guided Dexterous Grasp Generationcited by 39
  14. 2024LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning with LM-Driven PDDL Plannercited by 31
  15. 2025Exploring the Limits of Vision-Language-Action Manipulations in Cross-task Generalizationcited by 31
  16. 2021Integrated Task Assignment and Path Planning for Capacitated Multi-Agent Pickup and Deliverycited by 29
  17. 2025Large Language Models for Multi-Robot Systems: A Surveycited by 26
  18. 2025AffordDexGrasp: Open-set Language-guided Dexterous Grasp with Generalizable-Instructive Affordancecited by 25
  19. 2025PyRoki: A Modular Toolkit for Robot Kinematic Optimizationcited by 25
  20. 2024LiP-LLM: Integrating Linear Programming and dependency graph with Large Language Models for multi-robot task planningcited by 23
  21. 2024Mitigating the Human-Robot Domain Discrepancy in Visual Pre-training for Robotic Manipulationcited by 22
  22. 2025Rethinking Bimanual Robotic Manipulation: Learning with Decoupled Interaction Frameworkcited by 11
  23. 2024A Survey of Language-Based Communication in Roboticscited by 10
  24. 2024Leveraging Large Language Model for Heterogeneous Ad Hoc Teamwork Collaborationcited by 7
  25. 2025CycleManip: Enabling Cyclic Task Manipulation via Effective Historical Perception and Understandingcited by 7
  26. 2025EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observationscited by 5
  27. 2026ReViP: Mitigating False Completion in Vision-Language-Action Models with Vision-Proprioception Rebalancecited by 5
  28. 2025Task-Oriented 6-DoF Grasp Pose Detection in Clutterscited by 4
  29. 2025OmniDexGrasp: Generalizable Dexterous Grasping via Foundation Model and Force Feedbackcited by 4
  30. 2025TypeTele: Releasing Dexterity in Teleoperation by Dexterous Manipulation Typescited by 3
  31. 2025CollaBot: Vision-Language Guided Simultaneous Collaborative Manipulationcited by 3
  32. 2025ReSemAct: Advancing Fine-Grained Robotic Manipulation via Semantic Structuring and Affordance Refinementcited by 2
  33. 2025PIP-LLM: Integrating PDDL-Integer Programming with LLMs for Coordinating Multi-Robot Teams Using Natural Languagecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024MALMM: Multi-Agent Large Language Models for Zero-Shot Robotics Manipulation
  2. 2026MALLVI: A Multi-Agent Framework for Integrated Generalized Robotics Manipulation
  3. 2026ALRM: Agentic LLM for Robotic Manipulation
  4. 2026HEART: Coordination of Heterogeneous Expert Agents for Physically Grounded Robotic Task Planning
  5. 2025Curriculum Guided Massive Multi Agent System Solving For Robust Long Horizon Tasks
  6. 2026Hierarchical LLM-Based Multi-Agent Framework with Prompt Optimization for Multi-Robot Task Planning
  7. 2025HMCF: A Human-in-the-loop Multi-Robot Collaboration Framework Based on Large Language Models
  8. 2026PLanAR: Planning-Language-Grounded Agentic Reasoning for Robot Manipulation