mlsanityData to 14 Oct 2026

Cognition to Control - Multi-Agent Learning for Human-Humanoid Collaborative Transport

arXiv 2603.03768 ↗First posted 4 Mar 2026cs.RO cs.AIcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Full-stack human-robot collaboration (HRC) can become brittle when replacing a planner, partner model, coordination policy, or controller changes the physical meaning of cross-layer signals. We introduce C2C, an object-centric cognition-to-control architecture that preserves these meanings through physical contracts. Rather than standardizing individual modules, C2C standardizes the physical semantics exchanged between them: task intent is represented by a geometrically verified payload path, partner information by a source-independent physical state, learned coordination by bounded 11-D task-space commands, and robot-specific feasibility remains inside whole-body control (WBC). The reference system combines a vision-language model with deterministic geometric verification and multi-agent reinforcement learning (MARL) for partner-aware coordination. Across nine transport scenarios, adaptive MARL variants achieve 77.1-82.1% mean success under unchanged interfaces, compared with 56.5% for a scripted-partner reference. The same contracts further support neural and interpretable hard-tree actors, two- and three-carrier teams, and simulated-to-human partner substitution. Physical Unitree G1-human tests achieve 100% success in spatially confined transport and 80% in super-long-object handling, while a three-carrier system with two G1 humanoids and one human validates the same interface structure on hardware. Together, these results show that C2C converts a tightly coupled HRC stack into a plug-compatible system in which key components can change without redefining the physical collaboration task.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 25 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

15 of 25 references.

References · 15

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  3. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  4. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
  5. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  6. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  7. 2016Cooperative Inverse Reinforcement Learningcited by 300
  8. 2021Trust Region Policy Optimisation in Multi-Agent Reinforcement Learningcited by 186
  9. 2019A Review of Cooperative Multi-Agent Deep Reinforcement Learningcited by 147
  10. 2023Heterogeneous-Agent Reinforcement Learningcited by 69
  11. 2024Learning Multi-Modal Whole-Body Control for Real-World Humanoid Robotscited by 16
  12. 2025Learning Human-Humanoid Coordination for Collaborative Object Carryingcited by 7
3 more
  1. 2022Human-Robot Collaborative Carrying of Objects with Unknown Deformation Characteristicscited by 5
  2. 2025H2-COMPACT: Human-Humanoid Co-Manipulation via Adaptive Contact Trajectory Policiescited by 4
  3. 2025Efficient and Compliant Control Framework for Versatile Human-Humanoid Collaborative Transportationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Cognitive Collaborative Robots: Semantic-Level Integration and Explainable Control for Human-Centric Cooperation
  2. 2025Implicit Communication in Human-Robot Collaborative Transport
  3. 2026MATE: Multi-Agent Virtual Teleoperation Platform for Humanoid Collaboration Data Collection ↗
  4. 2026When Multi-Robot Systems Meet Agentic AI:Towards Embodied Collective Intelligence
  5. 2025Transforming Monolithic Foundation Models into Embodied Multi-Agent Architectures for Human-Robot Collaboration
  6. 2025Being-0: A Humanoid Robotic Agent with Vision-Language Models and Modular Skills
  7. 2026Observe, Share, or Predict? Disentangling Partner Information in Embodied Multi-Agent Collaboration
  8. 2022Aligning Robot Representations with Humans