mlsanityData to 7 Oct 2026

SynAgent: Generalizable Cooperative Humanoid Manipulation via Solo-to-Cooperative Agent Synergy

arXiv 2604.18557 ↗First posted 20 Apr 2026cs.CV cs.GR cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Controllable cooperative humanoid manipulation is a fundamental yet challenging problem for embodied intelligence, due to severe data scarcity, complexities in multi-agent coordination, and limited generalization across objects. In this paper, we present SynAgent, a unified framework that enables scalable and physically plausible cooperative manipulation by leveraging Solo-to-Cooperative Agent Synergy to transfer skills from single-agent human-object interaction to multi-agent human-object-human scenarios. To maintain semantic integrity during motion transfer, we introduce an interaction-preserving retargeting method based on an Interact Mesh constructed via Delaunay tetrahedralization, which faithfully maintains spatial relationships among humans and objects. Building upon this refined data, we propose a single-agent pretraining and adaptation paradigm that distills synergistic collaborative behaviors from abundant single-human data through decentralized training and multi-agent PPO. Finally, we develop a trajectory-conditioned generative policy using a conditional VAE, trained via multi-teacher distillation from motion imitation priors to achieve stable and controllable object-level trajectory execution. Extensive experiments demonstrate that SynAgent significantly outperforms existing baselines in both cooperative imitation and trajectory-conditioned control, while generalizing across diverse object geometries. Codes and data will be available after publication. Project Page: https://yw0208.github.io/synagent/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 53 of its 68 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

53 of 68 references.

References · 53

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  4. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  5. 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 903
  6. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
  7. 2023Object Motion Guided Human Motion Synthesiscited by 206
  8. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
  9. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
  10. 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
  11. 2024Scaling Up Dynamic Human-Scene Interaction Modelingcited by 137
  12. 2022COUCH: Towards Controllable Human-Chair Interactionscited by 134
38 more
  1. 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 121
  2. 2024Learning Human-to-Humanoid Real-Time Whole-Body Teleoperationcited by 112
  3. 2023Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learningcited by 111
  4. 2023Synthesizing Diverse Human Motions in 3D Indoor Scenescited by 109
  5. 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 109
  6. 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 101
  7. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  8. 2021SAGA: Stochastic Whole-Body Grasping with Contactcited by 89
  9. 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 84
  10. 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
  11. 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 67
  12. 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
  13. 2024DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptionscited by 60
  14. 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 57
  15. 2024Autonomous Character-Scene Interaction Synthesis from Text Instructioncited by 56
  16. 2023ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulationcited by 53
  17. 2023Locomotion-Action-Manipulation: Synthesizing Human-Scene Interactions in Complex 3D Environmentscited by 51
  18. 2023LEMON: Learning 3D Human-Object Interaction Relation from 2D Imagescited by 49
  19. 2024Omnigrasp: Grasping Diverse Objects with Simulated Humanoidscited by 45
  20. 2024CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamicscited by 43
  21. 2023Task-Oriented Human-Object Interactions Generation with Implicit Neural Representationscited by 41
  22. 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 40
  23. 2021D3D-HOI: Dynamic 3D Human-Object Interactions from Videoscited by 39
  24. 2023PMP: Learning to Physically Interact with Environments using Part-wise Motion Priorscited by 38
  25. 2023Object pop-up: Can we infer 3D objects and their poses from human interactions alone?cited by 36
  26. 2023Simulation and Retargeting of Complex Multi-Character Interactionscited by 32
  27. 2024SMPLOlympics: Sports Environments for Physically Simulated Humanoidscited by 29
  28. 2025SPIDER: Scalable Physics-Informed Dexterous Retargetingcited by 25
  29. 2024GUESS:GradUally Enriching SyntheSis for Text-Driven Human Motion Generationcited by 22
  30. 2024InterTrack: Tracking Human Object Interaction without Object Templatescited by 22
  31. 2022Learn to Predict How Humans Manipulate Large-sized Objects from Interactive Motionscited by 21
  32. 2024Diff-IP2D: Diffusion-Based Hand-Object Interaction Prediction on Egocentric Videoscited by 21
  33. 2024ManiDext: Hand-Object Manipulation Synthesis via Continuous Correspondence Embeddings and Residual-Guided Diffusioncited by 21
  34. 2023NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objectscited by 17
  35. 2023Compositional 3D Human-Object Neural Animationcited by 9
  36. 2025MimicKit: A Reinforcement Learning Framework for Motion Imitation and Controlcited by 9
  37. 2023A Two-part Transformer Network for Controllable Motion Synthesiscited by 7
  38. 2023Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Posescited by 7

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.