SynAgent: Generalizable Cooperative Humanoid Manipulation via Solo-to-Cooperative Agent Synergy
Not on the map. Why?
Abstract (arXiv)
Controllable cooperative humanoid manipulation is a fundamental yet challenging problem for embodied intelligence, due to severe data scarcity, complexities in multi-agent coordination, and limited generalization across objects. In this paper, we present SynAgent, a unified framework that enables scalable and physically plausible cooperative manipulation by leveraging Solo-to-Cooperative Agent Synergy to transfer skills from single-agent human-object interaction to multi-agent human-object-human scenarios. To maintain semantic integrity during motion transfer, we introduce an interaction-preserving retargeting method based on an Interact Mesh constructed via Delaunay tetrahedralization, which faithfully maintains spatial relationships among humans and objects. Building upon this refined data, we propose a single-agent pretraining and adaptation paradigm that distills synergistic collaborative behaviors from abundant single-human data through decentralized training and multi-agent PPO. Finally, we develop a trajectory-conditioned generative policy using a conditional VAE, trained via multi-teacher distillation from motion imitation priors to achieve stable and controllable object-level trajectory execution. Extensive experiments demonstrate that SynAgent significantly outperforms existing baselines in both cooperative imitation and trajectory-conditioned control, while generalizing across diverse object geometries. Codes and data will be available after publication. Project Page: https://yw0208.github.io/synagent/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 53 of its 68 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
53 of 68 references.
References · 53
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 903
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
- 2023Object Motion Guided Human Motion Synthesiscited by 206
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
- 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
- 2024Scaling Up Dynamic Human-Scene Interaction Modelingcited by 137
- 2022COUCH: Towards Controllable Human-Chair Interactionscited by 134
38 more
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 121
- 2024Learning Human-to-Humanoid Real-Time Whole-Body Teleoperationcited by 112
- 2023Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learningcited by 111
- 2023Synthesizing Diverse Human Motions in 3D Indoor Scenescited by 109
- 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 109
- 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 101
- 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
- 2021SAGA: Stochastic Whole-Body Grasping with Contactcited by 89
- 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 84
- 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
- 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 67
- 2021SmoothNet: A Plug-and-Play Network for Refining Human Poses in Videoscited by 64
- 2024DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptionscited by 60
- 2025OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interactioncited by 57
- 2024Autonomous Character-Scene Interaction Synthesis from Text Instructioncited by 56
- 2023ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulationcited by 53
- 2023Locomotion-Action-Manipulation: Synthesizing Human-Scene Interactions in Complex 3D Environmentscited by 51
- 2023LEMON: Learning 3D Human-Object Interaction Relation from 2D Imagescited by 49
- 2024Omnigrasp: Grasping Diverse Objects with Simulated Humanoidscited by 45
- 2024CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamicscited by 43
- 2023Task-Oriented Human-Object Interactions Generation with Implicit Neural Representationscited by 41
- 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 40
- 2021D3D-HOI: Dynamic 3D Human-Object Interactions from Videoscited by 39
- 2023PMP: Learning to Physically Interact with Environments using Part-wise Motion Priorscited by 38
- 2023Object pop-up: Can we infer 3D objects and their poses from human interactions alone?cited by 36
- 2023Simulation and Retargeting of Complex Multi-Character Interactionscited by 32
- 2024SMPLOlympics: Sports Environments for Physically Simulated Humanoidscited by 29
- 2025SPIDER: Scalable Physics-Informed Dexterous Retargetingcited by 25
- 2024GUESS:GradUally Enriching SyntheSis for Text-Driven Human Motion Generationcited by 22
- 2024InterTrack: Tracking Human Object Interaction without Object Templatescited by 22
- 2022Learn to Predict How Humans Manipulate Large-sized Objects from Interactive Motionscited by 21
- 2024Diff-IP2D: Diffusion-Based Hand-Object Interaction Prediction on Egocentric Videoscited by 21
- 2024ManiDext: Hand-Object Manipulation Synthesis via Continuous Correspondence Embeddings and Residual-Guided Diffusioncited by 21
- 2023NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objectscited by 17
- 2023Compositional 3D Human-Object Neural Animationcited by 9
- 2025MimicKit: A Reinforcement Learning Framework for Motion Imitation and Controlcited by 9
- 2023A Two-part Transformer Network for Controllable Motion Synthesiscited by 7
- 2023Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Posescited by 7
50 most cited of 53 All 53 (JSON)
Built on by
Not cited yet.