Stability-Driven Motion Generation for Object-Guided Human-Human Co-Manipulation
Not on the map. Why?
Abstract (arXiv)
Co-manipulation requires multiple humans to synchronize their motions with a shared object while ensuring reasonable interactions, maintaining natural poses, and preserving stable states. However, most existing motion generation approaches are designed for single-character scenarios or fail to account for payload-induced dynamics. In this work, we propose a flow-matching framework that ensures the generated co-manipulation motions align with the intended goals while maintaining naturalness and effectiveness. Specifically, we first introduce a generative model that derives explicit manipulation strategies from the object's affordance and spatial configuration, which guide the motion flow toward successful manipulation. To improve motion quality, we then design an adversarial interaction prior that promotes natural individual poses and realistic inter-person interactions during co-manipulation. In addition, we also incorporate a stability-driven simulation into the flow matching process, which refines unstable interaction states through sampling-based optimization and directly adjusts the vector field regression to promote more effective manipulation. The experimental results demonstrate that our method achieves higher contact accuracy, lower penetration, and better distributional fidelity compared to state-of-the-art human-object interaction baselines. The code is available at https://github.com/boycehbz/StaCOM.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 52 of its 59 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
52 of 59 references.
References · 52
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2022Human Motion Diffusion Modelcited by 1,080
- 2017End-to-end Recovery of Human Shape and Posecited by 885
- 2016The CMA Evolution Strategy: A Tutorialcited by 377
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
- 2023Human Motion Diffusion as a Generative Priorcited by 357
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
- 2023Object Motion Guided Human Motion Synthesiscited by 212
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
38 more
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 138
- 2023Universal Humanoid Motion Representations for Physics-Based Controlcited by 116
- 2024MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpaintingcited by 116
- 2023Controllable Human-Object Interaction Synthesiscited by 109
- 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 109
- 2023Synthesizing Physical Character-Scene Interactionscited by 104
- 2019Efficient Learning on Point Clouds with Basis Point Setscited by 103
- 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
- 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
- 2024Human-Object Interaction from Human-Level Instructionscited by 64
- 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 55
- 2024ReGenNet: Towards Human Action-Reaction Synthesiscited by 53
- 2025TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenizationcited by 51
- 2024InterMask: 3D Human Interaction Generation via Collaborative Masked Modelingcited by 47
- 2024CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamicscited by 44
- 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 44
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
- 2022Trajectory Optimization for Physics-Based Reconstruction of 3d Human Pose from Monocular Videocited by 37
- 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generationcited by 32
- 2022Neural MoCon: Neural Motion Control for Physically Plausible Human Motion Capturecited by 31
- 2025Guiding Human-Object Interactions with Rich Geometry and Relationscited by 24
- 2023InterControl: Zero-shot Human Interaction Generation by Controlling Every Jointcited by 23
- 2024InterDance:Reactive 3D Dance Generation with Realistic Duet Interactionscited by 22
- 2025Towards Immersive Human-X Interaction: A Real-Time Framework for Physically Plausible Motion Synthesiscited by 20
- 2024Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaptioncited by 19
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimickingcited by 16
- 2024SyncDiff: Synchronized Motion Diffusion for Multi-Body Human-Object Interaction Synthesiscited by 14
- 2025Physics-Based Motion Imitation with Adversarial Differential Discriminatorscited by 12
- 2025Text2Interact: High-Fidelity and Diverse Text-to-Two-Person Interaction Generationcited by 11
- 2025HOI-Dyn: Learning Interaction Dynamics for Human-Object Motion Diffusioncited by 10
- 2025PINO: Person-Interaction Noise Optimization for Long-Duration and Customizable Motion Generation of Arbitrary-Sized Groupscited by 9
- 2025Multi-Person Interaction Generation from Two-Person Motion Priorscited by 8
- 2025Perceiving and Acting in First-Person: A Dataset and Benchmark for Egocentric Human-Object-Human Interactionscited by 8
- 2025Ponimator: Unfolding Interactive Pose for Versatile Human-human Interaction Animationcited by 7
- 2024Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformercited by 6
- 2024Two-Person Interaction Augmentation with Skeleton Priorscited by 5
- 2025Large-Scale Multi-Character Interaction Synthesiscited by 4
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Dex2HOI: Dexterous Bimanual Two-Object Interaction Generation
- 2025Collaborative Multi-Robot Non-Prehensile Manipulation via Flow-Matching Co-Generation
- 2026ContactFlow: A video action conditioning that transfers across embodiments
- 2026DexSynRefine: Synthesizing and Refining Human-Object Interaction Motion for Physically Feasible Dexterous Robot Actions
- 2026FlowCorrect: Efficient Interactive Correction of Generative Flow Policies for Robotic Manipulation
- 2025Human-Object Interaction via Automatically Designed VLM-Guided Motion Policy
- 2026HO-Flow: Generalizable Hand-Object Interaction Generation with Latent Flow Matching
- 2026GIRAF: Towards Generalizable Human Interactions with Articulated Objects