MFlowHOI: Whole-Body Human-Object Interaction Generation via Part-Aware MeanFlow
Not on the map. Why?
Abstract (arXiv)
Whole-body human-object interaction (HOI) generation requires coordinating body and finger motion, object trajectories, and time-varying contacts. Existing methods typically rely on iterative diffusion or test-time optimization, resulting in high inference costs. Direct one-step generation is highly desired in downstream applications due to efficient inference. However, it is challenging because these HOI components differ substantially in structure and scale. We present MFlowHOI, an efficient one-step framework for whole-body HOI generation. A Contact-Aware Multipart RVQVAE organizes body, hand, object, and contact signals into a structured latent space, with a shared decoder preserving their global coordination. An ST-DiT then models temporal and cross-part dependencies in this space and generates a complete interaction in a single MeanFlow evaluation. Predicted object-local contact correspondences further enable geometric refinement and interaction-preserving transfer to photorealistic 3D Gaussian avatars with different body proportions. Experiments demonstrate that MFlowHOI outperforms existing base generators in motion quality and text alignment while substantially reducing inference time.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 37 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
29 of 37 references.
References · 29
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
- 2023Object Motion Guided Human Motion Synthesiscited by 212
- 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 144
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 124
- 2021D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactionscited by 113
- 2023TLControl: Trajectory and Language Control for Human Motion Synthesiscited by 94
- 2021SAGA: Stochastic Whole-Body Grasping with Contactcited by 91
- 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 86
17 more
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 84
- 2022TOCH: Spatio-Temporal Object-to-Hand Correspondence for Motion Refinementcited by 70
- 2024Human-Object Interaction from Human-Level Instructionscited by 64
- 2024DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptionscited by 62
- 2023CAMS: CAnonicalized Manipulation Spaces for Category-Level Functional Hand-Object Manipulation Synthesiscited by 56
- 2023ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulationcited by 55
- 2023ContactGen: Generative Contact Modeling for Grasp Generationcited by 53
- 2023Motion Flow Matching for Human Motion Synthesis and Editingcited by 38
- 2024GeneOH Diffusion: Towards Generalizable Hand-Object Interaction Denoising via Denoising Diffusioncited by 35
- 2025HOIGPT: Learning Long Sequence Hand-Object Interaction with Language Modelscited by 33
- 2023GRIP: Generating Interaction Poses Using Spatial Cues and Latent Consistencycited by 27
- 2025HOIDiNi: Human-Object Interaction through Diffusion Noise Optimizationcited by 18
- 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objectscited by 12
- 2025FlowerDance: MeanFlow for Efficient and Refined 3D Dance Generationcited by 11
- 2024GraspDiffusion: Synthesizing Realistic Whole-body Hand-Object Interactioncited by 8
- 2025FlowMotion: Target-Predictive Conditional Flow Matching for Jitter-Reduced Text-Driven Human Motion Generationcited by 4
- 2025ARMFlow: AutoRegressive MeanFlow for Online 3D Human Reaction Generationcited by 2
Built on by
Not cited yet.