mlsanityData to 14 Oct 2026

MaMi-HOI: Harmonizing Global Kinematics and Local Geometry for Human-Object Interaction Generation

arXiv 2605.05756 ↗First posted 7 May 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating realistic 3D Human-Object Interactions (HOI) is a fundamental task for applications ranging from embodied AI to virtual content creation, which requires harmonizing high-level semantic intent with strict low-level physical constraints. Existing methods excel at semantic alignment, however, they struggle to maintain precise object contact. We reveal a key finding termed textitGeometric Forgetting: as diffusion model depth increases, semantic feature tend to overshadow object geometry feature, causing the model to lose its perception to object geometry. To address this, we propose MaMi-HOI, a hierarchical framework reconciling Macro-level kinematic fluidity with Micro-level spatial precision. First, to counteract geometric forgetting, we introduce the Geometry-Aware Proximity Adapter (GAPA), which explicitly re-injects dense object details to perform residual snapping corrections for precise contact. Nevertheless, such aggressive local enforcement can disrupt global dynamics, leading to robotic stiffness. In response, we introduce the Kinematic Harmony Adapter (KHA), which proactively aligns whole-body posture with spatial objectives, ensuring the skeleton actively accommodates constraints without compromising naturalness. Extensive experiments validate that MaMi-HOI simultaneously achieves natural motion and precise contact. Crucially, it extends generation capabilities to long-term tasks with complex trajectories, effectively bridging the gap between global navigation and high-fidelity manipulation in 3D scenes. Code is available at https://github.com/DON738110198/MaMi-HOI.git

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 38 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

33 of 38 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  5. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  6. 2020Point Transformercited by 1,470
  7. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  8. 2022Human Motion Diffusion Modelcited by 1,080
  9. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  10. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  11. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
  12. 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 239
21 more
  1. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
  2. 2023Object Motion Guided Human Motion Synthesiscited by 212
  3. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
  4. 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 158
  5. 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 138
  6. 2023Synthesizing Diverse Human Motions in 3D Indoor Scenescited by 109
  7. 2023Controllable Human-Object Interaction Synthesiscited by 109
  8. 2019Efficient Learning on Point Clouds with Basis Point Setscited by 103
  9. 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 86
  10. 2024Human-Object Interaction from Human-Level Instructionscited by 64
  11. 2023Zero-Shot Robot Manipulation from Passive Human Videoscited by 51
  12. 2024Generating Human Motion in 3D Scenes from Text Descriptionscited by 49
  13. 2024THOR: Text to Human-Object Interaction Diffusion via Relation Interventioncited by 46
  14. 2023Hierarchical Planning and Control for Box Loco-Manipulationcited by 44
  15. 2024Joint Reconstruction of 3D Human and Object via Contact-Based Refinement Transformercited by 29
  16. 2022Interaction Replica: Tracking Human-Object Interaction and Scene Changes From Human Motioncited by 27
  17. 2024AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animationcited by 25
  18. 2025Guiding Human-Object Interactions with Rich Geometry and Relationscited by 24
  19. 2025ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generationcited by 20
  20. 2025HOI-Dyn: Learning Interaction Dynamics for Human-Object Motion Diffusioncited by 10
  21. 2024StackFLOW: Monocular Human-Object Reconstruction by Stacked Normalizing Flow with Offsetcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024F-HOI: Toward Fine-grained Semantic-Aligned 3D Human-Object Interactions
  2. 2026HO-Flow: Generalizable Hand-Object Interaction Generation with Latent Flow Matching
  3. 2025HOSIG: Full-Body Human-Object-Scene Interaction Generation with Hierarchical Scene Perception
  4. 2025InteractAnything: Zero-shot Human Object Interaction Synthesis via LLM Feedback and Object Affordance Parsing
  5. 2025HOI-PAGE: Zero-Shot Human-Object Interaction Generation with Part Affordance Guidance
  6. 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Models
  7. 2025OpenHOI: Open-World Hand-Object Interaction Synthesis with Multimodal Large Language Model
  8. 2026Acting in Meters: Learning Metric Interactions for Precise Robotic Manipulation