mlsanityData to 7 Oct 2026

HOIGS: Human-Object Interaction Gaussian Splatting

arXiv 2604.04016 ↗First posted 5 Apr 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Reconstructing dynamic scenes with complex human-object interactions is a fundamental challenge in computer vision and graphics. Existing Gaussian Splatting methods either rely on human pose priors while neglecting dynamic objects, or approximate all motions within a single field, limiting their ability to capture interaction-rich dynamics. To address this gap, we propose Human-Object Interaction Gaussian Splatting (HOIGS), which explicitly models interaction-induced deformation between humans and objects through a cross-attention-based HOI module. Distinct deformation baselines are employed to extract features: HexPlane for humans and Cubic Hermite Spline (CHS) for objects. By integrating these heterogeneous features, HOIGS effectively captures interdependent motions and improves deformation estimation in scenarios involving occlusion, contact, and object manipulation. Comprehensive experiments on multiple datasets demonstrate that our method consistently outperforms state-of-the-art human-centric and 4D Gaussian approaches, highlighting the importance of explicitly modeling human-object interactions for high-fidelity reconstruction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 53 references that are in the map. First posted on arXiv 5 Apr 2026.

Builds on

46 of 53 references.

References · 46

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  5. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  6. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  7. 2017End-to-end Recovery of Human Shape and Posecited by 883
  8. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  9. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  10. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  11. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  12. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
34 more
  1. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  2. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  3. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  4. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  5. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  6. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  7. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
  8. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  9. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
  10. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
  11. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  12. 2023Track Anything: Segment Anything Meets Videoscited by 230
  13. 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
  14. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
  15. 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
  16. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  17. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
  18. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  19. 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
  20. 2023HUGS: Human Gaussian Splatscited by 154
  21. 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
  22. 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
  23. 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
  24. 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
  25. 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 91
  26. 2024Expressive Whole-Body 3D Gaussian Avatarcited by 89
  27. 2023HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Videocited by 76
  28. 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
  29. 2024DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videoscited by 63
  30. 2024GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Meshcited by 51
  31. 2023Deformable 3D Gaussian Splatting for Animatable Human Avatarscited by 44
  32. 2023High-Fidelity Clothed Avatar Reconstruction from a Single Imagecited by 38
  33. 2023HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Videocited by 33
  34. 2023Animatable 3D Gaussian: Fast and High-Quality Reconstruction of Multiple Human Avatarscited by 30

Built on by

Not cited yet.