mlsanityData to 14 Oct 2026

Compositional 3D Human-Object Neural Animation

arXiv 2304.14070 ↗First posted 27 Apr 2023cs.CV cs.AI cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

Human-object interactions (HOIs) are crucial for human-centric scene understanding applications such as human-centric visual generation, AR/VR, and robotics. Since existing methods mainly explore capturing HOIs, rendering HOI remains less investigated. In this paper, we address this challenge in HOI animation from a compositional perspective, i.e., animating novel HOIs including novel interaction, novel human and/or novel object driven by a novel pose sequence. Specifically, we adopt neural human-object deformation to model and render HOI dynamics based on implicit neural representations. To enable the interaction pose transferring among different persons and objects, we then devise a new compositional conditional neural radiance field (or CC-NeRF), which decomposes the interdependence between human and object using latent codes to enable compositionally animation control of novel HOIs. Experiments show that the proposed method can generalize well to various novel HOI animation settings. Our project page is https://zhihou7.github.io/CHONA/

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 55 of its 73 references that are in the map. First posted on arXiv 27 Apr 2023.

Builds on

55 of 73 references.

References · 55

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  3. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  5. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  6. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  7. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  8. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  9. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  10. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  11. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  12. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
38 more
  1. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  2. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  3. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  4. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
  5. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  6. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
  7. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
  8. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  9. 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
  10. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  11. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  12. 2021Neural Articulated Radiance Fieldcited by 196
  13. 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
  14. 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
  15. 2020Populating 3D Scenes by Learning Human-Scene Interactioncited by 164
  16. 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
  17. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  18. 2020Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wildcited by 152
  19. 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
  20. 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
  21. 2020Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenescited by 135
  22. 2022COUCH: Towards Controllable Human-Chair Interactionscited by 135
  23. 2020Visual Compositional Learning for Human-Object Interaction Detectioncited by 130
  24. 2019Generating 3D People in Scenes without Peoplecited by 127
  25. 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
  26. 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
  27. 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
  28. 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 93
  29. 2022Towards Diverse and Natural Scene-aware 3D Human Motion Synthesiscited by 91
  30. 2022Compositional Human-Scene Interaction Synthesis with Semantic Controlcited by 83
  31. 2021Affordance Transfer Learning for Human-Object Interaction Detectioncited by 79
  32. 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
  33. 2019Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsensecited by 71
  34. 2022TOCH: Spatio-Temporal Object-to-Hand Correspondence for Motion Refinementcited by 70
  35. 2019Estimating 3D Motion and Forces of Person-Object Interactions from Monocular Videocited by 48
  36. 2022NeuralHOFusion: Neural Volumetric Rendering under Human-object Interactionscited by 44
  37. 2021D3D-HOI: Dynamic 3D Human-Object Interactions from Videoscited by 39
  38. 2022DANBO: Disentangled Articulated Neural Body Representations via Graph Neural Networkscited by 38

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 4; 2025: 2; 2026: 1.

9 papers.

  1. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
  2. 2023PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interactioncited by 76
  3. 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 72
  4. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 64
  5. 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generationcited by 32
  6. 2024Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editingcited by 18
  7. 2024COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Modelscited by 3
  8. 20243DArticCyclists: Generating Synthetic Articulated 8D Pose-Controllable Cyclist Data for Computer Vision Applicationscited by 1
  9. 2026SynAgent: Generalizable Cooperative Humanoid Manipulation via Solo-to-Cooperative Agent Synergycited by 0