mlsanityData to 14 Oct 2026

Primitive-based 3D Human-Object Interaction Modelling and Programming

arXiv 2312.10714 ↗First posted 17 Dec 2023cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Embedding Human and Articulated Object Interaction (HAOI) in 3D is an important direction for a deeper human activity understanding. Different from previous works that use parametric and CAD models to represent humans and objects, in this work, we propose a novel 3D geometric primitive-based language to encode both humans and objects. Given our new paradigm, humans and objects are all compositions of primitives instead of heterogeneous entities. Thus, mutual information learning may be achieved between the limited 3D data of humans and different object categories. Moreover, considering the simplicity of the expression and the richness of the information it contains, we choose the superquadric as the primitive representation. To explore an effective embedding of HAOI for the machine, we build a new benchmark on 3D HAOI consisting of primitives together with their images and propose a task requiring machines to recover 3D HAOI using primitives from images. Moreover, we propose a baseline of single-view 3D reconstruction on HAOI. We believe this primitive-based 3D HAOI representation would pave the way for 3D HAOI studies. Our code and data are available at https://mvig-rhos.com/p3haoi.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 34 of its 42 references that are in the map. First posted on arXiv 17 Dec 2023.

Builds on

34 of 42 references.

References · 34

  1. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  2. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  3. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  4. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  5. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  6. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  7. 2016RMPE: Regional Multi-person Pose Estimationcited by 340
  8. 2020Monocular, One-stage, Regression of Multiple 3D Peoplecited by 218
  9. 2018CrowdPose: Efficient Crowded Scenes Pose Estimation and A New Benchmarkcited by 214
  10. 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
  11. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 153
  12. 2020Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wildcited by 152
22 more
  1. 2020Coherent Reconstruction of Multiple Humans from a Single Imagecited by 136
  2. 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
  3. 2019Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"cited by 106
  4. 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
  5. 2020Detailed 2D-3D Joint Representation for Human-Object Interactioncited by 93
  6. 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 93
  7. 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
  8. 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discoverycited by 66
  9. 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Cameracited by 58
  10. 2020Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying Kernelscited by 53
  11. 2022BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Informationcited by 51
  12. 2022Interactiveness Field in Human-Object Interactionscited by 40
  13. 2021D3D-HOI: Dynamic 3D Human-Object Interactions from Videoscited by 39
  14. 2021Learning to Regress Bodies from Images using Differentiable Semantic Renderingcited by 39
  15. 2022Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detectioncited by 34
  16. 2022Reconstructing Action-Conditioned Human-Object Interactions Using Commonsense Knowledge Priorscited by 30
  17. 2021Cuboids Revisited: Learning Robust 3D Shape Fitting to Single RGB Imagescited by 17
  18. 20213DIAS: 3D Shape Reconstruction with Implicit Algebraic Surfacescited by 17
  19. 2023ShapeClipper: Scalable 3D Shape Learning from Single-View Images via Geometric and CLIP-based Consistencycited by 16
  20. 2021Discovering 3D Parts from Image Collectionscited by 13
  21. 2020Compositionally Generalizable 3D Structure Predictioncited by 7
  22. 2021Single Image 3D Object Estimation with Primitive Graph Networkscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 3; 2026: 1.

7 papers.

  1. 2024CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementcited by 44
  2. 2024TriDi: Trilateral Diffusion of 3D Humans, Objects, and Interactionscited by 20
  3. 2024Design2GarmentCode: Turning Design Concepts to Tangible Garments Through Program Synthesiscited by 18
  4. 2025Reconstructing In-the-Wild Open-Vocabulary Human-Object Interactionscited by 13
  5. 2025SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarioscited by 12
  6. 2026HarmoHOI: Harmonizing Appearance and 3D Motion for Multi-view Hand-Object Interaction Synthesiscited by 4
  7. 2025SyncMV4D: Synchronized Multi-view Joint Diffusion of Appearance and Motion for Hand-Object Interaction Synthesiscited by 1