mlsanityData to 7 Oct 2026

Holistic 3D Human and Scene Mesh Estimation from Single View Images

arXiv 2012.01591 ↗First posted 2 Dec 2020cs.CVcited by 54

Not on the map. Why?

Abstract (arXiv)

The 3D world limits the human body pose and the human body pose conveys information about the surrounding objects. Indeed, from a single image of a person placed in an indoor scene, we as humans are adept at resolving ambiguities of the human pose and room layout through our knowledge of the physical laws and prior perception of the plausible object and human poses. However, few computer vision models fully leverage this fact. In this work, we propose an end-to-end trainable model that perceives the 3D scene from a single RGB image, estimates the camera pose and the room layout, and reconstructs both human body and object meshes. By imposing a set of comprehensive and sophisticated losses on all aspects of the estimations, we show that our model outperforms existing human body mesh methods and indoor scene reconstruction methods. To the best of our knowledge, this is the first model that outputs both object and human predictions at the mesh level, and performs joint optimization on the scene and human poses.

Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 14; 2023: 14; 2024: 12; 2025: 7; 2026: 4.

54 papers.

Sort:

By area:

  1. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
  2. 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
  3. 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
  4. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
  5. 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
  6. 20233D Human Pose Estimation via Intuitive Physicscited by 100
  7. 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
  8. 2022Full-Body Articulated Human-Object Interactioncited by 76
  9. 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Cameracited by 58
  10. 2022Human-Aware Object Placement for Visual Environment Reconstructioncited by 56
  11. 2023DECO: Dense Estimation of 3D Human-Scene Contact In The Wildcited by 54
  12. 2024HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environmentcited by 52
38 more
  1. 2023Detecting Human-Object Contact in Imagescited by 41
  2. 2021D3D-HOI: Dynamic 3D Human-Object Interactions from Videoscited by 39
  3. 2023Object pop-up: Can we infer 3D objects and their poses from human interactions alone?cited by 36
  4. 2023Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Viewscited by 33
  5. 2023PACE: Human and Camera Motion Estimation from in-the-wild Videoscited by 33
  6. 2022The One Where They Reconstructed 3D Humans and Environments in TV Showscited by 30
  7. 2022Reconstructing Action-Conditioned Human-Object Interactions Using Commonsense Knowledge Priorscited by 30
  8. 2022Scene-aware Egocentric 3D Human Pose Estimationcited by 30
  9. 2022Interaction Replica: Tracking Human-Object Interaction and Scene Changes From Human Motioncited by 27
  10. 2024F-HOI: Toward Fine-grained Semantic-Aligned 3D Human-Object Interactionscited by 24
  11. 2023ROAM: Robust and Object-Aware Motion Generation Using Neural Pose Descriptorscited by 23
  12. 2024InterTrack: Tracking Human Object Interaction without Object Templatescited by 22
  13. 2025PICO: Reconstructing 3D People In Contact with Objectscited by 22
  14. 2023Scene-Aware 3D Multi-Human Motion Capture from a Single Cameracited by 19
  15. 2022MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenescited by 18
  16. 2023ZeroAvatar: Zero-shot 3D Avatar Generation from a Single Imagecited by 18
  17. 2024TriDi: Trilateral Diffusion of 3D Humans, Objects, and Interactionscited by 18
  18. 2024A Unified Diffusion Framework for Scene-aware Human Motion Estimation from Sparse Signalscited by 15
  19. 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimationcited by 15
  20. 2025CARI4D: Category Agnostic 4D Reconstruction of Human-Object Interactioncited by 14
  21. 2023Learning Human Mesh Recovery in 3D Scenescited by 13
  22. 2025PhySIC: Physically Plausible 3D Human-Scene Interaction and Contact from a Single Imagecited by 13
  23. 2022Domain Adaptive 3D Pose Augmentation for In-the-wild Human Mesh Recoverycited by 12
  24. 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
  25. 2025ScoreHOI: Physically Plausible Reconstruction of Human-Object Interaction via Score-Guided Diffusioncited by 9
  26. 2025End-to-End HOI Reconstruction Transformer with Graph-based Encodingcited by 8
  27. 2023Diffusion-HPC: Synthetic Data Generation for Human Mesh Recovery in Challenging Domainscited by 5
  28. 2024StackFLOW: Monocular Human-Object Reconstruction by Stacked Normalizing Flow with Offsetcited by 5
  29. 2024Robust Shape Fitting for 3D Scene Abstractioncited by 3
  30. 2023Physically Plausible 3D Human-Scene Reconstruction from Monocular RGB Image using an Adversarial Learning Approachcited by 2
  31. 2024TFS-NeRF: Template-Free NeRF for Semantic 3D Reconstruction of Dynamic Scenecited by 2
  32. 2025Measuring Physical Plausibility of 3D Human Poses Using Physics Simulationcited by 2
  33. 2023Intelligent Generation of Graphical Game Assets: A Conceptual Framework and Systematic Review of the State of the Artcited by 1
  34. 2024Kinematics-based 3D Human-Object Interaction Reconstruction from Single Viewcited by 1
  35. 2026End-to-End Spatial-Temporal Transformer for Real-time 4D HOI Reconstructioncited by 1
  36. 2026GRAFT: Geometric Refinement and Fitting Transformer for Human Scene Reconstructioncited by 1
  37. 2022TerrainMesh: Metric-Semantic Terrain Reconstruction from Aerial Images Using Joint 2D-3D Learningcited by 0
  38. 2022Unified Simulation, Perception, and Generation of Human Behaviorcited by 0

50 most cited of 54 All 54 (JSON)