mlsanityData to 7 Oct 2026

RHOBIN Challenge: Reconstruction of Human Object Interaction

arXiv 2401.04143 ↗First posted 7 Jan 2024cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

Modeling the interaction between humans and objects has been an emerging research direction in recent years. Capturing human-object interaction is however a very challenging task due to heavy occlusion and complex dynamics, which requires understanding not only 3D human pose, and object pose but also the interaction between them. Reconstruction of 3D humans and objects has been two separate research fields in computer vision for a long time. We hence proposed the first RHOBIN challenge: reconstruction of human-object interactions in conjunction with the RHOBIN workshop. It was aimed at bringing the research communities of human and object reconstruction as well as interaction modeling together to discuss techniques and exchange ideas. Our challenge consists of three tracks of 3D reconstruction from monocular RGB images with a focus on dealing with challenging interaction scenarios. Our challenge attracted more than 100 participants with more than 300 submissions, indicating the broad interest in the research communities. This paper describes the settings of our challenge and discusses the winning methods of each track in more detail. We observe that the human reconstruction task is becoming mature even under heavy occlusion settings while object pose estimation and joint reconstruction remain challenging tasks. With the growing interest in interaction modeling, we hope this report can provide useful insights and foster future research in this direction. Our workshop website can be found at hrefhttps://rhobin-challenge.github.io/https://rhobin-challenge.github.io/.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 65 of its 75 references that are in the map. First posted on arXiv 7 Jan 2024.

Builds on

65 of 75 references.

References · 65

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  4. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
  5. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  6. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  7. 2017End-to-end Recovery of Human Shape and Posecited by 883
  8. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  9. 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
  10. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
  11. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
  12. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
38 more
  1. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  2. 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 490
  3. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
  4. 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
  5. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  6. 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
  7. 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
  8. 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 304
  9. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
  10. 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
  11. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  12. 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
  13. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
  14. 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
  15. 2020Monocular, One-stage, Regression of Multiple 3D Peoplecited by 216
  16. 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
  17. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
  18. 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 180
  19. 2020Grasping Field: Learning Implicit Representations for Human Graspscited by 178
  20. 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 168
  21. 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 155
  22. 2020Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wildcited by 152
  23. 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
  24. 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
  25. 2019ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imagingcited by 145
  26. 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 144
  27. 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 141
  28. 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
  29. 2022COUCH: Towards Controllable Human-Chair Interactionscited by 134
  30. 2020CPF: Learning a Contact Potential Field to Model the Hand-Object Interactioncited by 127
  31. 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 120
  32. 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
  33. 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 115
  34. 2023TADA! Text to Animatable Digital Avatarscited by 109
  35. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  36. 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
  37. 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
  38. 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 90

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 4; 2026: 3.

10 papers.

  1. 2024Joint Reconstruction of 3D Human and Object via Contact-Based Refinement Transformercited by 29
  2. 2024InterTrack: Tracking Human Object Interaction without Object Templatescited by 22
  3. 2024Survey on Modeling of Human-made Articulated Objectscited by 14
  4. 2025CARI4D: Category Agnostic 4D Reconstruction of Human-Object Interactioncited by 14
  5. 2025Learning Dense Hand Contact Estimation from Imbalanced Datacited by 12
  6. 2026LOME: Learning Human-Object Manipulation with Action-Conditioned Egocentric World Modelcited by 12
  7. 2025End-to-End HOI Reconstruction Transformer with Graph-based Encodingcited by 8
  8. 2025Shoe Style-Invariant and Ground-Aware Learning for Dense Foot Contact Estimationcited by 1
  9. 2026TeHOR: Text-Guided 3D Human and Object Reconstruction with Texturescited by 1
  10. 2026Hoi3DGen: Generating High-Quality Human-Object-Interactions in 3Dcited by 0