mlsanityData to 7 Oct 2026

UniCon3R: Unified Contact-aware 4D Human-Scene Reconstruction from Monocular Video

arXiv 2604.19923 ↗First posted 21 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce UniCon3R, a unified feed-forward framework for online human-scene 4D reconstruction from monocular video. Current feed-forward human-scene reconstruction methods suffer from artifacts, where bodies float above the ground or penetrate parts of the scene. A key reason is the lack of effective interaction modelling between the human and the environment. Our goal is to exploit contact between the human and the scene during inference to actively improve the human mesh reconstruction. To that end, we explicitly model interaction by inferring 4D contact from the human pose and scene geometry and use the contact as a corrective cue for generating the pose. This enables UniCon3R to jointly recover scene geometry and spatially aligned 4D humans within the scene. Experiments on standard human-centric video benchmarks show that UniCon3R outperforms state-of-the-art baselines on physical plausibility and global human motion estimation while preserving fast, feed-forward inference speeds. The results validate our central claim: contact serves as a powerful internal prior, thus establishing a new paradigm for physically grounded joint human-scene reconstruction. Project page is available at https://surtantheta.github.io/UniCon3R .

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 51 references that are in the map. First posted on arXiv 21 Apr 2026.

Builds on

46 of 51 references.

References · 46

  1. 2017Mask R-CNNcited by 7,259
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  3. 2022Visual Prompt Tuningcited by 1,674
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  5. 2017End-to-end Recovery of Human Shape and Posecited by 883
  6. 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 844
  7. 2019Are Sixteen Heads Really Better than One?cited by 803
  8. 2020Quantifying Attention Flow in Transformerscited by 759
  9. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
  10. 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
  11. 2025Continuous 3D Perception Model with Persistent Statecited by 527
  12. 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
34 more
  1. 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
  2. 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 229
  3. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
  4. 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
  5. 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 141
  6. 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
  7. 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
  8. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
  9. 20233D Human Pose Estimation via Intuitive Physicscited by 100
  10. 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
  11. 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
  12. 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representationcited by 93
  13. 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environmentscited by 89
  14. 2024CameraHMR: Aligning People with Perspectivecited by 64
  15. 2020Holistic 3D Human and Scene Mesh Estimation from Single View Imagescited by 54
  16. 2023DECO: Dense Estimation of 3D Human-Scene Contact In The Wildcited by 54
  17. 2023SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environmentscited by 47
  18. 2023ReFit: Recurrent Fitting Network for 3D Human Recoverycited by 47
  19. 2025Human3R: Everyone Everywhere All at Oncecited by 35
  20. 2023PACE: Human and Camera Motion Estimation from in-the-wild Videoscited by 33
  21. 2021Contact-Aware Retargeting of Skinned Motioncited by 31
  22. 2024Reconstructing People, Places, and Camerascited by 31
  23. 2025SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimationcited by 31
  24. 2022The One Where They Reconstructed 3D Humans and Environments in TV Showscited by 30
  25. 2025Joint Optimization for 4D Human-Scene Reconstruction in the Wildcited by 29
  26. 2025PICO: Reconstructing 3D People In Contact with Objectscited by 22
  27. 2025InteractVLM: 3D Interaction Reasoning from 2D Foundational Modelscited by 21
  28. 2024HUMOS: Human Motion Model Conditioned on Body Shapecited by 20
  29. 2024Synergistic Global-space Camera and Human Reconstruction from Videoscited by 17
  30. 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimationcited by 15
  31. 2025HAMSt3R: Human-Aware Multi-view Stereo 3D Reconstructioncited by 15
  32. 2025PhySIC: Physically Plausible 3D Human-Scene Interaction and Contact from a Single Imagecited by 13
  33. 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimationcited by 9
  34. 2026OnlineHMR: Video-based Online World-Grounded Human Mesh Recoverycited by 4

Built on by

Not cited yet.