UniCon3R: Unified Contact-aware 4D Human-Scene Reconstruction from Monocular Video
Not on the map. Why?
Abstract (arXiv)
We introduce UniCon3R, a unified feed-forward framework for online human-scene 4D reconstruction from monocular video. Current feed-forward human-scene reconstruction methods suffer from artifacts, where bodies float above the ground or penetrate parts of the scene. A key reason is the lack of effective interaction modelling between the human and the environment. Our goal is to exploit contact between the human and the scene during inference to actively improve the human mesh reconstruction. To that end, we explicitly model interaction by inferring 4D contact from the human pose and scene geometry and use the contact as a corrective cue for generating the pose. This enables UniCon3R to jointly recover scene geometry and spatially aligned 4D humans within the scene. Experiments on standard human-centric video benchmarks show that UniCon3R outperforms state-of-the-art baselines on physical plausibility and global human motion estimation while preserving fast, feed-forward inference speeds. The results validate our central claim: contact serves as a powerful internal prior, thus establishing a new paradigm for physically grounded joint human-scene reconstruction. Project page is available at https://surtantheta.github.io/UniCon3R .
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 51 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
46 of 51 references.
References · 46
- 2017Mask R-CNNcited by 7,259
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2022Visual Prompt Tuningcited by 1,674
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 844
- 2019Are Sixteen Heads Really Better than One?cited by 803
- 2020Quantifying Attention Flow in Transformerscited by 759
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
34 more
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 229
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2021Putting People in their Place: Monocular Regression of 3D People in Depthcited by 141
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
- 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
- 20233D Human Pose Estimation via Intuitive Physicscited by 100
- 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
- 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
- 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representationcited by 93
- 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environmentscited by 89
- 2024CameraHMR: Aligning People with Perspectivecited by 64
- 2020Holistic 3D Human and Scene Mesh Estimation from Single View Imagescited by 54
- 2023DECO: Dense Estimation of 3D Human-Scene Contact In The Wildcited by 54
- 2023SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environmentscited by 47
- 2023ReFit: Recurrent Fitting Network for 3D Human Recoverycited by 47
- 2025Human3R: Everyone Everywhere All at Oncecited by 35
- 2023PACE: Human and Camera Motion Estimation from in-the-wild Videoscited by 33
- 2021Contact-Aware Retargeting of Skinned Motioncited by 31
- 2024Reconstructing People, Places, and Camerascited by 31
- 2025SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimationcited by 31
- 2022The One Where They Reconstructed 3D Humans and Environments in TV Showscited by 30
- 2025Joint Optimization for 4D Human-Scene Reconstruction in the Wildcited by 29
- 2025PICO: Reconstructing 3D People In Contact with Objectscited by 22
- 2025InteractVLM: 3D Interaction Reasoning from 2D Foundational Modelscited by 21
- 2024HUMOS: Human Motion Model Conditioned on Body Shapecited by 20
- 2024Synergistic Global-space Camera and Human Reconstruction from Videoscited by 17
- 2024COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimationcited by 15
- 2025HAMSt3R: Human-Aware Multi-view Stereo 3D Reconstructioncited by 15
- 2025PhySIC: Physically Plausible 3D Human-Scene Interaction and Contact from a Single Imagecited by 13
- 2024SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimationcited by 9
- 2026OnlineHMR: Video-based Online World-Grounded Human Mesh Recoverycited by 4
Built on by
Not cited yet.