Feed-Forward Multi-view Multi-person Reconstruction with Contrastive Human-Aware 3D Representation
Not on the map. Why?
Abstract (arXiv)
Multi-view human reconstruction has been extensively studied under simplified settings, yet robust and efficient multi-person reconstruction in unconstrained environments remains challenging. Existing bottom-up methods often rely on accurate camera calibration and explicit cross-view matching, and therefore struggle with severe occlusions and ambiguities. We propose a new top-down paradigm that maintains a unified, instance-centric human-aware 3D space, enabling simultaneous camera calibration, cross-view association, and human reconstruction via cross-modal contrastive learning. Observations from multiple views are lifted and fused into this shared 3D space, where geometric structure, visual appearance, and human-centric semantic cues are jointly encoded at the instance level. We further introduce a spatial contrastive learning strategy that aligns 3D features corresponding to the same human instance across different views and modalities while separating different instances. This enables correspondence reasoning, semantic aggregation, and instance discrimination to be performed natively in 3D, improving cross-view consistency and robustness under severe occlusions. Finally, structured human body models are recovered in a feed-forward manner by regressing SMPL parameters from instance-level 3D human tokens. Extensive experiments demonstrate robust, accurate, and efficient multi-view human reconstruction in challenging real-world scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 44 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
29 of 44 references.
References · 29
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2025DINOv3cited by 1,297
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2020Monocular, One-stage, Regression of Multiple 3D Peoplecited by 216
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
17 more
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 69
- 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
- 2025Light3R-SfM: Towards Feed-forward Structure-from-Motioncited by 47
- 2021VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wildcited by 39
- 2025Human3R: Everyone Everywhere All at Oncecited by 35
- 2024Reconstructing People, Places, and Camerascited by 31
- 2025Joint Optimization for 4D Human-Scene Reconstruction in the Wildcited by 29
- 2024Synergistic Global-space Camera and Human Reconstruction from Videoscited by 17
- 2022Occluded Human Body Capture with Self-Supervised Spatial-Temporal Motion Priorcited by 15
- 2025HAMSt3R: Human-Aware Multi-view Stereo 3D Reconstructioncited by 15
- 2025Regist3R: Incremental Registration with Stereo Foundation Modelcited by 9
- 2025MV-SSM: Multi-View State Space Modeling for 3D Human Pose Estimationcited by 9
- 2024Multi-Person 3D Pose Estimation from Multi-View Uncalibrated Depth Camerascited by 6
- 2025Mono3R: Exploiting Monocular Cues for Geometric 3D Reconstructioncited by 5
- 2025Kineo: Calibration-Free Metric Motion Capture From Sparse RGB Camerascited by 4
- 2024Simultaneously Recovering Multi-Person Meshes and Multi-View Cameras with Human Semanticscited by 3
Built on by
Not cited yet.