4D Human-Scene Reconstruction from Low-Overlap Captures
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Existing volumetric capture of dynamic human performance achieves high fidelity with dense camera arrays. However, in real-world scenarios, only a handful of low-overlap cameras are available, which degrades the output quality and leaves large areas unobserved. Recent 4D reconstruction methods have focused on low-overlap settings, yet they still produce noticeable artifacts in under-observed regions. Video diffusion models have emerged as another option, but they show geometrically inconsistent results for humans. To address these limitations, we propose StudioRecon, a pipeline that reconstructs 4D human scenes from sparse, low-overlap cameras by decoupling background and humans. We densify background supervision by synthesizing hundreds of camera-controlled novel views with a video diffusion model. We also robustly initialize deformable Gaussian humans with cross-view identity association and triangulated multi-view keypoint fitting. Finally, our recursive enhancement module with motion-adaptive consistency injection harmonizes the composed output, thereby further avoiding remaining artifacts. We achieve state-of-the-art novel view synthesis across four real-world datasets and demonstrate applications such as novel trajectory rendering and human replacement.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 39 of its 59 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
39 of 59 references.
Closest ancestors · 3
Same direction, newest first
- 2025Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models17 Jul
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models3 Mar
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction24 May
Other references · 36
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
24 more
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
- 20234K4D: Real-Time 4D View Synthesis at 4K Resolutioncited by 91
- 2024Expressive Whole-Body 3D Gaussian Avatarcited by 89
- 2020Understanding SSIMcited by 75
- 2025DropGaussian: Structural Regularization for Sparse-view Gaussian Splattingcited by 65
- 2024Human4DiT: 360-degree Human Video Generation with 4D Diffusion Transformercited by 61
- 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
- 2024Representing Long Volumetric Video with Temporal Gaussian Hierarchycited by 58
- 2025FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstructioncited by 53
- 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Modelscited by 33
- 2024Harmony4D: A Video Dataset for In-The-Wild Close Human Interactionscited by 31
- 2025How I Warped Your Noise: a Temporally-Correlated Noise Prior for Diffusion Modelscited by 31
- 2023MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generationcited by 26
- 2024Warped Diffusion: Solving Video Inverse Problems with Image Diffusion Modelscited by 21
- 2025CoMotion: Concurrent Multi-person 3D Motioncited by 13
- 2024ToMiE: Towards Explicit Exoskeleton for the Reconstruction of Complicated 3D Human Avatarscited by 10
- 2025ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videoscited by 8
- 2025Kineo: Calibration-Free Metric Motion Capture From Sparse RGB Camerascited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 20264DAnyone: Create Anyone in 4D from a Casual Monocular Video
- 2026Flex4DHuman: Flexible Multi-view Video Diffusion for 4D Human Reconstruction
- 2024Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpses
- 2026TROPHIES: Temporal Reconstruction of Places, Humans, and Cameras from Multi-view Videos
- 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models
- 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priors
- 2025BulletTime: Decoupled Control of Time and Camera Pose for Video Generation
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models