mlsanityData to 7 Oct 2026

GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstruction

arXiv 2604.20784 ↗First posted 22 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reconstructing dynamic 3D scenes from sparse multi-view videos is highly ill-posed, often leading to geometric collapse, trajectory drift, and floating artifacts. Recent attempts introduce generative priors to hallucinate missing content, yet naive integration frequently causes structural drift and temporal inconsistency due to the mismatch between stochastic 2D generation and deterministic 3D geometry. In this paper, we propose GeoRect4D, a novel unified framework for sparse-view dynamic reconstruction that couples explicit 3D consistency with generative refinement via a closed-loop optimization process. Specifically, GeoRect4D introduces a degradation-aware feedback mechanism that incorporates a robust anchor-based dynamic 3DGS substrate with a single-step diffusion rectifier to hallucinate high-fidelity details. This rectifier utilizes a structural locking mechanism and spatiotemporal coordinated attention, effectively preserving physical plausibility while restoring missing content. Furthermore, we present a progressive optimization strategy that employs stochastic geometric purification to eliminate floaters and generative distillation to infuse texture details into the explicit representation. Extensive experiments demonstrate that GeoRect4D achieves state-of-the-art performance in reconstruction fidelity, perceptual quality, and spatiotemporal consistency across multiple datasets. Project Page: https://mediax-sjtu.github.io/GeoRect4D

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 70 of its 78 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

70 of 78 references.

References · 70

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  6. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  7. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  8. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  9. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  10. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  11. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  12. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
38 more
  1. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  2. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  3. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  4. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  5. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
  6. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  7. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  8. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  9. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  10. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  11. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  12. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  13. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  14. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  15. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  16. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
  17. 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
  18. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
  19. 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
  20. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  21. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  22. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  23. 2023Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesiscited by 232
  24. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  25. 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 215
  26. 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
  27. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
  28. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
  29. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
  30. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  31. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
  32. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
  33. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
  34. 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 120
  35. 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
  36. 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
  37. 2024StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time Renderingcited by 107
  38. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106

50 most cited of 70 All 70 (JSON)

Built on by

Not cited yet.