GAPS: Generative Active Pseudo-view Selection for Sparse-View 3D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Novel view synthesis from sparse observations is severely under-constrained. Although 3D Gaussian Splatting (3DGS) enables real-time rendering, it produces floaters, broken geometry, and washed-out backgrounds when trained with few views. We propose an alternating optimization framework that uses a pre-trained image diffusion model to generate geometrically consistent pseudo-views for additional 3DGS supervision. Generation is constrained by depth-conditioned ControlNet, IP-Adapter style transfer, LoRA scene adaptation, and img2img structural anchoring. We introduce Generative Active Pseudo-view Selection (GAPS) to balance reconstruction informativeness and generative reliability when choosing target views. Its annealing schedule shifts from conservative interpolation early in training to exploratory extrapolation later, gradually covering unobserved regions. A dual-criterion admission gate and uncertainty-weighted losses reject unreliable generations, while density-adaptive DropGaussian reduces overfitting in complex scenes. On LLFF with 3/6/9 views, our method improves average PSNR over vanilla 3DGS by 0.40/0.89/0.70 dB. On Mip-NeRF 360 with 12/24 views, the gains are 1.18/0.80 dB. SSIM improves and LPIPS decreases in every setting. Ablations show that active selection and density-adaptive regularization are both necessary; only the full method reduces LPIPS below the no-pseudo-view baseline on unbounded 360-degree scenes.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 20 Sep 2026.
Builds on
19 of 33 references.
References · 19
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2024Depth Anything V2cited by 1,422
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 311
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 121
7 more
- 2025DropGaussian: Structural Regularization for Sparse-view Gaussian Splattingcited by 65
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2024Gaussian Scenes: Pose-Free Sparse-View Scene Reconstruction using Depth-Enhanced Diffusion Priorscited by 8
- 2025OracleGS: Grounding Generative Priors for Sparse-View Gaussian Splattingcited by 5
- 2026Predictive Photometric Uncertainty in Gaussian Splatting for Novel View Synthesiscited by 5
- 2024Frequency-based View Selection in Gaussian Splatting Reconstructioncited by 4
- 2025Uncertainty-Aware Diffusion Guided Refinement of 3D Scenescited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors
- 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
- 2025ProSplat: Improved Feed-Forward 3D Gaussian Splatting for Wide-Baseline Sparse Views
- 2025Breaking the Vicious Cycle: Coherent 3D Gaussian Splatting from Sparse and Motion-Blurred Views
- 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillation
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
- 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputs
- 2024FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage Training