Multimodal-Prior-Guided Importance Sampling for Hierarchical Gaussian Splatting in Sparse-View Novel View Synthesis
Not on the map. Why?
Abstract (arXiv)
We present multimodal-prior-guided importance sampling as the central mechanism for hierarchical 3D Gaussian Splatting (3DGS) in sparse-view novel view synthesis. Our sampler fuses complementary cues { -- } photometric rendering residuals, semantic priors, and geometric priors { -- } to produce a robust, local recoverability estimate that directly drives where to inject fine Gaussians. Built around this sampling core, our framework comprises (1) a coarse-to-fine Gaussian representation that encodes global shape with a stable coarse layer and selectively adds fine primitives where the multimodal metric indicates recoverable detail; and (2) a geometric-aware sampling and retention policy that concentrates refinement on geometrically critical and complex regions while protecting newly added primitives in underconstrained areas from premature pruning. By prioritizing regions supported by consistent multimodal evidence rather than raw residuals alone, our method alleviates overfitting texture-induced errors and suppresses noise from pose/appearance inconsistencies. Experiments on diverse sparse-view benchmarks demonstrate state-of-the-art reconstructions, with up to +0.3 dB PSNR on DTU.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 19 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
15 of 19 references.
References · 15
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
3 more
Built on by
Not cited yet.