One-Shot Refiner: Boosting Feed-forward Novel View Synthesis via One-Step Diffusion
Not on the map. Why?
Abstract (arXiv)
We present a novel framework for high-fidelity novel view synthesis (NVS) from sparse images, addressing key limitations in recent feed-forward 3D Gaussian Splatting (3DGS) methods built on Vision Transformer (ViT) backbones. While ViT-based pipelines offer strong geometric priors, they are often constrained by low-resolution inputs due to computational costs. Moreover, existing generative enhancement methods tend to be 3D-agnostic, resulting in inconsistent structures across views, especially in unseen regions. To overcome these challenges, we design a Dual-Domain Detail Perception Module, which enables handling high-resolution images without being limited by the ViT backbone, and endows Gaussians with additional features to store high-frequency details. We develop a feature-guided diffusion network, which can preserve high-frequency details during the restoration process. We introduce a unified training strategy that enables joint optimization of the ViT-based geometric backbone and the diffusion-based refinement module. Experiments demonstrate that our method can maintain superior generation quality across multiple datasets.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
24 of 38 references.
References · 24
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 280
12 more
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 139
- 2023DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion Modelscited by 127
- 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
- 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
- 2021Ensembling Off-the-shelf Models for GAN Trainingcited by 84
- 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
- 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Realitycited by 42
- 2025PanoGS: Gaussian-based Panoptic Segmentation for 3D Open Vocabulary Scene Understandingcited by 16
- 2024MaRINeR: Enhancing Novel Views by Matching Rendered Images with Nearby Referencescited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026OnlinePG: Online Open-Vocabulary Panoptic Mapping with 3D Gaussian Splattingcited by 2
- 2026ChopGrad: Pixel-Wise Losses for Latent Video Diffusion via Truncated Backpropagationcited by 1
- 2026GenSplatCodec: Feed-Forward Gaussian Splatting Compression via One-Step Diffusioncited by 1
- 2026TUDSR: Twice Upsampling-Diffusion for Higher Super-Resolutioncited by 0
- 2026GenSplatCodec: Feed-Forward Gaussian Splatting Compression via One-Step Diffusion27 Jul 2026
- 2026TUDSR: Twice Upsampling-Diffusion for Higher Super-Resolution8 Jun 2026
- 2026OnlinePG: Online Open-Vocabulary Panoptic Mapping with 3D Gaussian Splatting19 Mar 2026
- 2026ChopGrad: Pixel-Wise Losses for Latent Video Diffusion via Truncated Backpropagation18 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors
- 2025ProSplat: Improved Feed-Forward 3D Gaussian Splatting for Wide-Baseline Sparse Views
- 2026VidSplat: Gaussian Splatting Reconstruction with Geometry-Guided Video Diffusion Priors
- 2025High-Fidelity Novel View Synthesis via Splatting-Guided Diffusion
- 2026VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
- 2026BetterScene: 3D Scene Synthesis with Representation-Aligned Generative Model
- 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors