SplatGuide: Geometric Priors from 3D Gaussians for Pose-Free Novel View Synthesis
Not on the map. Why?
Abstract (arXiv)
Generating photorealistic novel views from unposed images requires both 3D geometric understanding and the ability to synthesize unseen content. A natural strategy combines feed-forward 3DGS reconstruction with multi-view diffusion. Yet prior pipelines extract at most one signal from the reconstruction, either pixel rendering or learned features, while none exploits per-Gaussian visibility for occlusion-aware reference selection. This *information disconnect* leaves renderable geometry, visibility cues, and learned features unused. SplatGuide closes this disconnect by reusing a single 3DGS scene across three complementary roles. Rendered images provide pixel-aligned geometric conditioning. Per-Gaussian source-view indices are rendered into a target-view voting map for occlusion-aware reference selection. Reconstruction tokens supply feature-level guidance via cross-attention. All three signals derive from the same reconstruction forward pass. Across RealEstate10K, DL3DV, Tanks-and-Temples, and Mip-NeRF 360, SplatGuide achieves state-of-the-art pose-free novel view synthesis. On RealEstate10K, with a moderate number of input views, it surpasses the ground-truth-pose baseline.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 46 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
41 of 46 references.
References · 41
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023Vision Transformers Need Registerscited by 871
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
29 more
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
- 2025History-Guided Video Diffusioncited by 171
- 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 143
- 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 130
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
- 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 114
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
- 2021Geometry-Free View Synthesis: Transformers and no 3D Priorscited by 100
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 96
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 77
- 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
- 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Modelscited by 76
- 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 67
- 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 40
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priorscited by 38
- 2024MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Modelcited by 32
- 2025SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observationscited by 16
- 2025Fillerbuster: Unified Generative Scene Completion Model for Casual Capturescited by 2
Built on by
Not cited yet.