mlsanityData to 14 Oct 2026

SplatGuide: Geometric Priors from 3D Gaussians for Pose-Free Novel View Synthesis

arXiv 2608.16863 ↗First posted 17 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating photorealistic novel views from unposed images requires both 3D geometric understanding and the ability to synthesize unseen content. A natural strategy combines feed-forward 3DGS reconstruction with multi-view diffusion. Yet prior pipelines extract at most one signal from the reconstruction, either pixel rendering or learned features, while none exploits per-Gaussian visibility for occlusion-aware reference selection. This *information disconnect* leaves renderable geometry, visibility cues, and learned features unused. SplatGuide closes this disconnect by reusing a single 3DGS scene across three complementary roles. Rendered images provide pixel-aligned geometric conditioning. Per-Gaussian source-view indices are rendered into a target-view voting map for occlusion-aware reference selection. Reconstruction tokens supply feature-level guidance via cross-attention. All three signals derive from the same reconstruction forward pass. Across RealEstate10K, DL3DV, Tanks-and-Temples, and Mip-NeRF 360, SplatGuide achieves state-of-the-art pose-free novel view synthesis. On RealEstate10K, with a moderate number of input views, it surpasses the ground-truth-pose baseline.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 46 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

41 of 46 references.

References · 41

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2022Classifier-Free Diffusion Guidancecited by 5,847
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  6. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  7. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  8. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  9. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  10. 2023Vision Transformers Need Registerscited by 871
  11. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  12. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
29 more
  1. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
  2. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  3. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
  4. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
  5. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
  6. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
  7. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
  8. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  9. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
  10. 2025History-Guided Video Diffusioncited by 171
  11. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
  12. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
  13. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  14. 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 143
  15. 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 130
  16. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
  17. 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 114
  18. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
  19. 2021Geometry-Free View Synthesis: Transformers and no 3D Priorscited by 100
  20. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 96
  21. 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 77
  22. 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
  23. 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Modelscited by 76
  24. 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 67
  25. 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 40
  26. 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priorscited by 38
  27. 2024MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Modelcited by 32
  28. 2025SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observationscited by 16
  29. 2025Fillerbuster: Unified Generative Scene Completion Model for Casual Capturescited by 2

Built on by

Not cited yet.