SPFSplatV2: Efficient Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views
Not on the map. Why?
Abstract (arXiv)
We introduce SPFSplatV2, an efficient feed-forward framework for 3D Gaussian splatting from sparse multi-view images, requiring no ground-truth poses during training or inference. The framework employs a shared feature extraction backbone to jointly predict 3D Gaussian primitives and camera poses in a canonical space from unposed inputs. To enable efficient and accurate pose estimation, we introduce a masked attention mechanism for target-view pose prediction and a reprojection loss that enforces pixel-aligned Gaussian primitives, providing stronger geometric constraints. We further demonstrate the compatibility of our training framework with different reconstruction architectures, resulting in two model variants. Remarkably, despite the absence of pose supervision, our method achieves state-of-the-art performance in both in-domain and out-of-domain novel view synthesis, even under extreme viewpoint changes and limited image overlap. It also surpasses many methods that rely on geometric supervision in relative pose estimation. By eliminating dependence on ground-truth poses, our method offers the scalability to leverage larger and more diverse datasets. Code and pretrained models will be available on our project page: https://ranrhuang.github.io/spfsplatv2/.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 65 of its 80 references that are in the map. First posted on arXiv 21 Sep 2025.
Builds on
65 of 80 references.
References · 65
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
38 more
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2023RoMa: Robust Dense Feature Matchingcited by 302
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 243
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 227
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 178
- 2018BA-Net: Dense Bundle Adjustment Networkcited by 175
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 160
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 147
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 141
- 2020ASLFeat: Learning Local Features of Accurate Shape and Localizationcited by 130
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 115
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026ViewSplat: View-Adaptive 3D Gaussian Splatting for Feed-Forward Synthesiscited by 2
- 2026From None to All: Self-Supervised 3D Reconstruction via Novel View Synthesiscited by 2
- 2026AESplat: Advancing Pose-Free Feed-Forward 3D Gaussian Splatting via Decoupled Appearance Modelingcited by 1
- 2026AA-Splat: Anti-Aliased Feed-forward Gaussian Splattingcited by 0
- 2026RayDer: Scalable Self-Supervised Novel View Synthesis from Real-World Videocited by 0
- 2026RDGSplat: Render-Dedicated Geometry for Novel View Synthesiscited by 0
- 2026RDGSplat: Render-Dedicated Geometry for Novel View Synthesis6 Oct 2026
- 2026AESplat: Advancing Pose-Free Feed-Forward 3D Gaussian Splatting via Decoupled Appearance Modeling29 Sep 2026
- 2026RayDer: Scalable Self-Supervised Novel View Synthesis from Real-World Video29 May 2026
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective15 Apr 2026
- 2026AA-Splat: Anti-Aliased Feed-forward Gaussian Splatting31 Mar 2026
- 2026From None to All: Self-Supervised 3D Reconstruction via Novel View Synthesis29 Mar 2026
- 2026ViewSplat: View-Adaptive 3D Gaussian Splatting for Feed-Forward Synthesis26 Mar 2026