StructSplat: Generalizable 3D Gaussian Splatting from Uncalibrated Sparse Views
Not on the map. Why?
Abstract (arXiv)
We present StructSplat, a feed-forward and generalizable 3D Gaussian reconstruction framework that operates directly on uncalibrated images without requiring camera parameters. Existing methods either rely on per-scene optimization or assume known camera poses, and often entangle geometry and appearance within a unified backbone, limiting reconstruction fidelity and generalization. Our key idea is to adopt a structured representation that organizes geometry, semantic, and texture cues with explicit roles in the reconstruction process. Specifically, we introduce a pixel-aligned feature injection mechanism to enable accurate texture modeling from 2D observations, incorporate semantic-aware priors to improve global consistency, and design a camera alignment strategy to prevent information leakage and improve generalization. Experiments show that our method significantly outperforms prior approaches on challenging benchmarks. On DL3DV, our method achieves 28.045 PSNR, surpassing AnySplat (22.377) by +5.67 dB. In cross-dataset evaluation, our method achieves +1.94 dB over AnySplat on ACID and +1.72 dB on RealEstate10K. Project page: https://structsplat.github.io Code: https://github.com/J-C-Zhao/StructSplat
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 54 of its 61 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
54 of 61 references.
References · 54
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2025DINOv3cited by 1,297
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
38 more
- 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 694
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
- 2021ZeRO-Offload: Democratizing Billion-Scale Model Trainingcited by 339
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2021ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learningcited by 253
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
- 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 239
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2019A Study of BFLOAT16 for Deep Learning Trainingcited by 227
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2024Global Structure-from-Motion Revisitedcited by 215
- 2024Mini-Splatting: Representing Scenes with a Constrained Number of Gaussianscited by 208
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2022Generalizable Patch-Based Neural Renderingcited by 121
- 2020Epipolar Transformerscited by 117
- 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 111
- 2024MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereocited by 86
- 2022DFNet: Enhance Absolute Pose Regression with Direct Feature Matchingcited by 82
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 74
- 2024SelfSplat: Pose-Free and 3D Prior-Free Generalizable 3D Gaussian Splattingcited by 40
- 2023Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairscited by 37
- 2025Uni3R: Unified 3D Reconstruction and Semantic Understanding via Generalizable Gaussian Splatting from Unposed Multi-View Imagescited by 25
- 2023FrozenRecon: Pose-free 3D Scene Reconstruction with Frozen Depth Modelscited by 17
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.