FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstruction
Not on the map. Why?
Abstract (arXiv)
Sparse-view reconstruction models typically require precise camera poses, yet obtaining these parameters from sparse-view images remains challenging. We introduce FreeSplatter, a scalable feed-forward framework that generates high-quality 3D Gaussians from uncalibrated sparse-view images while estimating camera parameters within seconds. Our approach employs a streamlined transformer architecture where self-attention blocks facilitate information exchange among multi-view image tokens, decoding them into pixel-aligned 3D Gaussian primitives within a unified reference frame. This representation enables both high-fidelity 3D modeling and efficient camera parameter estimation using off-the-shelf solvers. We develop two specialized variants--for object-centric and scene-level reconstruction--trained on comprehensive datasets. Remarkably, FreeSplatter outperforms several pose-dependent Large Reconstruction Models (LRMs) by a notable margin while achieving comparable or even better pose estimation accuracy compared to state-of-the-art pose-free reconstruction approach MASt3R in challenging benchmarks. Beyond technical benchmarks, FreeSplatter streamlines text/image-to-3D content creation pipelines, eliminating the complexity of camera pose management while delivering exceptional visual fidelity.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 58 of its 79 references that are in the map. First posted on arXiv 12 Dec 2024.
Builds on
58 of 79 references.
References · 58
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2017Mixed Precision Trainingcited by 1,135
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2016Training Deep Nets with Sublinear Memory Costcited by 825
38 more
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
- 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 324
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
- 2023RoMa: Robust Dense Feature Matchingcited by 296
- 20243D Reconstruction with Spatial Memorycited by 269
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
- 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
- 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 213
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 174
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 146
- 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
- 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
- 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
- 2023EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimationcited by 79
- 2019DeepSFM: Structure From Motion Via Deep Bundle Adjustmentcited by 70
- 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
- 2023LEAP: Liberate Sparse-view 3D Modeling from Camera Posescited by 65
- 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2025: 18; 2026: 22.
40 papers.
Sort:
By area:
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 76
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 30
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometrycited by 17
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 16
- 2025CUPID: Generative 3D Reconstruction via Joint Object and Pose Modelingcited by 8
- 2025ActiveInitSplat: How Active Image Selection Helps Gaussian Splattingcited by 7
- 2025PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstructioncited by 7
- 2025Unposed 3DGS Reconstruction with Probabilistic Procrustes Mappingcited by 6
- 2025GENA3D: Generative Amodal 3D Modeling by Bridging 2D Priors and 3D Coherencecited by 4
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
28 more
- 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challengescited by 3
- 2025UFV-Splatter: Pose-Free Feed-Forward 3D Gaussian Splatting Adapted to Unfavorable Viewscited by 3
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimationcited by 3
- 2026SatSurfGS: Generalizable 2D Gaussian Splatting for Sparse-View Satellite Surface Reconstructioncited by 3
- 2026Meshy T2: Fast Native Mesh Generation with Flow Matchingcited by 3
- 2026RnG: A Unified Transformer for Complete 3D Modeling from Partial Observationscited by 2
- 2025Learning Fine-Grained Geometry for Sparse-View Splatting via Cascade Depth Losscited by 1
- 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Imagescited by 1
- 2025DeblurSplat: SfM-free 3D Gaussian Splatting with Event Camera for Robust Deblurringcited by 1
- 2025OnlineSplatter: Pose-Free Online 3D Reconstruction for Free-Moving Objectscited by 1
- 2026TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstructioncited by 1
- 2026MeshWeaver: Sparse-Voxel-Guided Surface Weaving for Autoregressive Mesh Generationcited by 1
- 2026MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstructioncited by 1
- 2026QuerySplat: Decoupling Geometry and Appearance Representations in 3DGS Predictioncited by 1
- 2026ASV3D: Adapting Diffusion-Based Single-View 3D Reconstruction with Extra Imagerycited by 1
- 2026ResemBrick: Brick Reconstruction from Photographs with Perceptual Fidelity and Buildabilitycited by 1
- 2025FSFSplatter: Build Surface and Novel Views with Sparse-Views within 2mincited by 0
- 2026WildSplatter: Feed-forward 3D Gaussian Splatting with Appearance Control from Unconstrained Imagescited by 0
- 2026VG2GT: Voxel-Gaussian Splatting Visual Geometry Grounded Transformercited by 0
- 2026AsySplat: Efficient Asymmetric 3D Gaussian Splatting for Long-Sequence Scene Modelingcited by 0
- 2026OPERA: Object Perception Enhances Single-view 3D Reconstructioncited by 0
- 2026Gaussian Volumetric Representation for Efficient Shear-Warp Visualizationcited by 0
- 2026GSPotential: Camera Potential Field for Sparse-View 3D Gaussian Splattingcited by 0
- 2026Adapting Vision Foundation Models to Acoustics for Pose-Free 3D Sonar Reconstructioncited by 0
- 2026Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinementcited by 0
- 2026GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splattingcited by 0
- 2026OC-GS: Gaussian Splatting for Irregular Turntable Capturecited by 0
- 2026LVSPM: Long Sequence View Synthesis and Pose Estimation Modelcited by 0
- 2026LVSPM: Long Sequence View Synthesis and Pose Estimation Model7 Oct 2026
- 2026OC-GS: Gaussian Splatting for Irregular Turntable Capture25 Sep 2026
- 2026GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splatting19 Sep 2026
- 2026Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinement15 Sep 2026
- 2026Adapting Vision Foundation Models to Acoustics for Pose-Free 3D Sonar Reconstruction5 Sep 2026
- 2026GSPotential: Camera Potential Field for Sparse-View 3D Gaussian Splatting29 Aug 2026
- 2026ResemBrick: Brick Reconstruction from Photographs with Perceptual Fidelity and Buildability10 Aug 2026
- 2026ASV3D: Adapting Diffusion-Based Single-View 3D Reconstruction with Extra Imagery8 Aug 2026
- 2026QuerySplat: Decoupling Geometry and Appearance Representations in 3DGS Prediction2 Aug 2026
- 2026Meshy T2: Fast Native Mesh Generation with Flow Matching28 Jul 2026
- 2026Gaussian Volumetric Representation for Efficient Shear-Warp Visualization28 Jul 2026
- 2026OPERA: Object Perception Enhances Single-view 3D Reconstruction21 Jul 2026
28 more
- 2026AsySplat: Efficient Asymmetric 3D Gaussian Splatting for Long-Sequence Scene Modeling13 Jul 2026
- 2026MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstruction12 Jul 2026
- 2026MeshWeaver: Sparse-Voxel-Guided Surface Weaving for Autoregressive Mesh Generation3 Jun 2026
- 2026VG2GT: Voxel-Gaussian Splatting Visual Geometry Grounded Transformer1 Jun 2026
- 2026TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction25 May 2026
- 2026SatSurfGS: Generalizable 2D Gaussian Splatting for Sparse-View Satellite Surface Reconstruction8 May 2026
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation5 May 2026
- 2026WildSplatter: Feed-forward 3D Gaussian Splatting with Appearance Control from Unconstrained Images23 Apr 2026
- 2026RnG: A Unified Transformer for Complete 3D Modeling from Partial Observations1 Mar 2026
- 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometry13 Feb 2026
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstruction31 Dec 2025
- 2025GENA3D: Generative Amodal 3D Modeling by Bridging 2D Priors and 3D Coherence26 Nov 2025
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend25 Nov 2025
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generation27 Oct 2025
- 2025CUPID: Generative 3D Reconstruction via Joint Object and Pose Modeling23 Oct 2025
- 2025OnlineSplatter: Pose-Free Online 3D Reconstruction for Free-Moving Objects23 Oct 2025
- 2025FSFSplatter: Build Surface and Novel Views with Sparse-Views within 2min3 Oct 2025
- 2025DeblurSplat: SfM-free 3D Gaussian Splatting with Event Camera for Robust Deblurring23 Sep 2025
- 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Images4 Sep 2025
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformer14 Aug 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025UFV-Splatter: Pose-Free Feed-Forward 3D Gaussian Splatting Adapted to Unfavorable Views30 Jul 2025
- 2025PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstruction29 Jul 2025
- 2025Unposed 3DGS Reconstruction with Probabilistic Procrustes Mapping24 Jul 2025
- 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challenges22 Jul 2025
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey19 Jul 2025
- 2025Learning Fine-Grained Geometry for Sparse-View Splatting via Cascade Depth Loss28 May 2025
- 2025ActiveInitSplat: How Active Image Selection Helps Gaussian Splatting10 Mar 2025
- 2026Meshy T2: Fast Native Mesh Generation with Flow Matchingcited by 3
- 2026Meshy T2: Fast Native Mesh Generation with Flow Matching28 Jul 2026
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 76
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 30
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometrycited by 17
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 16
- 2025CUPID: Generative 3D Reconstruction via Joint Object and Pose Modelingcited by 8
- 2025ActiveInitSplat: How Active Image Selection Helps Gaussian Splattingcited by 7
- 2025PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstructioncited by 7
- 2025Unposed 3DGS Reconstruction with Probabilistic Procrustes Mappingcited by 6
- 2025GENA3D: Generative Amodal 3D Modeling by Bridging 2D Priors and 3D Coherencecited by 4
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
12 most cited of 39 All 39 (JSON)
- 2026LVSPM: Long Sequence View Synthesis and Pose Estimation Model7 Oct 2026
- 2026OC-GS: Gaussian Splatting for Irregular Turntable Capture25 Sep 2026
- 2026GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splatting19 Sep 2026
- 2026Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinement15 Sep 2026
- 2026Adapting Vision Foundation Models to Acoustics for Pose-Free 3D Sonar Reconstruction5 Sep 2026
- 2026GSPotential: Camera Potential Field for Sparse-View 3D Gaussian Splatting29 Aug 2026
- 2026ResemBrick: Brick Reconstruction from Photographs with Perceptual Fidelity and Buildability10 Aug 2026
- 2026ASV3D: Adapting Diffusion-Based Single-View 3D Reconstruction with Extra Imagery8 Aug 2026
- 2026QuerySplat: Decoupling Geometry and Appearance Representations in 3DGS Prediction2 Aug 2026
- 2026Gaussian Volumetric Representation for Efficient Shear-Warp Visualization28 Jul 2026
- 2026OPERA: Object Perception Enhances Single-view 3D Reconstruction21 Jul 2026
- 2026AsySplat: Efficient Asymmetric 3D Gaussian Splatting for Long-Sequence Scene Modeling13 Jul 2026
12 newest of 39 All 39 (JSON)