mlsanityData to 7 Oct 2026

FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstruction

arXiv 2412.09573 ↗First posted 12 Dec 2024cs.CVcited by 40

Not on the map. Why?

Abstract (arXiv)

Sparse-view reconstruction models typically require precise camera poses, yet obtaining these parameters from sparse-view images remains challenging. We introduce FreeSplatter, a scalable feed-forward framework that generates high-quality 3D Gaussians from uncalibrated sparse-view images while estimating camera parameters within seconds. Our approach employs a streamlined transformer architecture where self-attention blocks facilitate information exchange among multi-view image tokens, decoding them into pixel-aligned 3D Gaussian primitives within a unified reference frame. This representation enables both high-fidelity 3D modeling and efficient camera parameter estimation using off-the-shelf solvers. We develop two specialized variants--for object-centric and scene-level reconstruction--trained on comprehensive datasets. Remarkably, FreeSplatter outperforms several pose-dependent Large Reconstruction Models (LRMs) by a notable margin while achieving comparable or even better pose estimation accuracy compared to state-of-the-art pose-free reconstruction approach MASt3R in challenging benchmarks. Beyond technical benchmarks, FreeSplatter streamlines text/image-to-3D content creation pipelines, eliminating the complexity of camera pose management while delivering exceptional visual fidelity.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 58 of its 79 references that are in the map. First posted on arXiv 12 Dec 2024.

Builds on

58 of 79 references.

References · 58

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  5. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  6. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  7. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  8. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  9. 2017Mixed Precision Trainingcited by 1,135
  10. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  11. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  12. 2016Training Deep Nets with Sublinear Memory Costcited by 825
38 more
  1. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  2. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  3. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  4. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  5. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  6. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  7. 2023LightGlue: Local Feature Matching at Light Speedcited by 583
  8. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  9. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  10. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
  11. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  12. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  13. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
  14. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
  15. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
  16. 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 324
  17. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  18. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  19. 2023RoMa: Robust Dense Feature Matchingcited by 296
  20. 20243D Reconstruction with Spatial Memorycited by 269
  21. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
  22. 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
  23. 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
  24. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
  25. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 213
  26. 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 174
  27. 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
  28. 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
  29. 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 146
  30. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
  31. 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
  32. 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
  33. 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
  34. 2023EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimationcited by 79
  35. 2019DeepSFM: Structure From Motion Via Deep Bundle Adjustmentcited by 70
  36. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  37. 2023LEAP: Liberate Sparse-view 3D Modeling from Camera Posescited by 65
  38. 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 18; 2026: 22.

40 papers.

Sort:

By area:

  1. 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 76
  2. 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 30
  3. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
  4. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  5. 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometrycited by 17
  6. 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 16
  7. 2025CUPID: Generative 3D Reconstruction via Joint Object and Pose Modelingcited by 8
  8. 2025ActiveInitSplat: How Active Image Selection Helps Gaussian Splattingcited by 7
  9. 2025PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstructioncited by 7
  10. 2025Unposed 3DGS Reconstruction with Probabilistic Procrustes Mappingcited by 6
  11. 2025GENA3D: Generative Amodal 3D Modeling by Bridging 2D Priors and 3D Coherencecited by 4
  12. 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
28 more
  1. 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challengescited by 3
  2. 2025UFV-Splatter: Pose-Free Feed-Forward 3D Gaussian Splatting Adapted to Unfavorable Viewscited by 3
  3. 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimationcited by 3
  4. 2026SatSurfGS: Generalizable 2D Gaussian Splatting for Sparse-View Satellite Surface Reconstructioncited by 3
  5. 2026Meshy T2: Fast Native Mesh Generation with Flow Matchingcited by 3
  6. 2026RnG: A Unified Transformer for Complete 3D Modeling from Partial Observationscited by 2
  7. 2025Learning Fine-Grained Geometry for Sparse-View Splatting via Cascade Depth Losscited by 1
  8. 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Imagescited by 1
  9. 2025DeblurSplat: SfM-free 3D Gaussian Splatting with Event Camera for Robust Deblurringcited by 1
  10. 2025OnlineSplatter: Pose-Free Online 3D Reconstruction for Free-Moving Objectscited by 1
  11. 2026TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstructioncited by 1
  12. 2026MeshWeaver: Sparse-Voxel-Guided Surface Weaving for Autoregressive Mesh Generationcited by 1
  13. 2026MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstructioncited by 1
  14. 2026QuerySplat: Decoupling Geometry and Appearance Representations in 3DGS Predictioncited by 1
  15. 2026ASV3D: Adapting Diffusion-Based Single-View 3D Reconstruction with Extra Imagerycited by 1
  16. 2026ResemBrick: Brick Reconstruction from Photographs with Perceptual Fidelity and Buildabilitycited by 1
  17. 2025FSFSplatter: Build Surface and Novel Views with Sparse-Views within 2mincited by 0
  18. 2026WildSplatter: Feed-forward 3D Gaussian Splatting with Appearance Control from Unconstrained Imagescited by 0
  19. 2026VG2GT: Voxel-Gaussian Splatting Visual Geometry Grounded Transformercited by 0
  20. 2026AsySplat: Efficient Asymmetric 3D Gaussian Splatting for Long-Sequence Scene Modelingcited by 0
  21. 2026OPERA: Object Perception Enhances Single-view 3D Reconstructioncited by 0
  22. 2026Gaussian Volumetric Representation for Efficient Shear-Warp Visualizationcited by 0
  23. 2026GSPotential: Camera Potential Field for Sparse-View 3D Gaussian Splattingcited by 0
  24. 2026Adapting Vision Foundation Models to Acoustics for Pose-Free 3D Sonar Reconstructioncited by 0
  25. 2026Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinementcited by 0
  26. 2026GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splattingcited by 0
  27. 2026OC-GS: Gaussian Splatting for Irregular Turntable Capturecited by 0
  28. 2026LVSPM: Long Sequence View Synthesis and Pose Estimation Modelcited by 0