Gaussian Splatting SLAM
Not on the map. Why?
Abstract (arXiv)
We present the first application of 3D Gaussian Splatting in monocular SLAM, the most fundamental but the hardest setup for Visual SLAM. Our method, which runs live at 3fps, utilises Gaussians as the only 3D representation, unifying the required representation for accurate, efficient tracking, mapping, and high-quality rendering. Designed for challenging monocular settings, our approach is seamlessly extendable to RGB-D SLAM when an external depth sensor is available. Several innovations are required to continuously reconstruct 3D scenes with high fidelity from a live camera. First, to move beyond the original 3DGS algorithm, which requires accurate poses from an offline Structure from Motion (SfM) system, we formulate camera tracking for 3DGS using direct optimisation against the 3D Gaussians, and show that this enables fast and robust tracking with a wide basin of convergence. Second, by utilising the explicit nature of the Gaussians, we introduce geometric verification and regularisation to handle the ambiguities occurring in incremental 3D dense reconstruction. Finally, we introduce a full SLAM system which not only achieves state-of-the-art results in novel view synthesis and trajectory estimation but also reconstruction of tiny and even transparent objects.
Key facts. Cited by 410 papers in the map (data through 13 Oct 2026). Builds on 34 of its 51 references that are in the map. First posted on arXiv 11 Dec 2023.
Builds on
34 of 51 references.
References · 34
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,712
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,610
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,150
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 984
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 962
- 2020Neural Sparse Voxel Fieldscited by 959
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 895
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 866
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 839
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 803
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 735
22 more
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 676
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 588
- 2016Direct Sparse Odometrycited by 480
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 474
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 163
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
- 2018A micro Lie theory for state estimation in roboticscited by 120
- 2020DeepFactors: Real-Time Probabilistic Dense Monocular SLAMcited by 117
- 2020DI-Fusion: Online Implicit 3D Reconstruction with Deep Priorscited by 70
- 2019A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensorscited by 44
- 2022Approximate Differentiable Rendering with Algebraic Surfacescited by 44
- 2023Dense RGB SLAM with Neural Implicit Mapscited by 42
- 2018SurfelMeshing: Online Surfel-Based Mesh Reconstructioncited by 29
- 2022VoGE: A Differentiable Volume Renderer using Gaussian Ellipsoids for Analysis-by-Synthesiscited by 22
- 2023Learning a Depth Covariance Functioncited by 16
- 2014A Framework for the Volumetric Integration of Depth Imagescited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 124; 2025: 166; 2026: 119.
410 papers.
Sort:
By area:
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 283
- 20243D Reconstruction with Spatial Memorycited by 271
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 243
- 2024A Survey on 3D Gaussian Splattingcited by 222
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 200
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 132
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 2024Revising Densification in Gaussian Splattingcited by 128
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 112
- 20243D Gaussian as a New Era: A Surveycited by 103
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 101
38 more
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
- 2024SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAMcited by 86
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2024Large Spatial Model: End-to-end Unposed Images to Semantic 3Dcited by 73
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2024MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenescited by 71
- 2024RGBD GS-ICP SLAMcited by 65
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 64
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62
- 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descentcited by 61
- 2024LoopSplat: Loop Closure by Registering 3D Gaussian Splatscited by 59
- 2024Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesiscited by 57
- 2024RoboGSim: A Real2Sim2Real Robotic Gaussian Splatting Simulatorcited by 51
- 2024GaussNav: Gaussian Splatting for Visual Navigationcited by 49
- 2025WildGS-SLAM: Monocular Gaussian Splatting SLAM in Dynamic Environmentscited by 48
- 2024EgoLifter: Open-world 3D Segmentation for Egocentric Perceptioncited by 47
- 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 46
- 2024SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAMcited by 41
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 41
- 2024On the Error Analysis of 3D Gaussian Splatting and an Optimal Projection Strategycited by 39
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAMcited by 36
- 2024R+X: Retrieval and Execution from Everyday Human Videoscited by 36
- 2024HDR-GS: Efficient High Dynamic Range Novel View Synthesis at 1000x Speed via Gaussian Splattingcited by 35
- 2024ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splattingcited by 32
- 2024DynaMem: Online Dynamic Spatio-Semantic Memory for Open World Mobile Manipulationcited by 32
- 2024Baking Gaussian Splatting into Diffusion Denoiser for Fast and Scalable Single-stage Image-to-3D Generation and Reconstructioncited by 32
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
- 2024GS-Hider: Hiding Messages into 3D Gaussian Splattingcited by 26
- 2024NerfBaselines: Consistent and Reproducible Evaluation of Novel View Synthesis Methodscited by 25
- 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priorscited by 25
- 2024Compact 3D Gaussian Splatting For Dense Visual SLAMcited by 24
- 2024HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstructioncited by 24
- 2025Lifting by Gaussians: A Simple, Fast and Flexible Method for 3D Instance Segmentationcited by 23
- 2024MM3DGS SLAM: Multi-modal 3D Gaussian Splatting for SLAM Using Vision, Depth, and Inertial Measurementscited by 22
- 2024Event3DGS: Event-Based 3D Gaussian Splatting for High-Speed Robot Egomotioncited by 22
- 2024Beyond Gaussians: Fast and High-Fidelity 3D Splatting with Linear Kernelscited by 22
- 2024OmniGS: Fast Radiance Field Reconstruction using Omnidirectional Gaussian Splattingcited by 21
- 2024Neural Fields in Robotics: A Surveycited by 21
50 most cited of 410 All 410 (JSON)
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Images30 Sep 2026
- 2026DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients29 Sep 2026
- 2026AGILE-GS: Anchor-Guided Fast Next-Best-View Selection for Active 3D Gaussian Splatting28 Sep 2026
- 2026LiTe-GS: Oracle-Efficient Next Best View Selection for 3D Gaussian Splatting24 Sep 2026
- 2026PlenoCI: Plenoptic CharacterIstics for View Dependence Aware Change Classification24 Sep 2026
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering18 Sep 2026
- 2026Cube-Splat: High-Fidelity 360deg Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimization18 Sep 2026
- 2026EliGSiR: Continual RGB-D Mapping with Gaussian Splatting under Bounded Compute17 Sep 2026
- 2026VGGT-GS SLAM: Uncalibrated Monocular Gaussian Splatting SLAM with Feed-Forward Priors17 Sep 2026
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend17 Sep 2026
- 2026RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objects16 Sep 2026
38 more
- 2026PanoGS-SLAM: Panoramic 3D Gaussian Splatting SLAM15 Sep 2026
- 2026SCOUT-SLAM: Structurally-Coupled Dual Uncertainty-Aware 3DGS SLAM in the Wild13 Sep 2026
- 2026Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Exploration8 Sep 2026
- 2026LightSplat: Real-Time High-Fidelity 3D Gaussian SLAM with Loop Closure7 Sep 2026
- 2026Laplacian Frequency Hierarchies for Efficient 3D Gaussian Splatting Training3 Sep 2026
- 2026Failure or Drift? Evaluating Monocular SLAM under Synthetic and Real-World Corruptions31 Aug 2026
- 2026CapFrame: Text-Instructed Viewpoint Grounding in 3D Gaussian Scenes via Geometric Pseudo Labels31 Aug 2026
- 2026RoSe-SLAM: Robust Semantic-Aware Gaussian Splatting SLAM from Dynamic Monocular Videos29 Aug 2026
- 2026CGS-SLAM: Collaborative Gaussian Splatting based SLAM for Multi-Agent Reconstruction27 Aug 2026
- 2026Gating Before Commitment: Anticipating Intent Divergence to Prevent Post-Interaction Decision Failures in Autonomous Driving26 Aug 2026
- 20264DGS-WAM: Bridging Past and Future with an Object-Centric World Action Model based on 4D Gaussian Splatting26 Aug 2026
- 2026AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstruction24 Aug 2026
- 2026MotionGS-SLAM: Event-Modulated Gaussian Splatting for Motion-Blur Robust SLAM15 Aug 2026
- 2026GS-CPE: Unified 6-Degree-of-Freedom Camera Pose Estimation via 3D Gaussian Splatting11 Aug 2026
- 2026Visual Geometry Foundation-Aware Gaussians for Single-Frame Surround-View Driving Reconstruction11 Aug 2026
- 2026EndoMD-SLAM: Endoscopic Gaussian Splatting SLAM under Optical Degradation with Memory and Static-Transient Decomposition9 Aug 2026
- 2026EvTrajGS: Accurate and Efficient 3D Gaussian Splatting from Unposed Event Streams9 Aug 2026
- 2026SLAMFormer-∞: Infinite SLAM Transformer for Unbounded Frontend and Backend Processing4 Aug 2026
- 2026CHOW-SLAM: Compact Hybrid Representation with Complementary Overlap Window Optimization for RGB-D SLAM3 Aug 2026
- 2026UniSim-SLAM: Feed-Forward SLAM with Unified Sim(3) Optimization3 Aug 2026
- 2026Stipple: Real-Time Incremental Gaussian Splatting with Visual-Inertial Tracking2 Aug 2026
- 2026MonoVoc: Decoupling Geometry and Semantics for Lightweight Monocular Open-Vocabulary 3D Gaussians30 Jul 2026
- 2026Quasi-SVD: Learning a Lie-constrained matrix factorisation for real-time imaging28 Jul 2026
- 2026A Review Of Robotic World Models For Dynamic Environments Based On Factor And Scene Graphs27 Jul 2026
- 2026NSL-SLAM: High-Fidelity Neural Structured-Light Depth for Practical SLAM and Reconstruction27 Jul 2026
- 2026Visual Relocalization from Sparse Views in Aliased and Low-Texture Environments via Novel View Synthesis24 Jul 2026
- 2026GLAM-SLAM: Real-time Gaussian Large-scale Mapping via Flow Densification and Spatial Decomposition23 Jul 2026
- 2026Splat-based 3D Scene Reconstruction with Extreme Motion-blur18 Jul 2026
- 2026Rendering 3D Gaussians on a Graph Processor17 Jul 2026
- 2026ImprovedVBGS: Real-time Continual Variational Bayes Gaussian Splatting17 Jul 2026
- 2026MAGiSt3R: Multi-Agent Feed-forward 3D Reconstruction from Monocular RGB Videos16 Jul 2026
- 2026VistaVLA: Geometry- and Semantic-Aware 3D Gaussian-Grounded VLA for Robotic Manipulation14 Jul 2026
- 2026MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstruction12 Jul 2026
- 2026Incremental Online Scene Reconstruction by 3D Gaussian Triangulation12 Jul 2026
- 2026Why does Deep Learning Improve Visual SLAM?7 Jul 2026
- 2026Real-Time LiDAR Gaussian Splatting SLAM5 Jul 2026
- 2026AugSplat: Radiance Field-Informed Gaussian Splatting for Sparse-View Settings30 Jun 2026
- 2026Learning Video Dynamics with Predictive Differentiable Rendering30 Jun 2026
50 newest of 410 All 410 (JSON)
- 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 46
- 2024Baking Gaussian Splatting into Diffusion Denoiser for Fast and Scalable Single-stage Image-to-3D Generation and Reconstructioncited by 32
- 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priorscited by 25
- 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillationcited by 21
- 2025GSFix3D: Diffusion-Guided Repair of Novel Views in Gaussian Splattingcited by 17
- 2025LangScene-X: Reconstruct Generalizable 3D Language-Embedded Scenes with TriMap Video Diffusioncited by 6
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splattingcited by 3
- 2026FreeFix: Boosting 3D Gaussian Splatting via Fine-Tuning-Free Diffusion Modelscited by 2
- 2025Enhancing Monocular 3D Scene Completion with Diffusion Modelcited by 0
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splatting3 Mar 2026
- 2026FreeFix: Boosting 3D Gaussian Splatting via Fine-Tuning-Free Diffusion Models28 Jan 2026
- 2025GSFix3D: Diffusion-Guided Repair of Novel Views in Gaussian Splatting20 Aug 2025
- 2025LangScene-X: Reconstruct Generalizable 3D Language-Embedded Scenes with TriMap Video Diffusion3 Jul 2025
- 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidance13 May 2025
- 2025Enhancing Monocular 3D Scene Completion with Diffusion Model2 Mar 2025
- 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation27 Nov 2024
- 2024Baking Gaussian Splatting into Diffusion Denoiser for Fast and Scalable Single-stage Image-to-3D Generation and Reconstruction21 Nov 2024
- 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priors5 Sep 2024
- 2024MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenescited by 71
- 20264DGS-WAM: Bridging Past and Future with an Object-Centric World Action Model based on 4D Gaussian Splattingcited by 1
- 2026F3DGS: Federated 3D Gaussian Splatting for Decentralized Multi-Agent World Modelingcited by 0
- 2026Genie 4D: Semantic-Prior-Guided 4D Dynamic Scene Reconstructioncited by 0
- 2026Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Explorationcited by 0
- 2026Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Exploration8 Sep 2026
- 20264DGS-WAM: Bridging Past and Future with an Object-Centric World Action Model based on 4D Gaussian Splatting26 Aug 2026
- 2026Genie 4D: Semantic-Prior-Guided 4D Dynamic Scene Reconstruction10 Apr 2026
- 2026F3DGS: Federated 3D Gaussian Splatting for Decentralized Multi-Agent World Modeling2 Apr 2026
- 2024MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenes23 May 2024
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 283
- 20243D Reconstruction with Spatial Memorycited by 271
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 243
- 2024A Survey on 3D Gaussian Splattingcited by 222
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 200
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 132
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 2024Revising Densification in Gaussian Splattingcited by 128
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 112
- 20243D Gaussian as a New Era: A Surveycited by 103
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 101
12 most cited of 390 All 390 (JSON)
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Images30 Sep 2026
- 2026DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients29 Sep 2026
- 2026AGILE-GS: Anchor-Guided Fast Next-Best-View Selection for Active 3D Gaussian Splatting28 Sep 2026
- 2026LiTe-GS: Oracle-Efficient Next Best View Selection for 3D Gaussian Splatting24 Sep 2026
- 2026PlenoCI: Plenoptic CharacterIstics for View Dependence Aware Change Classification24 Sep 2026
- 2026Cube-Splat: High-Fidelity 360deg Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimization18 Sep 2026
- 2026EliGSiR: Continual RGB-D Mapping with Gaussian Splatting under Bounded Compute17 Sep 2026
- 2026VGGT-GS SLAM: Uncalibrated Monocular Gaussian Splatting SLAM with Feed-Forward Priors17 Sep 2026
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend17 Sep 2026
- 2026RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objects16 Sep 2026
- 2026PanoGS-SLAM: Panoramic 3D Gaussian Splatting SLAM15 Sep 2026
12 newest of 390 All 390 (JSON)