How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Survey
Not on the map. Why?
Abstract (arXiv)
Over the past two decades, research in the field of Simultaneous Localization and Mapping (SLAM) has undergone a significant evolution, highlighting its critical role in enabling autonomous exploration of unknown environments. This evolution ranges from hand-crafted methods, through the era of deep learning, to more recent developments focused on Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS) representations. Recognizing the growing body of research and the absence of a comprehensive survey on the topic, this paper aims to provide the first comprehensive overview of SLAM progress through the lens of the latest advancements in radiance fields. It sheds light on the background, evolutionary path, inherent strengths and limitations, and serves as a fundamental reference to highlight the dynamic progress and specific challenges.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). Builds on 129 of its 222 references that are in the map. First posted on arXiv 20 Feb 2024.
Builds on
129 of 222 references.
References · 129
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017Mask R-CNNcited by 7,259
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
38 more
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2020Convolutional Occupancy Networkscited by 760
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2020Implicit Geometric Regularization for Learning Shapescited by 707
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
- 2023Gaussian Splatting SLAMcited by 410
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
- 2021Advances in Neural Renderingcited by 365
50 most cited of 129 All 129 (JSON)
Built on by
Citing papers per year: 2024: 26; 2025: 29; 2026: 17.
72 papers.
Sort:
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 64
- 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAMcited by 36
- 2025On-the-fly Reconstruction for Large-Scale Novel View Synthesis from Unposed Imagescited by 35
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
- 2024MG-SLAM: Structure Gaussian Splatting SLAM with Manhattan World Hypothesiscited by 22
- 2024Neural Fields in Robotics: A Surveycited by 21
- 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
38 more
- 2024NEDS-SLAM: A Neural Explicit Dense Semantic SLAM Framework using 3D Gaussian Splattingcited by 16
- 2024DROID-Splat: Combining end-to-end SLAM with 3D Gaussian Splattingcited by 15
- 2025GigaSLAM: Large-Scale Monocular SLAM with Hierarchical Gaussian Splatscited by 14
- 2026Faster-GS: Analyzing and Improving Gaussian Splatting Optimizationcited by 13
- 2024MAGiC-SLAM: Multi-Agent Gaussian Globally Consistent SLAMcited by 12
- 2024Open-Vocabulary Online Semantic Mapping for SLAMcited by 11
- 2025Ov3R: Open-Vocabulary Semantic 3D Reconstruction from RGB Videoscited by 10
- 2024LiHi-GS: LiDAR-Supervised Gaussian Splatting for Highway Driving Scene Reconstructioncited by 8
- 2025ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videoscited by 8
- 2025UniPR-3D: Towards Universal Visual Place Recognition with Visual Geometry Grounded Transformercited by 8
- 2024CaRtGS: Computational Alignment for Real-Time Gaussian Splatting SLAMcited by 7
- 2024DVN-SLAM: Dynamic Visual Neural SLAM Based on Local-Global Encodingcited by 6
- 2025HS-SLAM: Hybrid Representation with Structural Supervision for Improved Dense SLAMcited by 6
- 2025DINO-SLAM: DINO-informed RGB-D SLAM for Neural Implicit and Explicit Representationscited by 6
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Predictioncited by 6
- 2025Understanding while Exploring: Semantics-driven Active Mappingcited by 5
- 2024Frequency-based View Selection in Gaussian Splatting Reconstructioncited by 4
- 2024ROVER: A Multi-Season Dataset for Visual SLAMcited by 4
- 2024NFL-BA: Near-Field Light Bundle Adjustment for SLAM in Dynamic Lightingcited by 4
- 2025Splat-LOAM: Gaussian Splatting LiDAR Odometry and Mappingcited by 4
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Fieldcited by 4
- 2025Dy3DGS-SLAM: Monocular 3D Gaussian Splatting SLAM for Dynamic Environmentscited by 4
- 2024Marrying NeRF with Feature Matching for One-step Pose Estimationcited by 3
- 2024RenderBender: A Survey on Adversarial Attacks Using Differentiable Renderingcited by 3
- 2025LRSLAM: Low-rank Representation of Signed Distance Fields in Dense Visual SLAM Systemcited by 3
- 2025LEGO-SLAM: Language-Embedded Gaussian Optimization SLAMcited by 3
- 2025Deblur Gaussian Splatting SLAMcited by 2
- 2025GI-SLAM: Gaussian-Inertial SLAMcited by 2
- 2026Intellectual Property Protection for 3D Gaussian Splatting Assets: A Surveycited by 2
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directionscited by 2
- 2024Look Ma, No Ground Truth! Ground-Truth-Free Tuning of Structure from Motion and Visual SLAMcited by 1
- 2024Editing Implicit and Explicit Representations of Radiance Fields: A Surveycited by 1
- 2025SLAM&Render: A Benchmark for the Intersection Between Neural Rendering, Gaussian Splatting and SLAMcited by 1
- 2025CAD-SLAM: Consistency-Aware Dynamic SLAM with Dynamic-Static Decoupled Mappingcited by 1
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representationscited by 1
- 2026NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splattingcited by 1
- 2024UDGS-SLAM : UniDepth Assisted Gaussian Splatting for Monocular SLAMcited by 0
- 2024DeformStream: Deformation-based Adaptive Volumetric Video Streamingcited by 0
50 most cited of 72 All 72 (JSON)
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera26 Sep 2026
- 2026From Splats to Silicon: Rethinking Computational Efficiency of 3DGS5 Sep 2026
- 2026Stipple: Real-Time Incremental Gaussian Splatting with Visual-Inertial Tracking2 Aug 2026
- 2026Visual Relocalization from Sparse Views in Aliased and Low-Texture Environments via Novel View Synthesis24 Jul 2026
- 2026MAGiSt3R: Multi-Agent Feed-forward 3D Reconstruction from Monocular RGB Videos16 Jul 2026
- 2026VCS-SLAM: Geometry-Validated Semantic Evidence Fusion for 3D Gaussian SLAM28 Jun 2026
- 2026PAGaS: Pixel-Aligned 1DoF Gaussian Splatting for Depth Refinement24 Apr 2026
- 2026A Survey of Spatial Memory Representations for Efficient Robot Navigation13 Apr 2026
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Prediction3 Apr 2026
- 2026Semantic Segmentation and Depth Estimation for Real-Time Lunar Surface Mapping Using 3D Gaussian Splatting18 Mar 2026
- 2026PhyGaP: Physically-Grounded Gaussians with Polarization Cues14 Mar 2026
38 more
- 2026NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splatting19 Feb 2026
- 2026LatentAM: Real-Time, Large-Scale Latent Gaussian Attention Mapping via Online Dictionary Learning12 Feb 2026
- 2026Faster-GS: Analyzing and Improving Gaussian Splatting Optimization10 Feb 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2026Intellectual Property Protection for 3D Gaussian Splatting Assets: A Survey2 Feb 2026
- 2025UniPR-3D: Towards Universal Visual Place Recognition with Visual Geometry Grounded Transformer24 Dec 2025
- 2025ACE-SLAM: Scene Coordinate Regression for Neural Implicit Real-Time SLAM16 Dec 2025
- 2025Deep Learning Perspective of Scene Understanding in Autonomous Robots16 Dec 2025
- 2025SLIM-VDB: A Real-Time 3D Probabilistic Semantic Mapping Framework15 Dec 2025
- 2025YOPO-Nav: Visual Navigation using 3DGS Graphs from One-Pass Videos10 Dec 2025
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Models3 Dec 2025
- 2025BINDER: Instantly Adaptive Mobile Manipulation with Open-Vocabulary Commands27 Nov 2025
- 2025LEGO-SLAM: Language-Embedded Gaussian Optimization SLAM20 Nov 2025
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representations28 Sep 2025
- 2025Enhanced Velocity Field Modeling for Gaussian Video Reconstruction31 Jul 2025
- 2025Ov3R: Open-Vocabulary Semantic 3D Reconstruction from RGB Videos29 Jul 2025
- 2025DINO-SLAM: DINO-informed RGB-D SLAM for Neural Implicit and Explicit Representations25 Jul 2025
- 2025LRSLAM: Low-rank Representation of Signed Distance Fields in Dense Visual SLAM System12 Jun 2025
- 2025Dy3DGS-SLAM: Monocular 3D Gaussian Splatting SLAM for Dynamic Environments6 Jun 2025
- 2025On-the-fly Reconstruction for Large-Scale Novel View Synthesis from Unposed Images5 Jun 2025
- 2025Understanding while Exploring: Semantics-driven Active Mapping30 May 2025
- 2025CAD-SLAM: Consistency-Aware Dynamic SLAM with Dynamic-Static Decoupled Mapping26 May 2025
- 2025Exploiting Radiance Fields for Grasp Generation on Novel Synthetic Views16 May 2025
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Field15 May 2025
- 2025ToF-Splatting: Dense SLAM using Sparse Time-of-Flight Depth and Multi-Frame Integration23 Apr 2025
- 2025SLAM&Render: A Benchmark for the Intersection Between Neural Rendering, Gaussian Splatting and SLAM18 Apr 2025
- 2025ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videos17 Apr 2025
- 2025HS-SLAM: Hybrid Representation with Structural Supervision for Improved Dense SLAM27 Mar 2025
- 2025GI-SLAM: Gaussian-Inertial SLAM24 Mar 2025
- 2025Splat-LOAM: Gaussian Splatting LiDAR Odometry and Mapping21 Mar 2025
- 2025Deblur Gaussian Splatting SLAM16 Mar 2025
- 2025GigaSLAM: Large-Scale Monocular SLAM with Hierarchical Gaussian Splats11 Mar 2025
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstruction3 Mar 2025
- 2025Abstract Rendering: Computing All that is Seen in Gaussian Splat Scenes1 Mar 2025
- 2024Editing Implicit and Explicit Representations of Radiance Fields: A Survey23 Dec 2024
- 2024LiHi-GS: LiDAR-Supervised Gaussian Splatting for Highway Driving Scene Reconstruction19 Dec 2024
- 2024NFL-BA: Near-Field Light Bundle Adjustment for SLAM in Dynamic Lighting17 Dec 2024
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videos12 Dec 2024
50 newest of 72 All 72 (JSON)
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 64
- 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAMcited by 36
- 2025On-the-fly Reconstruction for Large-Scale Novel View Synthesis from Unposed Imagescited by 35
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
- 2024MG-SLAM: Structure Gaussian Splatting SLAM with Manhattan World Hypothesiscited by 22
- 2024Neural Fields in Robotics: A Surveycited by 21
- 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
12 most cited of 72 All 72 (JSON)
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera26 Sep 2026
- 2026From Splats to Silicon: Rethinking Computational Efficiency of 3DGS5 Sep 2026
- 2026Stipple: Real-Time Incremental Gaussian Splatting with Visual-Inertial Tracking2 Aug 2026
- 2026Visual Relocalization from Sparse Views in Aliased and Low-Texture Environments via Novel View Synthesis24 Jul 2026
- 2026MAGiSt3R: Multi-Agent Feed-forward 3D Reconstruction from Monocular RGB Videos16 Jul 2026
- 2026VCS-SLAM: Geometry-Validated Semantic Evidence Fusion for 3D Gaussian SLAM28 Jun 2026
- 2026PAGaS: Pixel-Aligned 1DoF Gaussian Splatting for Depth Refinement24 Apr 2026
- 2026A Survey of Spatial Memory Representations for Efficient Robot Navigation13 Apr 2026
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Prediction3 Apr 2026
- 2026Semantic Segmentation and Depth Estimation for Real-Time Lunar Surface Mapping Using 3D Gaussian Splatting18 Mar 2026
- 2026PhyGaP: Physically-Grounded Gaussians with Polarization Cues14 Mar 2026
12 newest of 72 All 72 (JSON)