Advances in Inference and Representation for Simultaneous Localization and Mapping
Not on the map. Why?
Abstract (arXiv)
Simultaneous localization and mapping (SLAM) is the process of constructing a global model of an environment from local observations of it; this is a foundational capability for mobile robots, supporting such core functions as planning, navigation, and control. This article reviews recent progress in SLAM, focusing on advances in the expressive capacity of the environmental models used in SLAM systems (representation) and the performance of the algorithms used to estimate these models from data (inference). A prominent theme of recent SLAM research is the pursuit of environmental representations (including learned representations) that go beyond the classical attributes of geometry and appearance to model properties such as hierarchical organization, affordance, dynamics, and semantics; these advances equip autonomous agents with a more comprehensive understanding of the world, enabling more versatile and intelligent operation. A second major theme is a revitalized interest in the mathematical properties of the SLAM estimation problem itself (including its computational and information-theoretic performance limits); this work has led to the development of novel classes of certifiable and robust inference methods that dramatically improve the reliability of SLAM systems in real-world operation. We survey these advances with an emphasis on their ramifications for achieving robust, long-duration autonomy, and conclude with a discussion of open challenges and a perspective on future research directions.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 55 of its 148 references that are in the map. First posted on arXiv 8 Mar 2021.
Builds on
55 of 148 references.
References · 55
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2019Event-based Vision: A Surveycited by 1,010
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2016Direct Sparse Odometrycited by 479
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
- 2020TEASER: Fast and Certifiable Point Cloud Registrationcited by 274
- 2020Neural Topological SLAM for Visual Navigationcited by 193
- 2019Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mappingcited by 181
- 20203D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humanscited by 141
38 more
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
- 2018DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenescited by 130
- 2020DeepFactors: Real-Time Probabilistic Dense Monocular SLAMcited by 117
- 2018The Limits and Potentials of Deep Learning for Roboticscited by 104
- 2018Learning to Navigate in Cities Without a Mapcited by 103
- 2019Graduated Non-Convexity for Robust Spatial Perception: From Non-Minimal Solvers to Global Outlier Rejectioncited by 92
- 2016SE-Sync: A Certifiably Correct Algorithm for Synchronization over the Special Euclidean Groupcited by 80
- 2016Interactive Perception: Leveraging Action in Perception and Perception in Actioncited by 77
- 2020NodeSLAM: Neural Object Descriptors for Multi-View Shape Reconstructioncited by 61
- 2018LDSO: Direct Sparse Odometry with Loop Closurecited by 50
- 2020Learning Physical Graph Representations from Visual Scenescited by 50
- 2020Shonan Rotation Averaging: Global Optimality by Surfing SO(p)ncited by 46
- 2020VDO-SLAM: A Visual Dynamic Object-aware SLAM Systemcited by 39
- 2017Toward Geometric Deep SLAMcited by 38
- 2019SceneCode: Monocular Dense Semantic Reconstruction using Learned Encoded Scene Representationscited by 37
- 2018FutureMapping: The Computational Structure of Spatial AI Systemscited by 35
- 2019Visual-Inertial Navigation: A Concise Reviewcited by 28
- 2019gradSLAM: Automagically differentiable SLAMcited by 27
- 2020Dynamic SLAM: The Need For Speedcited by 24
- 2014Tightness of the maximum likelihood semidefinite relaxation for angular synchronizationcited by 23
- 2020One Ring to Rule Them All: Certifiably Robust Geometric Perception with Outlierscited by 19
- 2015Lagrangian Duality in 3D SLAM: Verification Techniques and Optimal Solutionscited by 18
- 2020Semantic Linking Maps for Active Visual Object Searchcited by 18
- 2019Distributed Certifiably Correct Pose-Graph Optimizationcited by 17
- 2019In Perfect Shape: Certifiably Optimal 3D Shape Reconstruction from 2D Landmarkscited by 17
- 2019A Survey of Recent Scalability Improvements for Semidefinite Programming with Applications in Machine Learning, Control, and Roboticscited by 16
- 2019Probabilistic Data Association via Mixture Models for Robust Semantic SLAMcited by 16
- 2019FutureMapping 2: Gaussian Belief Propagation for Spatial AIcited by 16
- 2015A note on Probably Certifiably Correct algorithmscited by 9
- 2015Information-based Active SLAM via Topological Feature Graphscited by 8
- 2020Multiple Hypothesis Semantic Mapping for Robust Data Associationcited by 8
- 2018Certifiably Globally Optimal Extrinsic Calibration from Per-Sensor Egomotioncited by 6
- 2018Self-Improving Visual Odometrycited by 6
- 2018Guaranteed Globally Optimal Planar Pose Graph and Landmark SLAM via Sparse-Bounded Sums-of-Squares Programmingcited by 5
- 2015Monocular SLAM Supported Object Recognitioncited by 4
- 2017Towards Visual Ego-motion Learning in Robotscited by 4
- 2018The Geometry of SDP-Exactness in Quadratic Optimizationcited by 3
- 2018Accelerated Inference in Markov Random Fields via Smooth Riemannian Optimizationcited by 3
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 3; 2024: 1; 2025: 3; 2026: 3.
16 papers.
Sort:
- 2022Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fieldscited by 58
- 2026Advances in Global Solvers for 3D Visioncited by 12
- 2024Open-Vocabulary Online Semantic Mapping for SLAMcited by 11
- 2025Towards Initialization-free Calibrated Bundle Adjustmentcited by 4
- 20263D Scene Graphs: Open Challenges and Future Directionscited by 4
- 2022Discrete-Continuous Smoothing and Mappingcited by 3
- 2022Accelerating Certifiable Estimation with Preconditioned Eigensolverscited by 3
- 2023Decentralization and Acceleration Enables Large-Scale Bundle Adjustmentcited by 3
- 2025Certifiably Optimal Anisotropic Rotation Averagingcited by 2
- 2021Incremental Non-Gaussian Inference for SLAM Using Normalizing Flowscited by 1
- 2022Streaming Inference for Infinite Non-Stationary Clusteringcited by 1
- 2022A Review of Scene Representations for Robot Manipulatorscited by 0
4 more
- 20263D Scene Graphs: Open Challenges and Future Directions15 Jun 2026
- 2026Certifiable Factor Graph Optimization1 Mar 2026
- 2026Advances in Global Solvers for 3D Vision16 Feb 2026
- 2025Deep Learning Perspective of Scene Understanding in Autonomous Robots16 Dec 2025
- 2025Towards Initialization-free Calibrated Bundle Adjustment30 Jun 2025
- 2025Certifiably Optimal Anisotropic Rotation Averaging10 Mar 2025
- 2024Open-Vocabulary Online Semantic Mapping for SLAM22 Nov 2024
- 2023Multi-Irreducible Spectral Synchronization for Robust Rotation Averaging28 Nov 2023
- 2023Ray-Patch: An Efficient Querying for Light Field Transformers16 May 2023
- 2023Decentralization and Acceleration Enables Large-Scale Bundle Adjustment11 May 2023
- 2022A Review of Scene Representations for Robot Manipulators22 Dec 2022
- 2022Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fields19 Sep 2022
4 more
- 2022Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fieldscited by 58
- 2026Advances in Global Solvers for 3D Visioncited by 12
- 2024Open-Vocabulary Online Semantic Mapping for SLAMcited by 11
- 2025Towards Initialization-free Calibrated Bundle Adjustmentcited by 4
- 20263D Scene Graphs: Open Challenges and Future Directionscited by 4
- 2022Discrete-Continuous Smoothing and Mappingcited by 3
- 2022Accelerating Certifiable Estimation with Preconditioned Eigensolverscited by 3
- 2023Decentralization and Acceleration Enables Large-Scale Bundle Adjustmentcited by 3
- 2025Certifiably Optimal Anisotropic Rotation Averagingcited by 2
- 2021Incremental Non-Gaussian Inference for SLAM Using Normalizing Flowscited by 1
- 2022Streaming Inference for Infinite Non-Stationary Clusteringcited by 1
- 2022A Review of Scene Representations for Robot Manipulatorscited by 0
12 most cited of 16 All 16 (JSON)
- 20263D Scene Graphs: Open Challenges and Future Directions15 Jun 2026
- 2026Certifiable Factor Graph Optimization1 Mar 2026
- 2026Advances in Global Solvers for 3D Vision16 Feb 2026
- 2025Deep Learning Perspective of Scene Understanding in Autonomous Robots16 Dec 2025
- 2025Towards Initialization-free Calibrated Bundle Adjustment30 Jun 2025
- 2025Certifiably Optimal Anisotropic Rotation Averaging10 Mar 2025
- 2024Open-Vocabulary Online Semantic Mapping for SLAM22 Nov 2024
- 2023Multi-Irreducible Spectral Synchronization for Robust Rotation Averaging28 Nov 2023
- 2023Ray-Patch: An Efficient Querying for Light Field Transformers16 May 2023
- 2023Decentralization and Acceleration Enables Large-Scale Bundle Adjustment11 May 2023
- 2022A Review of Scene Representations for Robot Manipulators22 Dec 2022
- 2022Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fields19 Sep 2022
12 newest of 16 All 16 (JSON)