DeepFactors: Real-Time Probabilistic Dense Monocular SLAM
Not on the map. Why?
Abstract (arXiv)
The ability to estimate rich geometry and camera motion from monocular imagery is fundamental to future interactive robotics and augmented reality applications. Different approaches have been proposed that vary in scene geometry representation (sparse landmarks, dense maps), the consistency metric used for optimising the multi-view problem, and the use of learned priors. We present a SLAM system that unifies these methods in a probabilistic framework while still maintaining real-time performance. This is achieved through the use of a learned compact depth map representation and reformulating three different types of errors: photometric, reprojection and geometric, which we make use of within standard factor graph software. We evaluate our system on trajectory estimation and depth reconstruction on real-world sequences and present various examples of estimated dense geometry.
Key facts. Cited by 117 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 13; 2023: 18; 2024: 24; 2025: 23; 2026: 21.
117 papers.
Sort:
By area:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2023Gaussian Splatting SLAMcited by 415
- 2021Neural RGB-D Surface Reconstructioncited by 313
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
- 2022Deep Patch Visual Odometrycited by 190
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 164
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 141
38 more
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 136
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 133
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 102
- 2021Endo-Depth-and-Motion: Reconstruction and Tracking in Endoscopic Videos using Depth Networks and Photometric Constraintscited by 81
- 2024Deep Patch Visual SLAMcited by 71
- 2022Theseus: A Library for Differentiable Nonlinear Optimizationcited by 65
- 2024RGBD GS-ICP SLAMcited by 65
- 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descentcited by 61
- 2021Tangent Space Backpropagation for 3D Transformation Groupscited by 40
- 2021TANDEM: Tracking and Dense Mapping in Real-time using Deep Multi-view Stereocited by 39
- 2023R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Camerascited by 39
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2025On-the-fly Reconstruction for Large-Scale Novel View Synthesis from Unposed Imagescited by 36
- 2021Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential Observationscited by 30
- 2023Multi-Modal Neural Radiance Field for Monocular Dense SLAM with a Light-Weight ToF Sensorcited by 30
- 2021ILabel: Interactive Neural Scene Labellingcited by 28
- 2022SAGE: SLAM with Appearance and Geometry Prior for Endoscopycited by 28
- 2026VGGT-SLAM 2.0: Real-time Dense Feed-forward Scene Reconstructioncited by 28
- 2024DDN-SLAM: Real-time Dense Dynamic Neural Implicit SLAMcited by 23
- 2022iDF-SLAM: End-to-End RGB-D SLAM with Neural Implicit Mapping and Deep Feature Trackingcited by 22
- 2025SAIL-Recon: Large SfM by Augmenting Scene Regression with Localizationcited by 20
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 20
- 2025Relative Pose Estimation through Affine Corrections of Monocular Depth Priorscited by 18
- 2021Advances in Inference and Representation for Simultaneous Localization and Mappingcited by 16
- 2021Boosting Light-Weight Depth Estimation Via Knowledge Distillationcited by 16
- 2021CodeMapping: Real-Time Dense Mapping for Sparse SLAM using Compact Scene Representationscited by 16
- 2023Learning a Depth Covariance Functioncited by 16
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomycited by 16
- 2023iSLAM: Imperative SLAMcited by 15
- 2023A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Servicescited by 14
- 2023Deep Learning for Visual Localization and Mapping: A Surveycited by 14
- 2025Benchmarking Egocentric Visual-Inertial SLAM at City Scalecited by 14
- 2021A visual introduction to Gaussian Belief Propagationcited by 13
- 2021Graph-based Thermal-Inertial SLAM with Probabilistic Neural Networkscited by 12
- 2024FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimationcited by 12
- 2024SLCF-Net: Sequential LiDAR-Camera Fusion for Semantic Scene Completion using a 3D Recurrent U-Netcited by 12
- 2023SuperPrimitive: Scene Reconstruction at a Primitive Levelcited by 11
- 2024Q-SLAM: Quadric Representations for Monocular SLAMcited by 11
50 most cited of 117 All 117 (JSON)
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering18 Sep 2026
- 2026GRF-Recon: Global Ray-Field Optimization for Long-Sequence Feed-forward Reconstruction17 Sep 2026
- 2026FFVO: A Feedforward Pose Decoder for Long-Horizon Visual Odometry12 Sep 2026
- 2026MomentBA: Second-order Spatial Moments for Anisotropic Correspondence Uncertainty in Differentiable Bundle Adjustment12 Sep 2026
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Models30 Aug 2026
- 2026CHOW-SLAM: Compact Hybrid Representation with Complementary Overlap Window Optimization for RGB-D SLAM3 Aug 2026
- 2026UniSim-SLAM: Feed-Forward SLAM with Unified Sim(3) Optimization3 Aug 2026
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motion29 Jul 2026
- 2026MoPe: Motion Permanence for Robust Monocular Gaussian Mapping in Dynamic Environments28 Jun 2026
- 2026Flow4DGS-SLAM: Optical Flow-Guided 4D Gaussian Splatting SLAM24 Apr 2026
- 2026Online3R: Online Learning for Consistent Sequential Reconstruction Based on Geometry Foundation Model10 Apr 2026
- 2026Accelerating Transformer-Based Monocular SLAM via Geometric Utility Scoring9 Apr 2026
38 more
- 2026VGGT-SLAM++8 Apr 2026
- 2026DINO-VO: Learning Where to Focus for Enhanced State Estimation5 Apr 2026
- 2026ViBA: Implicit Bundle Adjustment with Geometric and Temporal Consistency for Robust Visual Matching3 Apr 2026
- 2026SSR: A Training-Free Approach for Streaming 3D Reconstruction16 Mar 2026
- 2026VarSplat: Uncertainty-aware 3D Gaussian Splatting for Robust RGB-D SLAM10 Mar 2026
- 2026Learning Proposes, Geometry Disposes: A Modular Framework for Efficient Spatial Reasoning16 Feb 2026
- 2026S-MUSt3R: Sliding Multi-view 3D Reconstruction4 Feb 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2026VGGT-SLAM 2.0: Real-time Dense Feed-forward Scene Reconstruction27 Jan 2026
- 2025FoundationSLAM: Unleashing the Power of Depth Foundation Models for End-to-End Dense Visual SLAM31 Dec 2025
- 2025Joint Learning of Depth, Pose, and Local Radiance Field for Large Scale Monocular 3D Reconstruction20 Dec 2025
- 20254D Primitive-Mach'e: Glueing Primitives for Persistent 4D Scene Reconstruction18 Dec 2025
- 2025ACE-SLAM: Scene Coordinate Regression for Neural Implicit Real-Time SLAM16 Dec 2025
- 2025Fin3R: Fine-tuning Feed-forward 3D Reconstruction Models via Monocular Knowledge Distillation27 Nov 2025
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend25 Nov 2025
- 2025Dropping the D: RGB-D SLAM Without the Depth Sensor7 Oct 2025
- 2025Benchmarking Egocentric Visual-Inertial SLAM at City Scale30 Sep 2025
- 2025SLAM-Former: Putting SLAM into One Transformer21 Sep 2025
- 2025SAIL-Recon: Large SfM by Augmenting Scene Regression with Localization25 Aug 2025
- 2025Multimodal Fusion SLAM with Fourier Attention22 Jun 2025
- 2025SuperPoint-SLAM3: Augmenting ORB-SLAM3 with Deep Features, Adaptive NMS, and Learning-Based Loop Closure16 Jun 2025
- 2025LoopDB: A Loop Closure Dataset for Large Scale Simultaneous Localization and Mapping7 Jun 2025
- 2025GS4: Generalizable Sparse Splatting Semantic SLAM6 Jun 2025
- 2025On-the-fly Reconstruction for Large-Scale Novel View Synthesis from Unposed Images5 Jun 2025
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifold18 May 2025
- 2025ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videos17 Apr 2025
- 2025HS-SLAM: Hybrid Representation with Structural Supervision for Improved Dense SLAM27 Mar 2025
- 2025Image as an IMU: Estimating Camera Motion from a Single Motion-Blurred Image21 Mar 2025
- 2025SIRE: SE(3) Intrinsic Rigidity Embeddings10 Mar 2025
- 2025Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines4 Mar 2025
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstruction3 Mar 2025
- 2025Relative Pose Estimation through Affine Corrections of Monocular Depth Priors9 Jan 2025
- 2024MambaVO: Deep Visual Odometry Based on Sequential Matching Refinement and Training Smoothing28 Dec 2024
- 2024MVS-GS: High-Quality 3D Gaussian Splatting Mapping via Online Multi-View Stereo26 Dec 2024
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priors16 Dec 2024
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videos12 Dec 2024
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videos5 Dec 2024
- 2024MBA-SLAM: Motion Blur Aware Gaussian Splatting SLAM13 Nov 2024
50 newest of 117 All 117 (JSON)
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2023Gaussian Splatting SLAMcited by 415
- 2021Neural RGB-D Surface Reconstructioncited by 313
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
- 2022Deep Patch Visual Odometrycited by 190
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 164
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 141
12 most cited of 110 All 110 (JSON)
- 2026GRF-Recon: Global Ray-Field Optimization for Long-Sequence Feed-forward Reconstruction17 Sep 2026
- 2026FFVO: A Feedforward Pose Decoder for Long-Horizon Visual Odometry12 Sep 2026
- 2026MomentBA: Second-order Spatial Moments for Anisotropic Correspondence Uncertainty in Differentiable Bundle Adjustment12 Sep 2026
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Models30 Aug 2026
- 2026CHOW-SLAM: Compact Hybrid Representation with Complementary Overlap Window Optimization for RGB-D SLAM3 Aug 2026
- 2026UniSim-SLAM: Feed-Forward SLAM with Unified Sim(3) Optimization3 Aug 2026
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motion29 Jul 2026
- 2026MoPe: Motion Permanence for Robust Monocular Gaussian Mapping in Dynamic Environments28 Jun 2026
- 2026Flow4DGS-SLAM: Optical Flow-Guided 4D Gaussian Splatting SLAM24 Apr 2026
- 2026Online3R: Online Learning for Consistent Sequential Reconstruction Based on Geometry Foundation Model10 Apr 2026
- 2026Accelerating Transformer-Based Monocular SLAM via Geometric Utility Scoring9 Apr 2026
- 2026VGGT-SLAM++8 Apr 2026
12 newest of 110 All 110 (JSON)