Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mapping
Not on the map. Why?
Abstract (arXiv)
A spatial AI that can perform complex tasks through visual signals and cooperate with humans is highly anticipated. To achieve this, we need a visual SLAM that easily adapts to new scenes without pre-training and generates dense maps for downstream tasks in real-time. None of the previous learning-based and non-learning-based visual SLAMs satisfy all needs due to the intrinsic limitations of their components. In this work, we develop a visual SLAM named Orbeez-SLAM, which successfully collaborates with implicit neural representation and visual odometry to achieve our goals. Moreover, Orbeez-SLAM can work with the monocular camera since it only needs RGB inputs, making it widely applicable to the real world. Results show that our SLAM is up to 800x faster than the strong baseline with superior rendering outcomes. Code link: https://github.com/MarvinChung/Orbeez-SLAM.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 27 Sep 2022.
Builds on
22 of 36 references.
References · 22
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2020Neural Sparse Voxel Fieldscited by 959
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
10 more
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2021Self-Calibrating Neural Radiance Fieldscited by 204
- 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
- 2020DI-Fusion: Online Implicit 3D Reconstruction with Deep Priorscited by 70
- 2021TANDEM: Tracking and Dense Mapping in Real-time using Deep Multi-view Stereocited by 39
- 2019Bundle Adjustment Revisitedcited by 7
Built on by
Citing papers per year: 2022: 5; 2023: 17; 2024: 33; 2025: 14; 2026: 10.
79 papers.
Sort:
By area:
- 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2023Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Camerascited by 139
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 2024SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAMcited by 86
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2024RGBD GS-ICP SLAMcited by 65
38 more
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussianscited by 64
- 2024CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Fieldcited by 61
- 2024LoopSplat: Loop Closure by Registering 3D Gaussian Splatscited by 59
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
- 2023FlowCam: Training Generalizable 3D Radiance Fields without Camera Poses via Pixel-Aligned Scene Flowcited by 38
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAMcited by 36
- 2023CP-SLAM: Collaborative Neural Point-based SLAM Systemcited by 32
- 2023HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fieldscited by 31
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
- 2023Neural Implicit Dense Semantic SLAMcited by 26
- 2023MIPS-Fusion: Multi-Implicit-Submaps for Scalable and Robust Online Neural RGB-D Reconstructioncited by 24
- 2024DDN-SLAM: Real-time Dense Dynamic Neural Implicit SLAMcited by 22
- 2024MG-SLAM: Structure Gaussian Splatting SLAM with Manhattan World Hypothesiscited by 22
- 2022Multi-Object Navigation with dynamically learned neural implicit representationscited by 21
- 2024Neural Radiance Field in Autonomous Driving: A Surveycited by 19
- 2024NIS-SLAM: Neural Implicit Semantic RGB-D SLAM for 3D Consistent Scene Understandingcited by 19
- 2024MoD-SLAM: Monocular Dense Mapping for Unbounded 3D Scene Reconstructioncited by 18
- 2023DynaMoN: Motion-Aware Fast and Robust Camera Localization for Dynamic Neural Radiance Fieldscited by 16
- 2024NeRFs in Robotics: A Surveycited by 16
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenescited by 16
- 2025DenseSplat: Densifying Gaussian Splatting SLAM with Neural Radiance Priorcited by 14
- 2024MAGiC-SLAM: Multi-Agent Gaussian Globally Consistent SLAMcited by 12
- 2025LiftFeat: 3D Geometry-Aware Local Feature Matchingcited by 12
- 2025SEGS-SLAM: Structure-enhanced 3D Gaussian Splatting SLAM with Appearance Embeddingcited by 11
- 2023NeuSE: Neural SE(3)-Equivariant Embedding for Consistent Spatial Understanding with Objectscited by 10
- 2023NeRF-VO: Real-Time Sparse Visual Odometry with Neural Radiance Fieldscited by 10
- 2023RGB-D Mapping and Tracking in a Plenoxel Radiance Fieldcited by 9
- 2025GS-LIVO: Real-Time LiDAR, Inertial, and Visual Multi-sensor Fused Odometry with Gaussian Mappingcited by 8
- 2025ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videoscited by 8
- 2024Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-mapscited by 7
- 2024MGSO: Monocular Real-time Photometric SLAM with Efficient 3D Gaussian Splattingcited by 7
- 2023FMapping: Factorized Efficient Neural Field Mapping for Real-Time Dense RGB SLAMcited by 6
- 2024Hi-Map: Hierarchical Factorized Radiance Field for High-Fidelity Monocular Dense Mappingcited by 6
- 2024Benchmarking Implicit Neural Representation and Geometric Rendering in Real-Time RGB-D SLAMcited by 6
- 2024IG-SLAM: Instant Gaussian SLAMcited by 6
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAMcited by 6
- 2025Understanding while Exploring: Semantics-driven Active Mappingcited by 5
- 2026FeatureSLAM: Feature-enriched 3D gaussian splatting SLAM in real timecited by 5
50 most cited of 79 All 79 (JSON)
- 2026CHOW-SLAM: Compact Hybrid Representation with Complementary Overlap Window Optimization for RGB-D SLAM3 Aug 2026
- 2026Spectral GS-SLAM: Observability-Aware, Degeneracy-Robust Tracking for Real-Time 3D Gaussian Splatting SLAM19 Jun 2026
- 2026MMD-SLAM: Structure-Enhanced Multi-Meta Gaussian Distribution-Guided Visual SLAM18 Jun 2026
- 2026Unblur-SLAM: Dense Neural SLAM for Blurry Inputs26 Mar 2026
- 2026SURE: Semi-dense Uncertainty-REfined Feature Matching5 Mar 2026
- 2026From Pairs to Sequences: Track-Aware Policy Gradients for Keypoint Detection24 Feb 2026
- 2026GSO-SLAM: Bidirectionally Coupled Gaussian Splatting and Direct Visual Odometry12 Feb 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2026PointSLAM++: Robust Dense Neural Gaussian Point Cloud-based SLAM10 Jan 2026
- 2026FeatureSLAM: Feature-enriched 3D gaussian splatting SLAM in real time9 Jan 2026
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAM2 Dec 2025
- 2025RemixFusion: Residual-based Mixed Representation for Large-scale Online RGB-D Reconstruction23 Jul 2025
38 more
- 2025TVG-SLAM: Robust Gaussian Splatting SLAM with Tri-view Geometric Constraints29 Jun 2025
- 2025Understanding while Exploring: Semantics-driven Active Mapping30 May 2025
- 2025LiftFeat: 3D Geometry-Aware Local Feature Matching6 May 2025
- 2025Depth as Points: Center Point-based Depth Estimation26 Apr 2025
- 2025ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videos17 Apr 2025
- 2025Deblur Gaussian Splatting SLAM16 Mar 2025
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstruction3 Mar 2025
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenes21 Feb 2025
- 2025DenseSplat: Densifying Gaussian Splatting SLAM with Neural Radiance Prior13 Feb 2025
- 2025GS-LIVO: Real-Time LiDAR, Inertial, and Visual Multi-sensor Fused Odometry with Gaussian Mapping15 Jan 2025
- 2025SEGS-SLAM: Structure-enhanced 3D Gaussian Splatting SLAM with Appearance Embedding9 Jan 2025
- 2025NeRFs are Mirror Detectors: Using Structural Similarity for Multi-View Mirror Scene Reconstruction with 3D Surface Primitives7 Jan 2025
- 2024MVS-GS: High-Quality 3D Gaussian Splatting Mapping via Online Multi-View Stereo26 Dec 2024
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videos12 Dec 2024
- 2024Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstruction29 Nov 2024
- 2024MAGiC-SLAM: Multi-Agent Gaussian Globally Consistent SLAM25 Nov 2024
- 2024MBA-SLAM: Motion Blur Aware Gaussian Splatting SLAM13 Nov 2024
- 2024NeRF-Aug: Data Augmentation for Robotics with Neural Radiance Fields4 Nov 2024
- 2024MGSO: Monocular Real-time Photometric SLAM with Efficient 3D Gaussian Splatting19 Sep 2024
- 2024FaVoR: Features via Voxel Rendering for Camera Relocalization11 Sep 2024
- 2024LoopSplat: Loop Closure by Registering 3D Gaussian Splats19 Aug 2024
- 2024IG-SLAM: Instant Gaussian SLAM2 Aug 2024
- 2024NIS-SLAM: Neural Implicit Semantic RGB-D SLAM for 3D Consistent Scene Understanding30 Jul 2024
- 2024Learn to Memorize and to Forget: A Continual Learning Perspective of Dynamic SLAM18 Jul 2024
- 2024MG-SLAM: Structure Gaussian Splatting SLAM with Manhattan World Hypothesis30 May 2024
- 2024Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussians26 May 2024
- 2024Monocular Gaussian SLAM with Language Extended Loop Closure22 May 2024
- 2024SceneFactory: A Workflow-centric and Unified Framework for Incremental Scene Modeling13 May 2024
- 2024NeRFs in Robotics: A Survey2 May 2024
- 2024Neural Radiance Field in Autonomous Driving: A Survey22 Apr 2024
- 2024GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAM28 Mar 2024
- 2024Benchmarking Implicit Neural Representation and Geometric Rendering in Real-Time RGB-D SLAM28 Mar 2024
- 2024CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Field24 Mar 2024
- 2024RGBD GS-ICP SLAM19 Mar 2024
- 2024Vox-Fusion++: Voxel-based Neural Implicit Dense Tracking and Mapping with Multi-maps19 Mar 2024
- 2024DPPE: Dense Pose Estimation in a Plenoxels Environment using Gradient Approximation16 Mar 2024
- 2024VIRUS-NeRF -- Vision, InfraRed and UltraSonic based Neural Radiance Fields14 Mar 2024
- 2024DISORF: A Distributed Online 3D Reconstruction Framework for Mobile Robots1 Mar 2024
50 newest of 79 All 79 (JSON)
- 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2023Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Camerascited by 139
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 2024SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAMcited by 86
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2024RGBD GS-ICP SLAMcited by 65
12 most cited of 78 All 78 (JSON)
- 2026CHOW-SLAM: Compact Hybrid Representation with Complementary Overlap Window Optimization for RGB-D SLAM3 Aug 2026
- 2026Spectral GS-SLAM: Observability-Aware, Degeneracy-Robust Tracking for Real-Time 3D Gaussian Splatting SLAM19 Jun 2026
- 2026MMD-SLAM: Structure-Enhanced Multi-Meta Gaussian Distribution-Guided Visual SLAM18 Jun 2026
- 2026Unblur-SLAM: Dense Neural SLAM for Blurry Inputs26 Mar 2026
- 2026SURE: Semi-dense Uncertainty-REfined Feature Matching5 Mar 2026
- 2026From Pairs to Sequences: Track-Aware Policy Gradients for Keypoint Detection24 Feb 2026
- 2026GSO-SLAM: Bidirectionally Coupled Gaussian Splatting and Direct Visual Odometry12 Feb 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2026PointSLAM++: Robust Dense Neural Gaussian Point Cloud-based SLAM10 Jan 2026
- 2026FeatureSLAM: Feature-enriched 3D gaussian splatting SLAM in real time9 Jan 2026
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAM2 Dec 2025
- 2025RemixFusion: Residual-based Mixed Representation for Large-scale Online RGB-D Reconstruction23 Jul 2025
12 newest of 78 All 78 (JSON)