GRS-SLAM3R: Real-Time Dense SLAM with Gated Recurrent State
Not on the map. Why?
Abstract (arXiv)
DUSt3R-based end-to-end scene reconstruction has recently shown promising results in dense visual SLAM. However, most existing methods only use image pairs to estimate pointmaps, overlooking spatial memory and global consistency.To this end, we introduce GRS-SLAM3R, an end-to-end SLAM framework for dense scene reconstruction and pose estimation from RGB images without any prior knowledge of the scene or camera parameters. Unlike existing DUSt3R-based frameworks, which operate on all image pairs and predict per-pair point maps in local coordinate frames, our method supports sequentialized input and incrementally estimates metric-scale point clouds in the global coordinate. In order to improve consistent spatial correlation, we use a latent state for spatial memory and design a transformer-based gated update module to reset and update the spatial memory that continuously aggregates and tracks relevant 3D information across frames. Furthermore, we partition the scene into submaps, apply local alignment within each submap, and register all submaps into a common world frame using relative constraints, producing a globally consistent map. Experiments on various datasets show that our framework achieves superior reconstruction accuracy while maintaining real-time performance.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 40 of its 61 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
40 of 61 references.
References · 40
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
28 more
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2021Neural RGB-D Surface Reconstructioncited by 313
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 20243D Reconstruction with Spatial Memorycited by 277
- 2024Global Structure-from-Motion Revisitedcited by 218
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 200
- 2018BA-Net: Dense Bundle Adjustment Networkcited by 175
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 164
- 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
- 2018CodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAMcited by 152
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 115
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 102
- 2024SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAMcited by 87
- 2023SNI-SLAM: Semantic Neural Implicit SLAMcited by 65
- 2023PLGSLAM: Progressive Neural Scene Represenation with Local to Global Bundle Adjustmentcited by 63
- 2021TANDEM: Tracking and Dense Mapping in Real-time using Deep Multi-view Stereocited by 39
- 2024NeSLAM: Neural Implicit Mapping and Self-Supervised Feature Tracking With Depth Completion and Denoisingcited by 30
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representationcited by 11
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025UniPR-3D: Towards Universal Visual Place Recognition with Visual Geometry Grounded Transformercited by 8
- 2025MUT3R: Motion-aware Updating Transformer for Dynamic 3D Reconstructioncited by 7
- 2025Reloc-VGGT: Visual Re-localization with Geometry Grounded Transformercited by 5
- 2026Mamba-VGGT: Persistent Long-Sequence Video Geometry Grounded Transformer via External Sliding Window Mamba Memorycited by 3
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstructioncited by 0
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Renderingcited by 0
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering18 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026Mamba-VGGT: Persistent Long-Sequence Video Geometry Grounded Transformer via External Sliding Window Mamba Memory17 May 2026
- 2025Reloc-VGGT: Visual Re-localization with Geometry Grounded Transformer26 Dec 2025
- 2025UniPR-3D: Towards Universal Visual Place Recognition with Visual Geometry Grounded Transformer24 Dec 2025
- 2025MUT3R: Motion-aware Updating Transformer for Dynamic 3D Reconstruction3 Dec 2025