Accelerating Transformer-Based Monocular SLAM via Geometric Utility Scoring
Not on the map. Why?
Abstract (arXiv)
Geometric Foundation Models (GFMs) have recently advanced monocular SLAM by providing robust, calibration-free 3D priors. However, deploying these models on dense video streams introduces significant computational redundancy. Current GFM-based SLAM systems typically rely on post hoc keyframe selection. Because of this, they must perform expensive dense geometric decoding simply to determine whether a frame contains novel geometry, resulting in late rejection and wasted computation. To mitigate this inefficiency, we propose LeanGate, a lightweight feed-forward frame-gating network. LeanGate predicts a geometric utility score to assess a frame's mapping value prior to the heavy GFM feature extraction and matching stages. As a predictive plug-and-play module, our approach bypasses over 90% of redundant frames. Evaluations on standard SLAM benchmarks demonstrate that LeanGate reduces tracking FLOPs by more than 85% and achieves a 5x end-to-end throughput speedup. Furthermore, it maintains the tracking and mapping accuracy of dense baselines. Project page: https://lean-gate.github.io/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 60 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
42 of 60 references.
References · 42
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
30 more
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 324
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 174
- 2018BA-Net: Dense Bundle Adjustment Networkcited by 173
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2018CodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAMcited by 151
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 130
- 2020ASLFeat: Learning Local Features of Accurate Shape and Localizationcited by 129
- 2019Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filterscited by 117
- 2020DeepFactors: Real-Time Probabilistic Dense Monocular SLAMcited by 117
- 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 112
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 98
- 2018DeepTAM: Deep Tracking and Mappingcited by 87
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2024Deep Patch Visual SLAMcited by 68
- 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 67
- 2016A Photometrically Calibrated Benchmark For Monocular Visual Odometrycited by 32
- 2026VGGT-SLAM 2.0: Real-time Dense Feed-forward Scene Reconstructioncited by 22
- 2014Introducing SLAMBench, a performance and accuracy benchmarking methodology for SLAMcited by 9
- 2025EC3R-SLAM: Efficient and Consistent Monocular Dense SLAM with Feed-Forward 3D Reconstructioncited by 4
Built on by
Not cited yet.