VGGT-SLAM++
Not on the map. Why?
Abstract (arXiv)
We introduce VGGT-SLAM++, a complete visual SLAM system that leverages the geometry-rich outputs of the Visual Geometry Grounded Transformer (VGGT). The system comprises a visual odometry (front-end) fusing the VGGT feed-forward transformer and a Sim(3) solution, a Digital Elevation Map (DEM)-based graph construction module, and a back-end that jointly enable accurate large-scale mapping with bounded memory. While prior transformer-based SLAM pipelines such as VGGT-SLAM rely primarily on sparse loop closures or global Sim(3) manifold constraints - allowing short-horizon pose drift - VGGT-SLAM++ restores high-cadence local bundle adjustment (LBA) through a spatially corrective back-end. For each VGGT submap, we construct a dense planar-canonical DEM, partition it into patches, and compute their DINOv2 embeddings to integrate the submap into a covisibility graph. Spatial neighbors are retrieved using a Visual Place Recognition (VPR) module within the covisibility window, triggering frequent local optimization that stabilizes trajectories. Across standard SLAM benchmarks, VGGT-SLAM++ achieves state-of-the-art accuracy, substantially reducing short-term drift, accelerating graph convergence, and maintaining global consistency with compact DEM tiles and sublinear retrieval.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 45 of its 97 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
45 of 97 references.
References · 45
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2025DINOv3cited by 1,297
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
33 more
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2024The Faiss librarycited by 370
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 20243D Reconstruction with Spatial Memorycited by 269
- 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 200
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 159
- 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2020DeepFactors: Real-Time Probabilistic Dense Monocular SLAMcited by 117
- 2021OverlapNet: Loop Closing for LiDAR-based SLAMcited by 72
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 69
- 2024Deep Patch Visual SLAMcited by 68
- 2019OpenVSLAM: A Versatile Visual SLAM Frameworkcited by 64
- 2018LDSO: Direct Sparse Odometry with Loop Closurecited by 50
- 2024Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentationcited by 42
- 2025G-CUT3R: Guided 3D Reconstruction with Camera and Depth Prior Integrationcited by 11
- 2017Robust Estimation of Similarity Transformation for Visual Object Trackingcited by 10
- 2023Towards Accurate Loop Closure Detection in Semantic SLAM with 3D Semantic Covisibility Graphscited by 7
- 2024Enhancing HNSW Index for Real-Time Updates: Addressing Unreachable Points and Performance Degradationcited by 7
- 2023FinderNet: A Data Augmentation Free Canonicalization aided Loop Detection and Closure technique for Point clouds in 6-DOF separationcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.