VGGT-MPR: VGGT-Enhanced Multimodal Place Recognition in Autonomous Driving Environments
Not on the map. Why?
Abstract (arXiv)
In autonomous driving, robust place recognition is critical for global localization and loop closure detection. While inter-modality fusion of camera and LiDAR data in multimodal place recognition (MPR) has shown promise in overcoming the limitations of unimodal counterparts, existing MPR methods basically attend to hand-crafted fusion strategies and heavily parameterized backbones that require costly retraining. To address this, we propose VGGT-MPR, a multimodal place recognition framework that adopts the Visual Geometry Grounded Transformer (VGGT) as a unified geometric engine for both global retrieval and re-ranking. In the global retrieval stage, VGGT extracts geometrically-rich visual embeddings through prior depth-aware and point map supervision, and densifies sparse LiDAR point clouds with predicted depth maps to improve structural representation. This enhances the discriminative ability of fused multimodal features and produces global descriptors for fast retrieval. Beyond global retrieval, we design a training-free re-ranking mechanism that exploits VGGT's cross-view keypoint-tracking capability. By combining mask-guided keypoint extraction with confidence-aware correspondence scoring, our proposed re-ranking mechanism effectively refines retrieval results without additional parameter optimization. Extensive experiments on large-scale autonomous driving benchmarks and our self-collected data demonstrate that VGGT-MPR achieves state-of-the-art performance, exhibiting strong robustness to severe environmental changes, viewpoint shifts, and occlusions. Our code and data will be made publicly available.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 33 of its 41 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
33 of 41 references.
References · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 345
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 159
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 151
- 2023R2Former: Unified Retrieval and Reranking Transformer for Place Recognitioncited by 102
21 more
- 2021OverlapNet: Loop Closing for LiDAR-based SLAMcited by 72
- 2022OverlapTransformer: An Efficient and Rotation-Invariant Transformer Network for LiDAR-Based Place Recognitioncited by 69
- 2024CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognitioncited by 61
- 2021MinkLoc++: Lidar and Monocular Image Fusion for Place Recognitioncited by 41
- 2021AdaFusion: Visual-LiDAR Fusion with Adaptive Weights for Place Recognitioncited by 36
- 2023Text2Loc: 3D Point Cloud Localization from Natural Languagecited by 35
- 2022Spectral Geometric Verification: Re-Ranking Point Cloud Retrieval for Metric Localizationcited by 21
- 2023CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Datacited by 19
- 2024BEVPlace++: Fast, Robust, and Lightweight LiDAR Global Localization for Unmanned Ground Vehiclescited by 19
- 2024Revisit Anything: Visual Place Recognition via Image Segment Retrievalcited by 19
- 2020CORAL: Colored structural representation for bi-modal place recognitioncited by 18
- 2023LCPR: A Multi-Scale Attention-Based LiDAR-Camera Fusion Network for Place Recognitioncited by 17
- 2020PIC-Net: Point Cloud and Image Collaboration Network for Large-Scale Place Recognitioncited by 16
- 2024UniLoc: Towards Universal Place Recognition Using Any Single Modalitycited by 10
- 2024Tell Me Where You Are: Multimodal LLMs Meet Place Recognitioncited by 7
- 2024GSPR: Multimodal Place Recognition Using 3D Gaussian Splatting for Autonomous Drivingcited by 7
- 2024RING#: PR-by-PE Global Localization with Roto-translation Equivariant Gram Learningcited by 5
- 2024Explicit Interaction for Fusion-Based Place Recognitioncited by 4
- 2023TReR: A Lightweight Transformer Re-Ranking Approach for 3D LiDAR Place Recognitioncited by 3
- 2025UniMPR: A Unified Framework for Multimodal Place Recognition with Heterogeneous Sensor Configurationscited by 2
- 2024Matched Filtering based LiDAR Place Recognition for Urban and Natural Environmentscited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026VGGT-Omegacited by 20
- 2026SCD4VPR: Multi-modal Scene Change Detection for Long-term Visual Place Recognition Database Updatecited by 0
- 2026Heterogeneous LiDAR Early Fusion and Learned Re-Ranking Strategy for Robust Long-Term Place Recognition in Unstructured Environmentscited by 0
- 2026G2IA: Geometry-Guided Instance-Aware Retrieval and Refinement for Cross-Modal Place Recognitioncited by 0
- 2026G2IA: Geometry-Guided Instance-Aware Retrieval and Refinement for Cross-Modal Place Recognition13 Jun 2026
- 2026Heterogeneous LiDAR Early Fusion and Learned Re-Ranking Strategy for Robust Long-Term Place Recognition in Unstructured Environments11 Jun 2026
- 2026VGGT-Omega14 May 2026
- 2026SCD4VPR: Multi-modal Scene Change Detection for Long-term Visual Place Recognition Database Update13 Apr 2026