# VGGT-MPR: VGGT-Enhanced Multimodal Place Recognition in Autonomous Driving Environments

arXiv: https://arxiv.org/abs/2602.19735 · HTML: https://mlsanity.com/paper/2602.19735/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 33 of its 41 references that are in the map.
- First posted on arXiv 23 Feb 2026.

## Builds on (most cited first, 30 of 33)

- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [GPT-4 Technical Report](https://mlsanity.com/paper/2303.08774/) (2023)
- [Segment Anything](https://mlsanity.com/paper/2304.02643/) (2023)
- [DINOv2: Learning Robust Visual Features without Supervision](https://mlsanity.com/paper/2304.07193/) (2023)
- [Masked Autoencoders Are Scalable Vision Learners](https://mlsanity.com/paper/2111.06377/) (2021)
- [nuScenes: A multimodal dataset for autonomous driving](https://mlsanity.com/paper/1903.11027/) (2019)
- [VGGT: Visual Geometry Grounded Transformer](https://mlsanity.com/paper/2503.11651/) (2025)
- [Faster Segment Anything: Towards Lightweight SAM for Mobile Applications](https://mlsanity.com/paper/2306.14289/) (2023)
- [Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition](https://mlsanity.com/paper/2103.01486/) (2021)
- [AnyLoc: Towards Universal Visual Place Recognition](https://mlsanity.com/paper/2308.00688/) (2023)
- [Optimal Transport Aggregation for Visual Place Recognition](https://mlsanity.com/paper/2311.15937/) (2023)
- [R2Former: Unified Retrieval and Reranking Transformer for Place Recognition](https://mlsanity.com/paper/2304.03410/) (2023)
- [OverlapNet: Loop Closing for LiDAR-based SLAM](https://mlsanity.com/paper/2105.11344/) (2021)
- [OverlapTransformer: An Efficient and Rotation-Invariant Transformer Network for LiDAR-Based Place Recognition](https://mlsanity.com/paper/2203.03397/) (2022)
- [CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognition](https://mlsanity.com/paper/2402.19231/) (2024)
- [MinkLoc++: Lidar and Monocular Image Fusion for Place Recognition](https://mlsanity.com/paper/2104.05327/) (2021)
- [AdaFusion: Visual-LiDAR Fusion with Adaptive Weights for Place Recognition](https://mlsanity.com/paper/2111.11739/) (2021)
- [Text2Loc: 3D Point Cloud Localization from Natural Language](https://mlsanity.com/paper/2311.15977/) (2023)
- [Spectral Geometric Verification: Re-Ranking Point Cloud Retrieval for Metric Localization](https://mlsanity.com/paper/2210.04432/) (2022)
- [CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Data](https://mlsanity.com/paper/2302.01665/) (2023)
- [BEVPlace++: Fast, Robust, and Lightweight LiDAR Global Localization for Unmanned Ground Vehicles](https://mlsanity.com/paper/2408.01841/) (2024)
- [Revisit Anything: Visual Place Recognition via Image Segment Retrieval](https://mlsanity.com/paper/2409.18049/) (2024)
- [CORAL: Colored structural representation for bi-modal place recognition](https://mlsanity.com/paper/2011.10934/) (2020)
- [LCPR: A Multi-Scale Attention-Based LiDAR-Camera Fusion Network for Place Recognition](https://mlsanity.com/paper/2311.03198/) (2023)
- [PIC-Net: Point Cloud and Image Collaboration Network for Large-Scale Place Recognition](https://mlsanity.com/paper/2008.00658/) (2020)
- [UniLoc: Towards Universal Place Recognition Using Any Single Modality](https://mlsanity.com/paper/2412.12079/) (2024)
- [Tell Me Where You Are: Multimodal LLMs Meet Place Recognition](https://mlsanity.com/paper/2406.17520/) (2024)
- [GSPR: Multimodal Place Recognition Using 3D Gaussian Splatting for Autonomous Driving](https://mlsanity.com/paper/2410.00299/) (2024)
- [RING#: PR-by-PE Global Localization with Roto-translation Equivariant Gram Learning](https://mlsanity.com/paper/2409.00206/) (2024)
- [Explicit Interaction for Fusion-Based Place Recognition](https://mlsanity.com/paper/2402.17264/) (2024)

## Built on by (most cited first, 4 of 4)

- [VGGT-Omega](https://mlsanity.com/paper/2605.15195/) (2026)
- [SCD4VPR: Multi-modal Scene Change Detection for Long-term Visual Place Recognition Database Update](https://mlsanity.com/paper/2604.11402/) (2026)
- [Heterogeneous LiDAR Early Fusion and Learned Re-Ranking Strategy for Robust Long-Term Place Recognition in Unstructured Environments](https://mlsanity.com/paper/2606.13503/) (2026)
- [G2IA: Geometry-Guided Instance-Aware Retrieval and Refinement for Cross-Modal Place Recognition](https://mlsanity.com/paper/2606.15287/) (2026)

## Abstract (arXiv)

In autonomous driving, robust place recognition is critical for global localization and loop closure detection. While inter-modality fusion of camera and LiDAR data in multimodal place recognition (MPR) has shown promise in overcoming the limitations of unimodal counterparts, existing MPR methods basically attend to hand-crafted fusion strategies and heavily parameterized backbones that require costly retraining. To address this, we propose VGGT-MPR, a multimodal place recognition framework that adopts the Visual Geometry Grounded Transformer (VGGT) as a unified geometric engine for both global retrieval and re-ranking. In the global retrieval stage, VGGT extracts geometrically-rich visual embeddings through prior depth-aware and point map supervision, and densifies sparse LiDAR point clouds with predicted depth maps to improve structural representation. This enhances the discriminative ability of fused multimodal features and produces global descriptors for fast retrieval. Beyond global retrieval, we design a training-free re-ranking mechanism that exploits VGGT's cross-view keypoint-tracking capability. By combining mask-guided keypoint extraction with confidence-aware correspondence scoring, our proposed re-ranking mechanism effectively refines retrieval results without additional parameter optimization. Extensive experiments on large-scale autonomous driving benchmarks and our self-collected data demonstrate that VGGT-MPR achieves state-of-the-art performance, exhibiting strong robustness to severe environmental changes, viewpoint shifts, and occlusions. Our code and data will be made publicly available.