mlsanityData to 14 Oct 2026

G2IA: Geometry-Guided Instance-Aware Retrieval and Refinement for Cross-Modal Place Recognition

arXiv 2606.15287 ↗First posted 13 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Cross-modal place recognition (CMPR) enables camera-only robots to localize against pre-built LiDAR maps in autonomous navigation scenarios. This image-to-point-cloud setting is challenged by two coupled ambiguities: the modality gap between perspective RGB appearance and sparse metric geometry, and perceptual aliasing among urban places with similar roads, facades, intersections, and object arrangements. Instead of treating CMPR as a single global descriptor matching problem, we argue that reliable retrieval requires both geometry-aware representation alignment and fine-grained candidate verification. In this paper, we propose G2IA, a geometry-guided instance-aware framework for image-to-point-cloud place recognition. In the retrieval stage, visual geometry priors from VGGT and instance features are integrated to construct place descriptors that are more compatible with LiDAR-derived map representations. In the refinement stage, the retrieved candidates are re-ranked by explicitly verifying whether local instance shapes and their relative spatial layouts are consistent across modalities. Experiments on public benchmarks demonstrate that G2IA consistently improves image-to-point-cloud place recognition under different localization thresholds, and exhibits strong cross-dataset generalization.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 36 references that are in the map. First posted on arXiv 13 Jun 2026.

Builds on

28 of 36 references.

References · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  3. 2017Billion-scale similarity search with GPUscited by 2,497
  4. 2021Vision Transformers for Dense Predictioncited by 1,803
  5. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  6. 2024VMamba: Visual State Space Modelcited by 969
  7. 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
  8. 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 352
  9. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  10. 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbonecited by 224
  11. 2018PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognitioncited by 198
  12. 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 163
16 more
  1. 2018In Defense of Classical Image Processing: Fast Depth Completion on the CPUcited by 96
  2. 2023A Survey on Global LiDAR Localization: Challenges, Advances and Open Problemscited by 40
  3. 2023Text2Loc: 3D Point Cloud Localization from Natural Languagecited by 35
  4. 2023LIP-Loc: LiDAR Image Pretraining for Cross-Modal Localizationcited by 26
  5. 2023CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Datacited by 19
  6. 2023(LC)2: LiDAR-Camera Loop Constraints For Cross-Modal Place Recognitioncited by 17
  7. 2023LCPR: A Multi-Scale Attention-Based LiDAR-Camera Fusion Network for Place Recognitioncited by 17
  8. 2023I2P-Rec: Recognizing Images on Large-scale Point Cloud Maps through Bird's Eye View Projectionscited by 16
  9. 2022General Place Recognition Survey: Towards the Real-world Autonomy Agecited by 11
  10. 2024UniLoc: Towards Universal Place Recognition Using Any Single Modalitycited by 10
  11. 2025ImLPR: Image-based LiDAR Place Recognition using Vision Foundation Modelscited by 10
  12. 2024Tell Me Where You Are: Multimodal LLMs Meet Place Recognitioncited by 7
  13. 2024ModaLink: Unifying Modalities for Efficient Image-to-PointCloud Place Recognitioncited by 5
  14. 2025OPAL: Visibility-aware LiDAR-to-OpenStreetMap Place Recognition via Adaptive Radial Fusioncited by 5
  15. 2024Monocular Visual Place Recognition in LiDAR Maps via Cross-Modal State Space Model and Multi-View Matchingcited by 4
  16. 2026VGGT-MPR: VGGT-Enhanced Multimodal Place Recognition in Autonomous Driving Environmentscited by 4

Built on by

Not cited yet.