mlsanityData to 7 Oct 2026

Text2Graph VPR: A Text-to-Graph Expert System for Explainable Place Recognition in Changing Environments

arXiv 2512.18613 ↗First posted 21 Dec 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Visual Place Recognition (VPR) in long-term deployment requires reasoning beyond pixel similarity: systems must make transparent, interpretable decisions that remain robust under lighting, weather and seasonal change. We present Text2Graph VPR, an explainable semantic localization system that converts image sequences into textual scene descriptions, parses those descriptions into structured scene graphs, and reasons over the resulting graphs to identify places. Scene graphs capture objects, attributes and pairwise relations; we aggregate per-frame graphs into a compact place representation and perform retrieval with a dual-similarity mechanism that fuses learned Graph Attention Network (GAT) embeddings and a Shortest-Path (SP) kernel for structural matching. This hybrid design enables both learned semantic matching and topology-aware comparison, and -- critically -- produces human-readable intermediate representations that support diagnostic analysis and improve transparency in the decision process. We validate the system on Oxford RobotCar and MSLS (Amman/San Francisco) benchmarks and demonstrate robust retrieval under severe appearance shifts, along with zero-shot operation using human textual queries. The results illustrate that semantic, graph-based reasoning is a viable and interpretable alternative for place recognition, particularly suited to safety-sensitive and resource-constrained settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 54 references that are in the map. First posted on arXiv 21 Dec 2025.

Builds on

38 of 54 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2017Graph Attention Networkscited by 8,854
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  7. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  8. 2020Supervised Contrastive Learningcited by 2,803
  9. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  10. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  11. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
  12. 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
26 more
  1. 2019On Variational Bounds of Mutual Informationcited by 550
  2. 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 544
  3. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 310
  4. 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
  5. 2019Learning with Average Precision: Training Image Retrieval with a Listwise Losscited by 184
  6. 2021SeqNet: Learning Descriptors for Sequence-based Hierarchical Place Recognitioncited by 56
  7. 2021MinkLoc++: Lidar and Monocular Image Fusion for Place Recognitioncited by 41
  8. 2022Text2Pos: Text-to-Point-Cloud Cross-Modal Localizationcited by 40
  9. 2021AdaFusion: Visual-LiDAR Fusion with Adaptive Weights for Place Recognitioncited by 36
  10. 2023Text2Loc: 3D Point Cloud Localization from Natural Languagecited by 35
  11. 2018LoST? Appearance-Invariant Place Recognition for Opposite Viewpoints using Visual Semanticscited by 34
  12. 2024SceneGraphLoc: Cross-Modal Coarse Visual Localization on 3D Scene Graphscited by 29
  13. 2022Learning Sequential Descriptors for Sequence-based Visual Place Recognitioncited by 25
  14. 2020Delta Descriptors: Change-Based Place Representation for Robust Visual Localizationcited by 21
  15. 2023Language-EXtended Indoor SLAM (LEXIS): A Versatile System for Real-time Visual Scene Understandingcited by 15
  16. 2024"Where am I?" Scene Retrieval with Languagecited by 15
  17. 2024Pair-VPR: Place-Aware Pre-training and Contrastive Pair Classification for Visual Place Recognition with Vision Transformerscited by 15
  18. 2022MultiRes-NetVLAD: Augmenting Place Recognition Training with Low-Resolution Imagerycited by 14
  19. 2024JIST: Joint Image and Sequence Training for Sequential Visual Place Recognitioncited by 7
  20. 2024MSSPlace: Multi-Sensor Place Recognition with Visual and Text Semanticscited by 7
  21. 2023Learning Sequence Descriptor based on Spatio-Temporal Attention for Visual Place Recognitioncited by 6
  22. 2025Bridging Text and Vision: A Multi-View Text-Vision Registration Approach for Cross-Modal Place Recognitioncited by 6
  23. 2020DeepSeqSLAM: A Trainable CNN+RNN for Joint Global Description and Sequence-based Place Recognitioncited by 5
  24. 2025GOTPR: General Outdoor Text-based Place Recognition Using Scene Graph Retrieval with OpenStreetMapcited by 5
  25. 2025OPAL: Visibility-aware LiDAR-to-OpenStreetMap Place Recognition via Adaptive Radial Fusioncited by 5
  26. 2024LVLM-empowered Multi-modal Representation Learning for Visual Place Recognitioncited by 2

Built on by

Not cited yet.