DialogueVPR: Towards Conversational Visual Place Recognition
Not on the map. Why?
Abstract (arXiv)
Inspired by how humans communicate spatial information, language-guided geo-localization has gained significant traction for its intuitive and practical value. Despite this progress, most methods still rely on a static, one-shot retrieval paradigm, which fails to handle the ambiguity and incompleteness inherent in real-world natural language descriptions. We propose a paradigm shift to reasoning retrieval and introduce Dialogue Place Recognition (DlgPR), which casts localization as an interactive, dialogue-driven reasoning process. To support this new task, we present DlgQuest-Cities, the first large-scale dialogue-based benchmark for place recognition, and a unified reasoning framework that couples a cross-modal multi-level retriever with an intelligent questioner, DQ-pilot. DQ-pilot is trained in a curriculum: supervised fine-tuning on a curated DQ-cities-20k subset followed by reinforcement refinement on a harder DQ-cities-10k split via GRPO. Two task-aligned metrics guide learning: a Discriminative Difficulty Index (DDI) for curriculum sampling and a Positional Retrieval Gain (PRG) reward that directly measures retrieval improvement induced by a question. Experiments show this reasoning-based approach significantly outperforms baselines. The code and model are available at https://github.com/Graysonggg/DlgPR.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 46 of its 54 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
46 of 54 references.
References · 46
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
- 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
- 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 298
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 151
- 2023Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrievalcited by 131
- 2020Where am I looking at? Joint Location and Orientation Estimation by Cross-View Matchingcited by 125
34 more
- 2013A Theoretical Analysis of NDCG Type Ranking Measurescited by 119
- 2023Sample4Geo: Hard Negative Sampling For Cross-View Geo-Localisationcited by 107
- 2022GSV-Cities: Toward Appropriate Supervised Visual Place Recognitioncited by 92
- 2025FG-CLIP: Fine-Grained Visual and Textual Alignmentcited by 78
- 2024BoQ: A Place is Worth a Bag of Learnable Queriescited by 63
- 2023Fine-Grained Cross-View Geo-Localization Using a Correlation-Aware Homography Estimatorcited by 56
- 2024Towards Seamless Adaptation of Pre-trained Models for Visual Place Recognitioncited by 49
- 2024FLAIR: VLM with Fine-grained Language-informed Image Representationscited by 47
- 2022Text2Pos: Text-to-Point-Cloud Cross-Modal Localizationcited by 40
- 2023Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matchingcited by 40
- 2024Cross-view image geo-localization with Panorama-BEV Co-Retrieval Networkcited by 40
- 2024Where am I? Cross-View Geo-localization with Natural Language Descriptionscited by 38
- 2023Text2Loc: 3D Point Cloud Localization from Natural Languagecited by 35
- 2024Close, But Not There: Boosting Geographic Distance Sensitivity in Visual Place Recognitioncited by 27
- 2023Chatting Makes Perfect: Chat-based Image Retrievalcited by 25
- 2024Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approachcited by 25
- 2022OmniCity: Omnipotent City Understanding with Multi-level and Multi-view Imagescited by 21
- 2024Enhancing Interactive Image Retrieval With Query Rewriting Using Large Language Models and Vision Language Modelscited by 19
- 2022Learning to Retrieve Videos by Asking Questionscited by 17
- 2025Focus on Local: Finding Reliable Discriminative Regions for Visual Place Recognitioncited by 16
- 2024"Where am I?" Scene Retrieval with Languagecited by 15
- 2024Adapting Fine-Grained Cross-View Localization to Areas without Fine Ground Truthcited by 14
- 2023Simple Baselines for Interactive Video Retrieval with Questions and Answerscited by 12
- 2024Loc4Plan: Locating Before Planning for Outdoor Vision and Language Navigationcited by 11
- 2015WhittleSearch: Interactive Image Search with Relative Attribute Feedbackcited by 10
- 2021Ask&Confirm: Active Detail Enriching for Cross-Modal Retrieval with Partial Querycited by 9
- 2025LLaVA-ReID: Selective Multi-image Questioner for Interactive Person Re-Identificationcited by 9
- 2023Global Proxy-based Hard Mining for Visual Place Recognitioncited by 8
- 2024Tell Me Where You Are: Multimodal LLMs Meet Place Recognitioncited by 7
- 2024ProGEO: Generating Prompts through Image-Text Contrastive Learning for Visual Geo-localizationcited by 6
- 2025Bridging Text and Vision: A Multi-View Text-Vision Registration Approach for Cross-Modal Place Recognitioncited by 6
- 2024LVLM-empowered Multi-modal Representation Learning for Visual Place Recognitioncited by 2
- 2025TextInPlace: Indoor Visual Place Recognition in Repetitive Structures with Scene Text Spotting and Verificationcited by 2
- 2026Region Matters: Efficient and Reliable Region-Aware Visual Place Recognitioncited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Where on Earth? A Vision-Language Benchmark for Probing Model Geolocation Skills Across Scales
- 2025Recognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Models
- 2026LaVPR: Benchmarking Language and Vision for Place Recognition
- 2026MapVerse: A Benchmark for Geospatial Question Answering on Diverse Real-World Maps
- 2026What Words Keep of a Place: Zero-Shot Language Reasoning for Cross-View Geo-Localization
- 2024Learning to Localize Objects Improves Spatial Reasoning in Visual-LLMs
- 2023Towards Grounded Visual Spatial Reasoning in Multi-Modal Vision Language Models
- 2026SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Models