mlsanityData to 7 Oct 2026

Scale, Don't Fine-tune: Guiding Multimodal LLMs for Efficient Visual Place Recognition at Test-Time

arXiv 2509.02129 ↗First posted 2 Sep 2025cs.LG cs.CVcited by 3

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

Abstract (arXiv)

Visual Place Recognition (VPR) has evolved from handcrafted descriptors to deep learning approaches, yet significant challenges remain. Current approaches, including Vision Foundation Models (VFMs) and Multimodal Large Language Models (MLLMs), enhance semantic understanding but suffer from high computational overhead and limited cross-domain transferability when fine-tuned. To address these limitations, we propose a novel zero-shot framework employing Test-Time Scaling (TTS) that leverages MLLMs' vision-language alignment capabilities through Guidance-based methods for direct similarity scoring. Our approach eliminates two-stage processing by employing structured prompts that generate length-controllable JSON outputs. The TTS framework with Uncertainty-Aware Self-Consistency (UASC) enables real-time adaptation without additional training costs, achieving superior generalization across diverse environments. Experimental results demonstrate significant improvements in cross-domain VPR performance with up to 210× computational efficiency gains.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 29 references that are in the map. First posted on arXiv 2 Sep 2025.

Builds on

18 of 29 references.

References · 18

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  4. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  5. 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Trainingcited by 291
  6. 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
  7. 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 185
  8. 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 160
  9. 2023EigenPlaces: Training Viewpoint Robust Models for Visual Place Recognitioncited by 109
  10. 2025DeepSeek-R1 Thoughtology: Let's think about LLM Reasoningcited by 91
  11. 2024BoQ: A Place is Worth a Bag of Learnable Queriescited by 63
  12. 2024CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognitioncited by 61
6 more
  1. 2024TreeBoN: Enhancing Inference-Time Alignment with Speculative Tree-Search and Best-of-N Samplingcited by 61
  2. 2024MF-MOS: A Motion-Focused Model for Moving Object Segmentationcited by 23
  3. 2024AddressCLIP: Empowering Vision-Language Models for City-wide Image Address Localizationcited by 21
  4. 2025NAVIG: Natural Language-guided Analysis with Vision Language Models for Image Geo-localizationcited by 8
  5. 2024Tell Me Where You Are: Multimodal LLMs Meet Place Recognitioncited by 7
  6. 2024ProGEO: Generating Prompts through Image-Text Contrastive Learning for Visual Geo-localizationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024LVLM-empowered Multi-modal Representation Learning for Visual Place Recognition
  2. 2026LaVPR: Benchmarking Language and Vision for Place Recognition
  3. 2026Are All Tokens Necessary for Visual Place Recognition? An Empirical Study of Token Reduction for Efficient Inference
  4. 2025VLM-Guided Visual Place Recognition for Planet-Scale Geo-Localization
  5. 2026Breaking D'ej`a Vu: Independent Auditing of Visual Place Recognition through Vision-Language Reasoning
  6. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs
  7. 2024Rethinking VLMs and LLMs for Image Classification
  8. 2026Faster or Stronger: Towards Flexible Visual Place Recognition via Weighted Aggregation and Token Pruning