mlsanityData to 14 Oct 2026

GeoLocSFT: Efficient Visual Geolocation via Supervised Fine-Tuning of Multimodal Foundation Models

arXiv 2506.01277 ↗First posted 2 Jun 2025cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

Accurately determining the geographic location where a single image was taken, visual geolocation, remains a formidable challenge due to the planet's vastness and the deceptive similarity among distant locations. We introduce GeoLocSFT, a framework that demonstrates how targeted supervised fine-tuning (SFT) of a large multimodal foundation model (Gemma 3) using a small, high-quality dataset can yield highly competitive geolocation performance. GeoLocSFT is trained with only 2700 carefully selected image-GPS pairs from our geographically diverse MR600k dataset. Despite this limited data, our SFT-centric approach substantially improves over baseline models and achieves robust results on standard benchmarks such as Im2GPS-3k and YFCC-4k, as well as on our newly proposed and challenging MR40k benchmark, aimed specifically at sparsely populated regions. Further, we explore multi-candidate inference and aggregation strategies but find that the core gains are already realized at the SFT stage. Our findings highlight the power of high-quality supervision and efficient SFT for planet-scale image geolocation, especially when compared to prior methods that require massive databases or complex pipelines. To foster further research, we publicly release the MR40k benchmark dataset.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 2 Jun 2025.

Builds on

15 of 28 references.

References · 15

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  8. 2016PlaNet - Photo Geolocation with Convolutional Neural Networkscited by 115
  9. 2017Revisiting IM2GPS in the Deep Learning Eracited by 80
  10. 2023PIGEON: Predicting Image Geolocationscited by 56
  11. 2023Where We Are and What We're Looking At: Query Based Worldwide Image Geo-localization Using Hierarchies and Scenescited by 55
  12. 2024OpenStreetView-5M: The Many Roads to Global Visual Geolocationcited by 38
3 more
  1. 2024G3: An Effective and Adaptive Framework for Worldwide Geolocalization Using Large Multi-Modality Modelscited by 34
  2. 2024Around the World in 80 Timesteps: A Generative Approach to Global Visual Geolocationcited by 23
  3. 2024Image-Based Geolocation Using Large Vision-Language Modelscited by 17

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 5.

9 papers.