GeoLocSFT: Efficient Visual Geolocation via Supervised Fine-Tuning of Multimodal Foundation Models
Not on the map. Why?
Abstract (arXiv)
Accurately determining the geographic location where a single image was taken, visual geolocation, remains a formidable challenge due to the planet's vastness and the deceptive similarity among distant locations. We introduce GeoLocSFT, a framework that demonstrates how targeted supervised fine-tuning (SFT) of a large multimodal foundation model (Gemma 3) using a small, high-quality dataset can yield highly competitive geolocation performance. GeoLocSFT is trained with only 2700 carefully selected image-GPS pairs from our geographically diverse MR600k dataset. Despite this limited data, our SFT-centric approach substantially improves over baseline models and achieves robust results on standard benchmarks such as Im2GPS-3k and YFCC-4k, as well as on our newly proposed and challenging MR40k benchmark, aimed specifically at sparsely populated regions. Further, we explore multi-candidate inference and aggregation strategies but find that the core gains are already realized at the SFT stage. Our findings highlight the power of high-quality supervision and efficient SFT for planet-scale image geolocation, especially when compared to prior methods that require massive databases or complex pipelines. To foster further research, we publicly release the MR40k benchmark dataset.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
15 of 28 references.
References · 15
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Visual Instruction Tuningcited by 7,869
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2016PlaNet - Photo Geolocation with Convolutional Neural Networkscited by 115
- 2017Revisiting IM2GPS in the Deep Learning Eracited by 80
- 2023PIGEON: Predicting Image Geolocationscited by 56
- 2023Where We Are and What We're Looking At: Query Based Worldwide Image Geo-localization Using Hierarchies and Scenescited by 55
- 2024OpenStreetView-5M: The Many Roads to Global Visual Geolocationcited by 38
Built on by
Citing papers per year: 2025: 4; 2026: 5.
9 papers.
- 2025From Pixels to Places: A Systematic Benchmark for Evaluating Image Geolocalization Ability in Large Language Modelscited by 12
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Riskscited by 3
- 2026DisasterTD: Disaster Toponym Disambiguation Using Multimodal LLMs and Cross-View Geolocalizationcited by 3
- 2025GDGS: 3D Gaussian Splatting Via Geometry-Guided Initialization And Dynamic Density Controlcited by 2
- 2025A Global-Local Cross-Attention Network for Ultra-high Resolution Remote Sensing Image Semantic Segmentationcited by 1
- 2026LocationAgent: A Hierarchical Agent for Image Geolocation via Decoupling Strategy and Evidence from Parametric Knowledgecited by 1
- 2026MAViE: A Multi-scale Adaptive Vision Encoder for Fine-grained Visual Perception and Efficient Multimodal Reasoningcited by 0
- 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigationcited by 0
- 2026Hiding in Plain Sight: A Diffusion-based Mitigation of Geolocation Privacy Leakage in Vision-Language Modelscited by 0
- 2026Hiding in Plain Sight: A Diffusion-based Mitigation of Geolocation Privacy Leakage in Vision-Language Models18 Sep 2026
- 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation30 Aug 2026
- 2026MAViE: A Multi-scale Adaptive Vision Encoder for Fine-grained Visual Perception and Efficient Multimodal Reasoning27 Jul 2026
- 2026DisasterTD: Disaster Toponym Disambiguation Using Multimodal LLMs and Cross-View Geolocalization26 Jul 2026
- 2026LocationAgent: A Hierarchical Agent for Image Geolocation via Decoupling Strategy and Evidence from Parametric Knowledge27 Jan 2026
- 2025From Pixels to Places: A Systematic Benchmark for Evaluating Image Geolocalization Ability in Large Language Models3 Aug 2025
- 2025GDGS: 3D Gaussian Splatting Via Geometry-Guided Initialization And Dynamic Density Control1 Jul 2025
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Risks30 Jun 2025
- 2025A Global-Local Cross-Attention Network for Ultra-high Resolution Remote Sensing Image Semantic Segmentation24 Jun 2025