Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Framework
Not on the map. Why?
Abstract (arXiv)
Geolocation, the task of identifying an image's location, requires complex reasoning and is crucial for navigation, monitoring, and cultural preservation. However, current methods often produce coarse, imprecise, and non-interpretable localization. A major challenge lies in the quality and scale of existing geolocation datasets. These datasets are typically small-scale and automatically constructed, leading to noisy data and inconsistent task difficulty, with images that either reveal answers too easily or lack sufficient clues for reliable inference. To address these challenges, we introduce a comprehensive geolocation framework with three key components: GeoComp, a large-scale dataset; GeoCoT, a novel reasoning method; and GeoEval, an evaluation metric, collectively designed to address critical challenges and drive advancements in geolocation research. At the core of this framework is GeoComp (Geolocation Competition Dataset), a large-scale dataset collected from a geolocation game platform involving 740K users over two years. It comprises 25 million entries of metadata and 3 million geo-tagged locations spanning much of the globe, with each location annotated thousands to tens of thousands of times by human users. The dataset offers diverse difficulty levels for detailed analysis and highlights key gaps in current models. Building on this dataset, we propose Geographical Chain-of-Thought (GeoCoT), a novel multi-step reasoning framework designed to enhance the reasoning capabilities of Large Vision Models (LVMs) in geolocation tasks. GeoCoT improves performance by integrating contextual and spatial cues through a multi-step process that mimics human geolocation reasoning. Finally, using the GeoEval metric, we demonstrate that GeoCoT significantly boosts geolocation accuracy by up to 25% while enhancing interpretability.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 32 of its 66 references that are in the map. First posted on arXiv 19 Feb 2025.
Builds on
32 of 66 references.
References · 32
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
- 2023An Embodied Generalist Agent in 3D Worldcited by 365
- 2024MM1: Methods, Analysis & Insights from Multimodal LLM Pre-trainingcited by 232
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 187
- 2015Wide-Area Image Geolocalization with Aerial Reference Imagerycited by 186
- 2019Lending Orientation to Neural Networks for Cross-view Geo-localizationcited by 180
- 2022Language models show human-like content effects on reasoning taskscited by 173
- 2022TransGeo: Transformer Is All You Need for Cross-view Image Geo-localizationcited by 168
20 more
- 2023mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understandingcited by 168
- 2016PlaNet - Photo Geolocation with Convolutional Neural Networkscited by 115
- 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inferencecited by 97
- 2017Revisiting IM2GPS in the Deep Learning Eracited by 80
- 2022Cross-view Geo-localization via Learning Disentangled Geometric Layout Correspondencecited by 70
- 2018CPlaNet: Enhancing Image Geolocalization by Combinatorial Partitioning of Mapscited by 68
- 2022Where in the World is this Image? Transformer-based Geo-localization in the Wildcited by 58
- 2023Where We Are and What We're Looking At: Query Based Worldwide Image Geo-localization Using Hierarchies and Scenescited by 55
- 2024ControlTraj: Controllable Trajectory Generation with Topology-Constrained Diffusion Modelcited by 49
- 2019The StreetLearn Environment and Datasetcited by 42
- 2023Learning Generalized Zero-Shot Learners for Open-Domain Image Geolocalizationcited by 41
- 2023BenchLMM: Benchmarking Cross-style Visual Capability of Large Multimodal Modelscited by 41
- 2024OpenStreetView-5M: The Many Roads to Global Visual Geolocationcited by 38
- 2021Interpretable Semantic Photo Geolocationcited by 32
- 2024Img2Loc: Revisiting Image Geolocalization using Multi-modality Foundation Models and Image-based Retrieval-Augmented Generationcited by 32
- 2024Universal Adversarial Perturbations for Vision-Language Pre-trained Modelscited by 31
- 2024Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Modelscited by 24
- 2023MLPST: MLP is All You Need for Spatio-Temporal Predictioncited by 22
- 2023PromptST: Prompt-Enhanced Spatio-Temporal Multi-Attribute Predictioncited by 20
- 2022MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learningcited by 11
Built on by
Citing papers per year: 2025: 14; 2026: 10.
24 papers.
Sort:
By area:
- 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Modelscited by 44
- 2025Recognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Modelscited by 28
- 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Modelscited by 27
- 2025Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Modelscited by 21
- 2025PresentAgent: Multimodal Agent for Presentation Video Generationcited by 21
- 2025GeoChain: Multimodal Chain-of-Thought for Geographic Reasoningcited by 16
- 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chainscited by 14
- 2025Towards Cross-View Point Correspondence in Vision-Language Modelscited by 14
- 2025GeoVista: Web-Augmented Agentic Visual Reasoning for Geolocalizationcited by 11
- 2025VaseVQA: Multimodal Agent and Benchmark for Ancient Greek Potterycited by 6
- 2025Where on Earth? A Vision-Language Benchmark for Probing Model Geolocation Skills Across Scalescited by 5
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristicscited by 5
12 more
- 2026TextAlign: Preference Alignment for Text Rendering with Hierarchical Rewardscited by 5
- 2026GeoRC: A Benchmark for Geolocation Reasoning Chainscited by 4
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Riskscited by 3
- 2026Learning to Wander: Improving the Global Image Geolocation Ability of LMMs via Actionable Reasoningcited by 3
- 2026GeoBrowse: A Geolocation Benchmark for Agentic Tool Use with Expert-Annotated Reasoning Tracescited by 3
- 2025Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Viewscited by 1
- 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agentscited by 1
- 2026LocationAgent: A Hierarchical Agent for Image Geolocation via Decoupling Strategy and Evidence from Parametric Knowledgecited by 1
- 2026MONETA: Multimodal Industry Classification through Geographic Information with Multi Agent Systemscited by 0
- 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigationcited by 0
- 2026EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoningcited by 0
- 2026GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulationcited by 0
- 2026GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulation14 Oct 2026
- 2026EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoning8 Sep 2026
- 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation30 Aug 2026
- 2026TextAlign: Preference Alignment for Text Rendering with Hierarchical Rewards19 May 2026
- 2026MONETA: Multimodal Industry Classification through Geographic Information with Multi Agent Systems9 Apr 2026
- 2026GeoBrowse: A Geolocation Benchmark for Agentic Tool Use with Expert-Annotated Reasoning Traces5 Apr 2026
- 2026Learning to Wander: Improving the Global Image Geolocation Ability of LMMs via Actionable Reasoning11 Mar 2026
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristics13 Feb 2026
- 2026GeoRC: A Benchmark for Geolocation Reasoning Chains29 Jan 2026
- 2026LocationAgent: A Hierarchical Agent for Image Geolocation via Decoupling Strategy and Evidence from Parametric Knowledge27 Jan 2026
- 2025Towards Cross-View Point Correspondence in Vision-Language Models4 Dec 2025
- 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agents27 Nov 2025
12 more
- 2025GeoVista: Web-Augmented Agentic Visual Reasoning for Geolocalization19 Nov 2025
- 2025Where on Earth? A Vision-Language Benchmark for Probing Model Geolocation Skills Across Scales13 Oct 2025
- 2025VaseVQA: Multimodal Agent and Benchmark for Ancient Greek Pottery21 Sep 2025
- 2025PresentAgent: Multimodal Agent for Presentation Video Generation5 Jul 2025
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Risks30 Jun 2025
- 2025Recognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Models17 Jun 2025
- 2025Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Views3 Jun 2025
- 2025GeoChain: Multimodal Chain-of-Thought for Geographic Reasoning1 Jun 2025
- 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chains24 May 2025
- 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Models22 May 2025
- 2025Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models21 May 2025
- 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models30 Apr 2025
- 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Modelscited by 44
- 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Modelscited by 27
- 2025GeoChain: Multimodal Chain-of-Thought for Geographic Reasoningcited by 16
- 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chainscited by 14
- 2025GeoVista: Web-Augmented Agentic Visual Reasoning for Geolocalizationcited by 11
- 2026GeoRC: A Benchmark for Geolocation Reasoning Chainscited by 4
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Riskscited by 3
- 2026Learning to Wander: Improving the Global Image Geolocation Ability of LMMs via Actionable Reasoningcited by 3
- 2026GeoBrowse: A Geolocation Benchmark for Agentic Tool Use with Expert-Annotated Reasoning Tracescited by 3
- 2026GeoBrowse: A Geolocation Benchmark for Agentic Tool Use with Expert-Annotated Reasoning Traces5 Apr 2026
- 2026Learning to Wander: Improving the Global Image Geolocation Ability of LMMs via Actionable Reasoning11 Mar 2026
- 2026GeoRC: A Benchmark for Geolocation Reasoning Chains29 Jan 2026
- 2025GeoVista: Web-Augmented Agentic Visual Reasoning for Geolocalization19 Nov 2025
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Risks30 Jun 2025
- 2025GeoChain: Multimodal Chain-of-Thought for Geographic Reasoning1 Jun 2025
- 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chains24 May 2025
- 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Models22 May 2025
- 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models30 Apr 2025
- 2025Towards Cross-View Point Correspondence in Vision-Language Modelscited by 14
- 2025Where on Earth? A Vision-Language Benchmark for Probing Model Geolocation Skills Across Scalescited by 5
- 2025Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Viewscited by 1
- 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agentscited by 1
- 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigationcited by 0
- 2026GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulationcited by 0
- 2026GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulation14 Oct 2026
- 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation30 Aug 2026
- 2025Towards Cross-View Point Correspondence in Vision-Language Models4 Dec 2025
- 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agents27 Nov 2025
- 2025Where on Earth? A Vision-Language Benchmark for Probing Model Geolocation Skills Across Scales13 Oct 2025
- 2025Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Views3 Jun 2025
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristicscited by 5
- 2026LocationAgent: A Hierarchical Agent for Image Geolocation via Decoupling Strategy and Evidence from Parametric Knowledgecited by 1
- 2026MONETA: Multimodal Industry Classification through Geographic Information with Multi Agent Systemscited by 0
- 2026EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoningcited by 0
- 2026EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoning8 Sep 2026
- 2026MONETA: Multimodal Industry Classification through Geographic Information with Multi Agent Systems9 Apr 2026
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristics13 Feb 2026
- 2026LocationAgent: A Hierarchical Agent for Image Geolocation via Decoupling Strategy and Evidence from Parametric Knowledge27 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024Image-Based Geolocation Using Large Vision-Language Models
- 2026Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approach
- 2025From Pixels to Places: A Systematic Benchmark for Evaluating Image Geolocalization Ability in Large Language Models
- 2026GeoContext: One Context Ladder, Two Failure Modes in Vision-Language Geolocation: Flat Reliance on User-Provided Location Context and False Confirmation of Location Claims
- 2025Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models
- 2024Towards Interactive Global Geolocation Assistant
- 2024GeoReasoner: Geo-localization with Reasoning in Street Views using a Large Vision-Language Model
- 2025GeoRanker: Distance-Aware Ranking for Worldwide Image Geolocalization