mlsanityData to 14 Oct 2026

Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Framework

arXiv 2502.13759 ↗First posted 19 Feb 2025cs.CVcited by 24

Not on the map. Why?

Abstract (arXiv)

Geolocation, the task of identifying an image's location, requires complex reasoning and is crucial for navigation, monitoring, and cultural preservation. However, current methods often produce coarse, imprecise, and non-interpretable localization. A major challenge lies in the quality and scale of existing geolocation datasets. These datasets are typically small-scale and automatically constructed, leading to noisy data and inconsistent task difficulty, with images that either reveal answers too easily or lack sufficient clues for reliable inference. To address these challenges, we introduce a comprehensive geolocation framework with three key components: GeoComp, a large-scale dataset; GeoCoT, a novel reasoning method; and GeoEval, an evaluation metric, collectively designed to address critical challenges and drive advancements in geolocation research. At the core of this framework is GeoComp (Geolocation Competition Dataset), a large-scale dataset collected from a geolocation game platform involving 740K users over two years. It comprises 25 million entries of metadata and 3 million geo-tagged locations spanning much of the globe, with each location annotated thousands to tens of thousands of times by human users. The dataset offers diverse difficulty levels for detailed analysis and highlights key gaps in current models. Building on this dataset, we propose Geographical Chain-of-Thought (GeoCoT), a novel multi-step reasoning framework designed to enhance the reasoning capabilities of Large Vision Models (LVMs) in geolocation tasks. GeoCoT improves performance by integrating contextual and spatial cues through a multi-step process that mimics human geolocation reasoning. Finally, using the GeoEval metric, we demonstrate that GeoCoT significantly boosts geolocation accuracy by up to 25% while enhancing interpretability.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 32 of its 66 references that are in the map. First posted on arXiv 19 Feb 2025.

Builds on

32 of 66 references.

References · 32

  1. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  3. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  4. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  5. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
  6. 2023An Embodied Generalist Agent in 3D Worldcited by 365
  7. 2024MM1: Methods, Analysis & Insights from Multimodal LLM Pre-trainingcited by 232
  8. 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 187
  9. 2015Wide-Area Image Geolocalization with Aerial Reference Imagerycited by 186
  10. 2019Lending Orientation to Neural Networks for Cross-view Geo-localizationcited by 180
  11. 2022Language models show human-like content effects on reasoning taskscited by 173
  12. 2022TransGeo: Transformer Is All You Need for Cross-view Image Geo-localizationcited by 168
20 more
  1. 2023mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understandingcited by 168
  2. 2016PlaNet - Photo Geolocation with Convolutional Neural Networkscited by 115
  3. 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inferencecited by 97
  4. 2017Revisiting IM2GPS in the Deep Learning Eracited by 80
  5. 2022Cross-view Geo-localization via Learning Disentangled Geometric Layout Correspondencecited by 70
  6. 2018CPlaNet: Enhancing Image Geolocalization by Combinatorial Partitioning of Mapscited by 68
  7. 2022Where in the World is this Image? Transformer-based Geo-localization in the Wildcited by 58
  8. 2023Where We Are and What We're Looking At: Query Based Worldwide Image Geo-localization Using Hierarchies and Scenescited by 55
  9. 2024ControlTraj: Controllable Trajectory Generation with Topology-Constrained Diffusion Modelcited by 49
  10. 2019The StreetLearn Environment and Datasetcited by 42
  11. 2023Learning Generalized Zero-Shot Learners for Open-Domain Image Geolocalizationcited by 41
  12. 2023BenchLMM: Benchmarking Cross-style Visual Capability of Large Multimodal Modelscited by 41
  13. 2024OpenStreetView-5M: The Many Roads to Global Visual Geolocationcited by 38
  14. 2021Interpretable Semantic Photo Geolocationcited by 32
  15. 2024Img2Loc: Revisiting Image Geolocalization using Multi-modality Foundation Models and Image-based Retrieval-Augmented Generationcited by 32
  16. 2024Universal Adversarial Perturbations for Vision-Language Pre-trained Modelscited by 31
  17. 2024Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Modelscited by 24
  18. 2023MLPST: MLP is All You Need for Spatio-Temporal Predictioncited by 22
  19. 2023PromptST: Prompt-Enhanced Spatio-Temporal Multi-Attribute Predictioncited by 20
  20. 2022MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learningcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 14; 2026: 10.

24 papers.

Sort:

By area:

  1. 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Modelscited by 44
  2. 2025Recognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Modelscited by 28
  3. 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Modelscited by 27
  4. 2025Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Modelscited by 21
  5. 2025PresentAgent: Multimodal Agent for Presentation Video Generationcited by 21
  6. 2025GeoChain: Multimodal Chain-of-Thought for Geographic Reasoningcited by 16
  7. 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chainscited by 14
  8. 2025Towards Cross-View Point Correspondence in Vision-Language Modelscited by 14
  9. 2025GeoVista: Web-Augmented Agentic Visual Reasoning for Geolocalizationcited by 11
  10. 2025VaseVQA: Multimodal Agent and Benchmark for Ancient Greek Potterycited by 6
  11. 2025Where on Earth? A Vision-Language Benchmark for Probing Model Geolocation Skills Across Scalescited by 5
  12. 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristicscited by 5
12 more
  1. 2026TextAlign: Preference Alignment for Text Rendering with Hierarchical Rewardscited by 5
  2. 2026GeoRC: A Benchmark for Geolocation Reasoning Chainscited by 4
  3. 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Riskscited by 3
  4. 2026Learning to Wander: Improving the Global Image Geolocation Ability of LMMs via Actionable Reasoningcited by 3
  5. 2026GeoBrowse: A Geolocation Benchmark for Agentic Tool Use with Expert-Annotated Reasoning Tracescited by 3
  6. 2025Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Viewscited by 1
  7. 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agentscited by 1
  8. 2026LocationAgent: A Hierarchical Agent for Image Geolocation via Decoupling Strategy and Evidence from Parametric Knowledgecited by 1
  9. 2026MONETA: Multimodal Industry Classification through Geographic Information with Multi Agent Systemscited by 0
  10. 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigationcited by 0
  11. 2026EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoningcited by 0
  12. 2026GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Image-Based Geolocation Using Large Vision-Language Models
  2. 2026Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approach
  3. 2025From Pixels to Places: A Systematic Benchmark for Evaluating Image Geolocalization Ability in Large Language Models
  4. 2026GeoContext: One Context Ladder, Two Failure Modes in Vision-Language Geolocation: Flat Reliance on User-Provided Location Context and False Confirmation of Location Claims
  5. 2025Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models
  6. 2024Towards Interactive Global Geolocation Assistant
  7. 2024GeoReasoner: Geo-localization with Reasoning in Street Views using a Large Vision-Language Model
  8. 2025GeoRanker: Distance-Aware Ranking for Worldwide Image Geolocalization