# GeoContext: One Context Ladder, Two Failure Modes in Vision-Language Geolocation: Flat Reliance on User-Provided Location Context and False Confirmation of Location Claims

arXiv: https://arxiv.org/abs/2609.05761 · HTML: https://mlsanity.com/paper/2609.05761/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 11 of its 24 references that are in the map.
- First posted on arXiv 4 Sep 2026.

## Builds on (most cited first, 11 of 11)

- [Where We Are and What We're Looking At: Query Based Worldwide Image Geo-localization Using Hierarchies and Scenes](https://mlsanity.com/paper/2303.04249/) (2023)
- [From Pixels to Places: A Systematic Benchmark for Evaluating Image Geolocalization Ability in Large Language Models](https://mlsanity.com/paper/2508.01608/) (2025)
- [Content-Aware Detection of Temporal Metadata Manipulation](https://mlsanity.com/paper/2103.04736/) (2021)
- [DuMapper: Towards Automatic Verification of Large-Scale POIs with Street Views at Baidu Maps](https://mlsanity.com/paper/2411.18073/) (2024)
- [Where on Earth? A Vision-Language Benchmark for Probing Model Geolocation Skills Across Scales](https://mlsanity.com/paper/2510.10880/) (2025)
- [GeoX-Bench: Benchmarking Cross-View Geo-Localization and Pose Estimation Capabilities of Large Multimodal Models](https://mlsanity.com/paper/2511.13259/) (2025)
- [GeoRC: A Benchmark for Geolocation Reasoning Chains](https://mlsanity.com/paper/2601.21278/) (2026)
- [Validating the Contextual Information of Outdoor Images for Photo Misuse Detection](https://mlsanity.com/paper/1811.08951/) (2018)
- [Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Views](https://mlsanity.com/paper/2506.03371/) (2025)
- [HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoning](https://mlsanity.com/paper/2607.15255/) (2026)
- [SIGNPOST-Bench: Benchmarking Text-Vision Conflict Resolution in Multimodal Large Language Models](https://mlsanity.com/paper/2608.04244/) (2026)

## Abstract (arXiv)

Visual geolocation benchmarks typically ask a model where an image was captured without accounting for the location context that users often provide. We introduce GeoContext, a resource supporting two complementary tasks: GeoHint, open-ended localization given a true but coarse location hint, and GeoVerify, binary verification of whether an image was taken within 150 m of a claimed place. GeoContext constructs a context ladder by stratifying nearby reference points according to distance and referenceability, allowing the image to remain fixed while the supplied context varies. The benchmark covers 109 sites in 30 cities and evaluates five vision-language models using 21,933 GeoHint responses and 6,270 GeoVerify responses. Our evaluation reveals three main patterns. First, hint repetition varies by only 1.5 percentage points across referenceability tiers and by less than 3 points across distance bands, while the resulting localization error increases steadily with hint distance. Second, behavior depends strongly on no-context performance: at sites with low no-context accuracy, the median ratio between localization error and hint distance is approximately 1.00, whereas at higher-accuracy sites it ranges from 0.24 to 0.69. After correcting for bias introduced by the site grouping procedure, only one of the five models retains a negative accuracy estimate when given a nearby hint. Third, in GeoVerify, no model reaches d' = 1 for decoys immediately beyond the 150 m tolerance. Model rankings also change when sensitivity is separated from response bias, and 83.8% of false acceptances are reported with confidence of at least 0.8. We release the benchmark, construction pipeline, audit decisions, and scoring code.