Object-Level Explanations for Image Geolocation Models: a GeoGuessr use-case
Not on the map. Why?
Abstract (arXiv)
When humans play geolocation games such as GeoGuessr, they rely on concrete visual cues, such as road markings, vegetation, or architectural details, to infer where an image was captured. Whether image geolocation models rely on similar object-level evidence remains difficult to determine, as attribution methods like Grad-CAM typically highlight diffuse regions rather than coherent visual entities, making it difficult to link model predictions to specific objects or perceptible patterns. In this work, we propose an object-centric analysis pipeline to investigate the visual evidence used by geolocation models. Starting from attribution maps, we extract salient regions and segment them into object-like elements. We evaluate their predictive relevance through deletion and insertion tests, comparing attributionguided crops to randomly selected regions with similar coverage. Experiments on a three-country benchmark show that attribution-guided crops consistently retain more information for the model's prediction than random crops. These results suggest that attribution maps can be decomposed into interpretable, perceptible elements, providing a step toward object-level analysis of geolocation models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 17 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
13 of 17 references.
References · 13
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2020Concept Bottleneck Modelscited by 1,032
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
- 2016PlaNet - Photo Geolocation with Convolutional Neural Networkscited by 115
- 2017Revisiting IM2GPS in the Deep Learning Eracited by 80
- 2023PIGEON: Predicting Image Geolocationscited by 56
1 more
Built on by
Not cited yet.