Learning Generalized Zero-Shot Learners for Open-Domain Image Geolocalization
Not on the map. Why?
Abstract (arXiv)
Image geolocalization is the challenging task of predicting the geographic coordinates of origin for a given photo. It is an unsolved problem relying on the ability to combine visual clues with general knowledge about the world to make accurate predictions across geographies. We present hrefhttps://huggingface.co/geolocal/StreetCLIPStreetCLIP, a robust, publicly available foundation model not only achieving state-of-the-art performance on multiple open-domain image geolocalization benchmarks but also doing so in a zero-shot setting, outperforming supervised models trained on more than 4 million images. Our method introduces a meta-learning approach for generalized zero-shot learning by pretraining CLIP from synthetic captions, grounding CLIP in a domain of choice. We show that our method effectively transfers CLIP's generalized zero-shot capabilities to the domain of image geolocalization, improving in-domain generalized zero-shot performance without finetuning StreetCLIP on a fixed set of classes.
Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). Builds on 17 of its 35 references that are in the map. First posted on arXiv 1 Feb 2023.
Builds on
17 of 35 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Supervised Contrastive Learningcited by 2,829
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2021Robust fine-tuning of zero-shot modelscited by 797
- 2021How Much Can CLIP Benefit Vision-and-Language Tasks?cited by 321
- 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
- 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 163
- 2020A Review of Generalized Zero-Shot Learning Methodscited by 159
- 2016PlaNet - Photo Geolocation with Convolutional Neural Networkscited by 115
- 2022Deep Visual Geo-localization Benchmarkcited by 84
- 2017Revisiting IM2GPS in the Deep Learning Eracited by 80
5 more
- 2022Where in the World is this Image? Transformer-based Geo-localization in the Wildcited by 58
- 2022Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learningcited by 40
- 2015Artificial Neural Networks Applied to Taxi Destination Predictioncited by 18
- 2022G^3: Geolocation via Guidebook Groundingcited by 12
- 2018DeepGeo: Photo Localization with Deep Neural Networkcited by 8
Built on by
Citing papers per year: 2023: 3; 2024: 11; 2025: 13; 2026: 14.
41 papers.
Sort:
By area:
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 163
- 2023PIGEON: Predicting Image Geolocationscited by 56
- 2024OpenStreetView-5M: The Many Roads to Global Visual Geolocationcited by 38
- 2025Recognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Modelscited by 28
- 2024GeoReasoner: Geo-localization with Reasoning in Street Views using a Large Vision-Language Modelcited by 27
- 2025Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Frameworkcited by 24
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
- 2024Around the World in 80 Timesteps: A Generative Approach to Global Visual Geolocationcited by 23
- 2024AddressCLIP: Empowering Vision-Language Models for City-wide Image Address Localizationcited by 21
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodalitycited by 19
- 2024Learning Cross-view Visual Geo-localization without Ground Truthcited by 18
- 2024Towards Interactive Global Geolocation Assistantcited by 11
29 more
- 2025Scaling Image Geo-Localization to Continent Levelcited by 10
- 2024A citizen science toolkit to collect human perceptions of urban environments using open street view imagescited by 9
- 2024Unsupervised Multi-view UAV Image Geo-localization via Iterative Renderingcited by 9
- 2025NAVIG: Natural Language-guided Analysis with Vision Language Models for Image Geo-localizationcited by 8
- 2026SpotAgent: Grounding Visual Geo-localization in Large Vision-Language Models through Agentic Reasoningcited by 7
- 2026Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approachcited by 6
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristicscited by 5
- 2026GeoRC: A Benchmark for Geolocation Reasoning Chainscited by 4
- 2025GeoExplain: Multimodal Reasoning based on Hierarchy of Visual Information in Street Viewcited by 3
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Riskscited by 3
- 2025AddressVLM: Cross-view Alignment Tuning for Image Address Localization using Large Vision-Language Modelscited by 3
- 2026Learning to Wander: Improving the Global Image Geolocation Ability of LMMs via Actionable Reasoningcited by 3
- 2024Audio-Visual Generalized Zero-Shot Learning using Pre-Trained Large Multi-Modal Modelscited by 2
- 2025Bayesian Modeling of Zero-Shot Classifications for Urban Flood Detectioncited by 2
- 2025VLM-Guided Visual Place Recognition for Planet-Scale Geo-Localizationcited by 2
- 2025Street-Level Geolocalization Using Multimodal Large Language Models and Retrieval-Augmented Generationcited by 2
- 2023An unsupervised approach towards promptable defect segmentation in laser-based additive manufacturing by Segment Anythingcited by 1
- 2024Learning to Rank Pre-trained Vision-Language Models for Downstream Taskscited by 1
- 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agentscited by 1
- 2026HierLoc: Hyperbolic Entity Embeddings for Hierarchical Visual Geolocationcited by 1
- 2026VidTAG: Temporally Aligned Video to GPS Geolocalization with Denoising Sequence Prediction at a Global Scalecited by 1
- 2026HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoningcited by 1
- 2025MMLANDMARKS: a Cross-View Instance-Level Benchmark for Geo-Spatial Understandingcited by 0
- 2026DamageArbiter: A Multimodal Arbitration Framework for Disaster Damage Assessment from Street-View Imagerycited by 0
- 2026GeoRouter: Dynamic Paradigm Routing for Worldwide Image Geolocalizationcited by 0
- 2026Zero-shot Vision-Language Reranking for Cross-View Geolocalizationcited by 0
- 2026One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensemblingcited by 0
- 2026GeoSEAN: Explainable Country-Level Image Geolocation for ASEAN Regionscited by 0
- 2026What Does CLIP Learn for Regional Geolocalization? Probing Visual Cues and Scene Configuration After Adaptationcited by 0
- 2026What Does CLIP Learn for Regional Geolocalization? Probing Visual Cues and Scene Configuration After Adaptation22 Aug 2026
- 2026HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoning16 Jul 2026
- 2026GeoSEAN: Explainable Country-Level Image Geolocation for ASEAN Regions14 Jul 2026
- 2026One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensembling6 Jun 2026
- 2026VidTAG: Temporally Aligned Video to GPS Geolocalization with Denoising Sequence Prediction at a Global Scale14 Apr 2026
- 2026Zero-shot Vision-Language Reranking for Cross-View Geolocalization28 Mar 2026
- 2026GeoRouter: Dynamic Paradigm Routing for Worldwide Image Geolocalization25 Mar 2026
- 2026DamageArbiter: A Multimodal Arbitration Framework for Disaster Damage Assessment from Street-View Imagery16 Mar 2026
- 2026Learning to Wander: Improving the Global Image Geolocation Ability of LMMs via Actionable Reasoning11 Mar 2026
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristics13 Feb 2026
- 2026SpotAgent: Grounding Visual Geo-localization in Large Vision-Language Models through Agentic Reasoning10 Feb 2026
- 2026HierLoc: Hyperbolic Entity Embeddings for Hierarchical Visual Geolocation30 Jan 2026
29 more
- 2026GeoRC: A Benchmark for Geolocation Reasoning Chains29 Jan 2026
- 2026Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approach1 Jan 2026
- 2025MMLANDMARKS: a Cross-View Instance-Level Benchmark for Geo-Spatial Understanding19 Dec 2025
- 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agents27 Nov 2025
- 2025Scaling Image Geo-Localization to Continent Level30 Oct 2025
- 2025Street-Level Geolocalization Using Multimodal Large Language Models and Retrieval-Augmented Generation1 Sep 2025
- 2025AddressVLM: Cross-view Alignment Tuning for Image Address Localization using Large Vision-Language Models14 Aug 2025
- 2025VLM-Guided Visual Place Recognition for Planet-Scale Geo-Localization23 Jul 2025
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Risks30 Jun 2025
- 2025GeoExplain: Multimodal Reasoning based on Hierarchy of Visual Information in Street View19 Jun 2025
- 2025Recognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Models17 Jun 2025
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodality28 Mar 2025
- 2025Bayesian Modeling of Zero-Shot Classifications for Urban Flood Detection18 Mar 2025
- 2025NAVIG: Natural Language-guided Analysis with Vision Language Models for Image Geo-localization20 Feb 2025
- 2025Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Framework19 Feb 2025
- 2024Learning to Rank Pre-trained Vision-Language Models for Downstream Tasks30 Dec 2024
- 2024Towards Interactive Global Geolocation Assistant12 Dec 2024
- 2024Around the World in 80 Timesteps: A Generative Approach to Global Visual Geolocation9 Dec 2024
- 2024Unsupervised Multi-view UAV Image Geo-localization via Iterative Rendering22 Nov 2024
- 2024AddressCLIP: Empowering Vision-Language Models for City-wide Image Address Localization11 Jul 2024
- 2024GeoReasoner: Geo-localization with Reasoning in Street Views using a Large Vision-Language Model3 Jun 2024
- 2024OpenStreetView-5M: The Many Roads to Global Visual Geolocation29 Apr 2024
- 2024Audio-Visual Generalized Zero-Shot Learning using Pre-Trained Large Multi-Modal Models9 Apr 2024
- 2024Learning Cross-view Visual Geo-localization without Ground Truth19 Mar 2024
- 2024A citizen science toolkit to collect human perceptions of urban environments using open street view images29 Feb 2024
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models30 Jan 2024
- 2023An unsupervised approach towards promptable defect segmentation in laser-based additive manufacturing by Segment Anything7 Dec 2023
- 2023AnyLoc: Towards Universal Visual Place Recognition1 Aug 2023
- 2023PIGEON: Predicting Image Geolocations11 Jul 2023
- 2024GeoReasoner: Geo-localization with Reasoning in Street Views using a Large Vision-Language Modelcited by 27
- 2026SpotAgent: Grounding Visual Geo-localization in Large Vision-Language Models through Agentic Reasoningcited by 7
- 2026Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approachcited by 6
- 2026GeoRC: A Benchmark for Geolocation Reasoning Chainscited by 4
- 2025GeoExplain: Multimodal Reasoning based on Hierarchy of Visual Information in Street Viewcited by 3
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Riskscited by 3
- 2026Learning to Wander: Improving the Global Image Geolocation Ability of LMMs via Actionable Reasoningcited by 3
- 2026HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoningcited by 1
- 2026HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoning16 Jul 2026
- 2026Learning to Wander: Improving the Global Image Geolocation Ability of LMMs via Actionable Reasoning11 Mar 2026
- 2026SpotAgent: Grounding Visual Geo-localization in Large Vision-Language Models through Agentic Reasoning10 Feb 2026
- 2026GeoRC: A Benchmark for Geolocation Reasoning Chains29 Jan 2026
- 2026Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approach1 Jan 2026
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Risks30 Jun 2025
- 2025GeoExplain: Multimodal Reasoning based on Hierarchy of Visual Information in Street View19 Jun 2025
- 2024GeoReasoner: Geo-localization with Reasoning in Street Views using a Large Vision-Language Model3 Jun 2024
- 2025NAVIG: Natural Language-guided Analysis with Vision Language Models for Image Geo-localizationcited by 8
- 2025AddressVLM: Cross-view Alignment Tuning for Image Address Localization using Large Vision-Language Modelscited by 3
- 2024Audio-Visual Generalized Zero-Shot Learning using Pre-Trained Large Multi-Modal Modelscited by 2
- 2025Street-Level Geolocalization Using Multimodal Large Language Models and Retrieval-Augmented Generationcited by 2
- 2024Learning to Rank Pre-trained Vision-Language Models for Downstream Taskscited by 1
- 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agentscited by 1
- 2026One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensemblingcited by 0
- 2026One Stone, Three Birds: Self-adaptive Optimal Transport for Multi-VLM Selection, Adaptation, and Ensembling6 Jun 2026
- 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agents27 Nov 2025
- 2025Street-Level Geolocalization Using Multimodal Large Language Models and Retrieval-Augmented Generation1 Sep 2025
- 2025AddressVLM: Cross-view Alignment Tuning for Image Address Localization using Large Vision-Language Models14 Aug 2025
- 2025NAVIG: Natural Language-guided Analysis with Vision Language Models for Image Geo-localization20 Feb 2025
- 2024Learning to Rank Pre-trained Vision-Language Models for Downstream Tasks30 Dec 2024
- 2024Audio-Visual Generalized Zero-Shot Learning using Pre-Trained Large Multi-Modal Models9 Apr 2024
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 163
- 2023PIGEON: Predicting Image Geolocationscited by 56
- 2024OpenStreetView-5M: The Many Roads to Global Visual Geolocationcited by 38
- 2025Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Frameworkcited by 24
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
- 2024Around the World in 80 Timesteps: A Generative Approach to Global Visual Geolocationcited by 23
- 2024AddressCLIP: Empowering Vision-Language Models for City-wide Image Address Localizationcited by 21
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodalitycited by 19
- 2024Learning Cross-view Visual Geo-localization without Ground Truthcited by 18
- 2024Towards Interactive Global Geolocation Assistantcited by 11
- 2025Scaling Image Geo-Localization to Continent Levelcited by 10
- 2024A citizen science toolkit to collect human perceptions of urban environments using open street view imagescited by 9
12 most cited of 25 All 25 (JSON)
- 2026What Does CLIP Learn for Regional Geolocalization? Probing Visual Cues and Scene Configuration After Adaptation22 Aug 2026
- 2026GeoSEAN: Explainable Country-Level Image Geolocation for ASEAN Regions14 Jul 2026
- 2026VidTAG: Temporally Aligned Video to GPS Geolocalization with Denoising Sequence Prediction at a Global Scale14 Apr 2026
- 2026Zero-shot Vision-Language Reranking for Cross-View Geolocalization28 Mar 2026
- 2026GeoRouter: Dynamic Paradigm Routing for Worldwide Image Geolocalization25 Mar 2026
- 2026DamageArbiter: A Multimodal Arbitration Framework for Disaster Damage Assessment from Street-View Imagery16 Mar 2026
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristics13 Feb 2026
- 2026HierLoc: Hyperbolic Entity Embeddings for Hierarchical Visual Geolocation30 Jan 2026
- 2025MMLANDMARKS: a Cross-View Instance-Level Benchmark for Geo-Spatial Understanding19 Dec 2025
- 2025Scaling Image Geo-Localization to Continent Level30 Oct 2025
- 2025VLM-Guided Visual Place Recognition for Planet-Scale Geo-Localization23 Jul 2025
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodality28 Mar 2025
12 newest of 25 All 25 (JSON)