Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Risks
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Objectives: The rapid advancement of Multimodal Large Language Models (MLLMs) has significantly enhanced their reasoning capabilities, enabling a wide range of intelligent applications. However, these advancements also raise critical concerns regarding privacy and ethics. MLLMs are now capable of inferring the geographic location of images -- such as those shared on social media or captured from street views -- based solely on visual content, thereby posing serious risks of privacy invasion, including doxxing, surveillance, and other security threats. Methods: This study provides a comprehensive analysis of existing geolocation techniques based on MLLMs. It systematically reviews relevant litera-ture and evaluates the performance of state-of-the-art visual reasoning models on geolocation tasks, particularly in identifying the origins of street view imagery. Results: Empirical evaluation reveals that the most advanced visual large models can successfully localize the origin of street-level imagery with up to 49% accuracy within a 1-kilometer radius. This performance underscores the models' powerful capacity to extract and utilize fine-grained geographic cues from visual data. Conclusions: Building on these findings, the study identifies key visual elements that contribute to suc-cessful geolocation, such as text, architectural styles, and environmental features. Furthermore, it discusses the potential privacy implications associated with MLLM-enabled geolocation and discuss several technical and policy-based coun-termeasures to mitigate associated risks. Our code and dataset are available at https://github.com/zxyl1003/MLLM-Geolocation-Evaluation.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 15 of its 19 references that are in the map. First posted on arXiv 30 Jun 2025.
Builds on
15 of 19 references.
References · 15
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 185
- 2023Learning Generalized Zero-Shot Learners for Open-Domain Image Geolocalizationcited by 41
- 2024Where am I? Cross-View Geo-localization with Natural Language Descriptionscited by 38
- 2025A Survey on Mechanistic Interpretability for Multi-Modal Foundation Modelscited by 34
- 2025Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Frameworkcited by 23
- 2024LLMGeo: Benchmarking Large Language Models on Image Geolocation In-the-wildcited by 21
- 2024AddressCLIP: Empowering Vision-Language Models for City-wide Image Address Localizationcited by 21
- 2024Granular Privacy Control for Geolocation with Vision Language Modelscited by 19
- 2024Image-Based Geolocation Using Large Vision-Language Modelscited by 17
3 more
- 2025Doxing via the Lens: Revealing Location-related Privacy Leakage on Multi-modal Large Reasoning Modelscited by 14
- 2025GeoLocSFT: Efficient Visual Geolocation via Supervised Fine-Tuning of Multimodal Foundation Modelscited by 9
- 2025NAVIG: Natural Language-guided Analysis with Vision Language Models for Image Geo-localizationcited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026ERGeoBench:A Comprehensive Benchmark for Embodied Reasoning and Geo-localization in Multimodal Large Language Modelscited by 0
- 2026Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMscited by 0
- 2026Hiding in Plain Sight: A Diffusion-based Mitigation of Geolocation Privacy Leakage in Vision-Language Modelscited by 0
- 2026Hiding in Plain Sight: A Diffusion-based Mitigation of Geolocation Privacy Leakage in Vision-Language Models18 Sep 2026
- 2026Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMs5 Jun 2026
- 2026ERGeoBench:A Comprehensive Benchmark for Embodied Reasoning and Geo-localization in Multimodal Large Language Models29 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Evaluating Precise Geolocation Inference Capabilities of Vision Language Models
- 2025Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models
- 2026Do Vision-Language Models Respect Contextual Integrity in Location Disclosure?
- 2025Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Views
- 2025From Pixels to Places: A Systematic Benchmark for Evaluating Image Geolocalization Ability in Large Language Models
- 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agents
- 2025AI Sees Your Location, But With A Bias Toward The Wealthy World
- 2023GeoLocator: a location-integrated large multimodal model for inferring geo-privacy