GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agents
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Images shared on social media often expose geographic cues. While early geolocation methods required expert effort and lacked generalization, the rise of Large Vision Language Models (LVLMs) now enables accurate geolocation even for ordinary users. However, existing approaches are not optimized for this task. To explore the full potential and associated privacy risks, we present Geo-Detective, an agent that mimics human reasoning and tool use for image geolocation inference. It follows a procedure with four steps that adaptively selects strategies based on image difficulty and is equipped with specialized tools such as visual reverse search, which emulates how humans gather external geographic clues. Experimental results show that GEO-Detective outperforms baseline large vision language models (LVLMs) overall, particularly on images lacking visible geographic features. In country level geolocation tasks, it achieves an improvement of over 11.1% compared to baseline LLMs, and even at finer grained levels, it still provides around a 5.2% performance gain. Meanwhile, when equipped with external clues, GEO-Detective becomes more likely to produce accurate predictions, reducing the "unknown" prediction rate by more than 50.6%. We further explore multiple defense strategies and find that Geo-Detective exhibits stronger robustness, highlighting the need for more effective privacy safeguards.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 30 of its 46 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
30 of 46 references.
Closest ancestors · 4
Same direction, newest first
- 2025GeoChain: Multimodal Chain-of-Thought for Geographic Reasoning1 Jun
- 2024Image-Based Geolocation Using Large Vision-Language Models18 Aug
- 2024Granular Privacy Control for Geolocation with Vision Language Models6 Jul
- 2024LLMGeo: Benchmarking Large Language Models on Image Geolocation In-the-wild30 May
Other references · 26
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Visual Instruction Tuningcited by 7,792
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 185
- 2016PlaNet - Photo Geolocation with Convolutional Neural Networkscited by 114
- 2017Towards a Visual Privacy Advisor: Understanding and Predicting Privacy Risks in Imagescited by 101
- 2025Words or Vision: Do Vision-Language Models Have Blind Faith in Text?cited by 86
- 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Modelscited by 83
- 2017Revisiting IM2GPS in the Deep Learning Eracited by 79
- 2024Safety of Multimodal Large Language Models on Images and Textscited by 70
14 more
- 2018CPlaNet: Enhancing Image Geolocalization by Combinatorial Partitioning of Mapscited by 68
- 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 67
- 2023Learning Generalized Zero-Shot Learners for Open-Domain Image Geolocalizationcited by 41
- 2024Private Attribute Inference from Images with Vision-Language Modelscited by 35
- 2024TrojVLM: Backdoor Attack Against Vision Language Modelscited by 35
- 2024G3: An Effective and Adaptive Framework for Worldwide Geolocalization Using Large Multi-Modality Modelscited by 33
- 2025Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Frameworkcited by 23
- 2025Rex-Thinker: Grounded Object Referring via Chain-of-Thought Reasoningcited by 23
- 2024Mission Impossible: A Statistical Perspective on Jailbreaking LLMscited by 21
- 2025GeoRanker: Distance-Aware Ranking for Worldwide Image Geolocalizationcited by 18
- 2023GeoLocator: a location-integrated large multimodal model for inferring geo-privacycited by 13
- 2018DeepGeo: Photo Localization with Deep Neural Networkcited by 8
- 2017An Analysis of Human-centered Geolocationcited by 1
- 2025Text Prompt Injection of Vision Language Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Evaluating Precise Geolocation Inference Capabilities of Vision Language Models
- 2025Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Risks
- 2026Do Vision-Language Models Respect Contextual Integrity in Location Disclosure?
- 2026Hiding in Plain Sight: A Diffusion-based Mitigation of Geolocation Privacy Leakage in Vision-Language Models
- 2025Doxing via the Lens: Revealing Location-related Privacy Leakage on Multi-modal Large Reasoning Models
- 2025GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbations
- 2025From Pixels to Places: A Systematic Benchmark for Evaluating Image Geolocalization Ability in Large Language Models