GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbations
Not on the map. Why?
Abstract (arXiv)
Vision-Language Models (VLMs) such as GPT-4o now demonstrate a remarkable ability to infer users' locations from public shared images, posing a substantial risk to geoprivacy. Although adversarial perturbations offer a potential defense, current methods are ill-suited for this scenario: they often perform poorly on high-resolution images and low perturbation budgets, and may introduce irrelevant semantic content. To address these limitations, we propose GeoShield, a novel adversarial framework designed for robust geoprivacy protection in real-world scenarios. GeoShield comprises three key modules: a feature disentanglement module that separates geographical and non-geographical information, an exposure element identification module that pinpoints geo-revealing regions within an image, and a scale-adaptive enhancement module that jointly optimizes perturbations at both global and local levels to ensure effectiveness across resolutions. Extensive experiments on challenging benchmarks show that GeoShield consistently surpasses prior methods in black-box settings, achieving strong privacy protection with minimal impact on visual or semantic quality. To our knowledge, this work is the first to explore adversarial perturbations for defending against geolocation inference by advanced VLMs, providing a practical and effective solution to escalating privacy concerns.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 56 of its 66 references that are in the map. First posted on arXiv 5 Aug 2025.
Builds on
56 of 66 references.
References · 56
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023Visual Instruction Tuningcited by 7,869
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2016Adversarial examples in the physical worldcited by 1,769
- 2023A Survey on Multimodal Large Language Modelscited by 909
38 more
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 517
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 284
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 187
- 2023How Robust is Google's Bard to Adversarial Image Attacks?cited by 183
- 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 163
- 2022Towards Adversarial Attack on Vision-Language Pre-training Modelscited by 144
- 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 126
- 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesiscited by 120
- 2023Set-level Guidance Attack: Boosting Adversarial Transferability of Vision-Language Pre-training Modelscited by 108
- 2023Rethinking Model Ensemble in Transfer-based Adversarial Attackscited by 89
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
- 2023VLATTACK: Multimodal Adversarial Attacks on Vision-Language Tasks via Pre-trained Modelscited by 68
- 2020Efficient Adversarial Attacks for Visual Object Trackingcited by 66
- 2023X-Adv: Physical Adversarial Object Attacks against X-ray Prohibited Item Detectioncited by 59
- 2020Adv-watermark: A Novel Watermark Perturbation for Adversarial Examplescited by 56
- 2023PIGEON: Predicting Image Geolocationscited by 56
- 2022A Large-scale Multiple-objective Method for Black-box Attack against Object Detectioncited by 55
- 2023Where We Are and What We're Looking At: Query Based Worldwide Image Geo-localization Using Hierarchies and Scenescited by 55
- 2024AnyAttack: Towards Large-scale Self-supervised Adversarial Attacks on Vision-language Modelscited by 46
- 2025Adversarial Attacks against Closed-Source MLLMs via Feature Optimal Alignmentcited by 43
- 2024Efficient Generation of Targeted and Transferable Adversarial Examples for Vision-Language Models Via Diffusion Modelscited by 38
- 2025A Frustratingly Simple Yet Highly Effective Attack Baseline: Over 90% Success Rate Against the Strong Black-box Models of GPT-4.5/4o/o1cited by 37
- 2024Boosting Transferability in Vision-Language Attacks via Diversification along the Intersection Region of Adversarial Trajectorycited by 36
- 2021Interpretable Semantic Photo Geolocationcited by 32
- 2022Enhancing the Self-Universality for Transferable Targeted Attackscited by 30
- 2025Black-Box Adversarial Attack on Vision Language Models for Autonomous Drivingcited by 24
- 2023Can Vision-Language Models be a Good Guesser? Exploring VLMs for Times and Location Reasoningcited by 22
- 2024LLMGeo: Benchmarking Large Language Models on Image Geolocation In-the-wildcited by 21
- 2024Granular Privacy Control for Geolocation with Vision Language Modelscited by 21
- 2022Watermark Vaccine: Adversarial Attacks to Prevent Watermark Removalcited by 20
- 2024Semantic-Aligned Adversarial Evolution Triangle for High-Transferability Vision-Language Attackcited by 18
- 2025Image Captioning Evaluation in the Age of Multimodal LLMs: Challenges and Future Perspectivescited by 18
- 2025Doxing via the Lens: Revealing Location-related Privacy Leakage on Multi-modal Large Reasoning Modelscited by 14
- 2023GeoLocator: a location-integrated large multimodal model for inferring geo-privacycited by 13
- 2025Evaluating Precise Geolocation Inference Capabilities of Vision Language Modelscited by 12
- 2023Isolation and Induction: Training Robust Deep Neural Networks against Model Stealing Attackscited by 10
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecyclecited by 2
- 2025Why Does Weak-OOD Help? A Further Step Towards Understanding Jailbreaking VLMscited by 1
- 2026Defending from GeoLocalization through Adversarial Road Tripscited by 0
- 2026Hiding in Plain Sight: A Diffusion-based Mitigation of Geolocation Privacy Leakage in Vision-Language Modelscited by 0
- 2026GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulationcited by 0
- 2026GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulation14 Oct 2026
- 2026Hiding in Plain Sight: A Diffusion-based Mitigation of Geolocation Privacy Leakage in Vision-Language Models18 Sep 2026
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecycle5 Aug 2026
- 2026Defending from GeoLocalization through Adversarial Road Trips3 Jul 2026
- 2025Why Does Weak-OOD Help? A Further Step Towards Understanding Jailbreaking VLMs11 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Beyond Pixels: Semantic-aware Typographic Attack for Geo-Privacy Protection
- 2025Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models
- 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agents
- 2026Do Vision-Language Models Respect Contextual Integrity in Location Disclosure?
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Risks
- 2024Image-Based Geolocation Using Large Vision-Language Models
- 2025Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Views
- 2025Disrupting Hierarchical Reasoning: Adversarial Protection for Geographic Privacy in Multimodal Reasoning Models