Do Vision-Language Models Respect Contextual Integrity in Location Disclosure?
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Vision-language models (VLMs) have demonstrated strong performance in image geolocation, a capability further sharpened by frontier multimodal large reasoning models (MLRMs). This poses a significant privacy risk, as these widely accessible models can be exploited to infer sensitive locations from casually shared photos, often at street-level precision, potentially surpassing the level of detail the sharer consented or intended to disclose. While recent work has proposed applying a blanket restriction on geolocation disclosure to combat this risk, these measures fail to distinguish valid geolocation uses from malicious behavior. Instead, VLMs should maintain contextual integrity by reasoning about elements within an image to determine the appropriate level of information disclosure, balancing privacy and utility. To evaluate how well models respect contextual integrity, we introduce VLM-GEOPRIVACY, a benchmark that challenges VLMs to interpret latent social norms and contextual cues in real-world images and determine the appropriate level of location disclosure. Our evaluation of 14 leading VLMs shows that, despite their ability to precisely geolocate images, the models are poorly aligned with human privacy expectations. They often over-disclose in sensitive contexts and are vulnerable to prompt-based attacks. Our results call for new design principles in multimodal systems to incorporate context-conditioned privacy reasoning.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 35 of its 57 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
35 of 57 references.
Closest ancestors · 4
Same direction, newest first
- 2025GeoArena: Evaluating Open-World Geographic Reasoning in Large Vision-Language Models4 Sep
- 2025Recognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Models17 Jun
- 2024MapEval: A Map-Based Evaluation of Geo-Spatial Reasoning in Foundation Models31 Dec
- 2024Swarm Intelligence in Geo-Localization: A Multi-Agent Large Vision-Language Model Collaborative Framework21 Aug
Other references · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2024GPT-4o System Cardcited by 4,467
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
- 2015VQA: Visual Question Answeringcited by 2,489
- 2024Phi-4 Technical Reportcited by 675
- 2016Visual Dialogcited by 377
- 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 218
- 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 203
19 more
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 185
- 2023Beyond Memorization: Violating Privacy Via Inference with Large Language Modelscited by 167
- 2024PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Actioncited by 161
- 2017Revisiting IM2GPS in the Deep Learning Eracited by 79
- 2023PIGEON: Predicting Image Geolocationscited by 55
- 2024Private Attribute Inference from Images with Vision-Language Modelscited by 35
- 2021Interpretable Semantic Photo Geolocationcited by 32
- 2023Deepfakes, Phrenology, Surveillance, and More! A Taxonomy of AI Privacy Riskscited by 31
- 2024Img2Loc: Revisiting Image Geolocalization using Multi-modality Foundation Models and Image-based Retrieval-Augmented Generationcited by 31
- 2025Contextual Integrity in LLMs via Reasoning and Reinforcement Learningcited by 30
- 2021Constructing Multi-Modal Dialogue Dataset by Replacing Text with Semantically Relevant Imagescited by 26
- 2024Granular Privacy Control for Geolocation with Vision Language Modelscited by 19
- 2025Searching for Privacy Risks in LLM Agents via Simulationcited by 19
- 2024Image-Based Geolocation Using Large Vision-Language Modelscited by 17
- 2025AI Sees Your Location, But With A Bias Toward The Wealthy Worldcited by 14
- 2023GeoLocator: a location-integrated large multimodal model for inferring geo-privacycited by 13
- 2025Evaluating Precise Geolocation Inference Capabilities of Vision Language Modelscited by 12
- 2025Where on Earth? A Vision-Language Benchmark for Probing Model Geolocation Skills Across Scalescited by 5
- 2025Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Modelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Risks
- 2025Doxing via the Lens: Revealing Location-related Privacy Leakage on Multi-modal Large Reasoning Models
- 2026Hiding in Plain Sight: A Diffusion-based Mitigation of Geolocation Privacy Leakage in Vision-Language Models
- 2025Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Views
- 2025GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agents
- 2025GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbations
- 2025Beyond Pixels: Semantic-aware Typographic Attack for Geo-Privacy Protection
- 2025From Pixels to Places: A Systematic Benchmark for Evaluating Image Geolocalization Ability in Large Language Models