Disrupting Hierarchical Reasoning: Adversarial Protection for Geographic Privacy in Multimodal Reasoning Models
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Multi-modal large reasoning models (MLRMs) pose significant privacy risks by inferring precise geographic locations from personal images through hierarchical chain-of-thought reasoning. Existing privacy protection techniques, primarily designed for perception-based models, prove ineffective against MLRMs' sophisticated multi-step reasoning processes that analyze environmental cues. We introduce ReasonBreak, a novel adversarial framework specifically designed to disrupt hierarchical reasoning in MLRMs through concept-aware perturbations. Our approach is founded on the key insight that effective disruption of geographic reasoning requires perturbations aligned with conceptual hierarchies rather than uniform noise. ReasonBreak strategically targets critical conceptual dependencies within reasoning chains, generating perturbations that invalidate specific inference steps and cascade through subsequent reasoning stages. To facilitate this approach, we contribute GeoPrivacy-6K, a comprehensive dataset comprising 6,341 ultra-high-resolution images (≥2K) with hierarchical concept annotations. Extensive evaluation across seven state-of-the-art MLRMs (including GPT-o3, GPT-5, Gemini 2.5 Pro) demonstrates ReasonBreak's superior effectiveness, achieving a 14.4% improvement in tract-level protection (33.8% vs 19.4%) and nearly doubling block-level protection (33.5% vs 16.8%). This work establishes a new paradigm for privacy protection against reasoning-based threats.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 12 of its 40 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
12 of 40 references.
Closest ancestors · 1
Same direction, newest first
- 2024OpenAI o1 System Card21 Dec
Other references · 11
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2013Intriguing properties of neural networkscited by 5,114
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2024Jailbreaking Attack against Multimodal Large Language Modelcited by 128
- 2024White-box Multimodal Jailbreaks Against Large Vision-Language Modelscited by 57
- 2025A Frustratingly Simple Yet Highly Effective Attack Baseline: Over 90% Success Rate Against the Strong Black-box Models of GPT-4.5/4o/o1cited by 34
- 2020HoliCity: A City-Scale Data Platform for Learning Holistic 3D Structurescited by 28
- 2024Failures to Find Transferable Image Jailbreaks Between Vision-Language Modelscited by 27
- 2025Doxing via the Lens: Revealing Location-related Privacy Leakage on Multi-modal Large Reasoning Modelscited by 14
- 2024Boosting the Transferability of Adversarial Examples via Local Mixup and Adaptive Step Sizecited by 7
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025MultiPriv: Benchmarking Individual-Level Privacy Reasoning in Vision-Language Models
- 2026Do Vision-Language Models Respect Contextual Integrity in Location Disclosure?
- 2025GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbations
- 2026On the Efficiency-Safety Dilemma in Large Reasoning Models
- 2025Assessing Visual Privacy Risks in Multimodal AI: A Novel Taxonomy-Grounded Evaluation of Vision-Language Models
- 2025Evaluation of Geolocation Capabilities of Multimodal Large Language Models and Analysis of Associated Privacy Risks
- 2025Distractor Injection Attacks on Large Reasoning Models: Characterization and Defense
- 2026Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMs