When Privacy Meets Recovery: The Overlooked Half of Surrogate-Driven Privacy Preservation for MLLM Editing
Not on the map. Why?
Abstract (arXiv)
Privacy leakage in Multimodal Large Language Models (MLLMs) has long been an intractable problem. Existing studies, though effectively obscure private information in MLLMs, often overlook the evaluation of the authenticity and recovery quality of user privacy. To this end, this work uniquely focuses on the critical challenge of how to restore surrogate-driven protected data in diverse MLLM scenarios. We first bridge this research gap by contributing the SPPE (Surrogate Privacy Protected Editable) dataset, which includes a wide range of privacy categories and user instructions to simulate real MLLM applications. This dataset offers protected surrogates alongside their various MLLM-edited versions, thus enabling the direct assessment of privacy recovery quality. By formulating privacy recovery as a guided generation task conditioned on complementary multimodal signals, we further introduce a unified approach that reliably reconstructs private content while preserving the fidelity of MLLM-generated edits. The experiments on both SPPE and InstructPix2Pix further show that our approach generalizes well across diverse visual content and editing tasks, achieving a strong balance between privacy protection and MLLM usability.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 13 of its 24 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
13 of 24 references.
References · 13
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2023Generating Images with Multimodal Language Modelscited by 259
- 2023Making LLaMA SEE and Draw with SEED Tokenizercited by 184
- 2017Towards a Visual Privacy Advisor: Understanding and Predicting Privacy Risks in Imagescited by 101
- 2019Live Face De-Identification in Videocited by 48
- 2017Connecting Pixels to Privacy and Utility: Automatic Redaction of Private Information in Imagescited by 24
- 2025Edit Transfer: Learning Image Editing via Vision In-Context Relationscited by 23
- 2022Realistic Full-Body Anonymization with Surface-Guided GANscited by 15
- 2023Differentially Private Decoupled Graph Convolutions for Multigranular Topology Protectioncited by 12
- 2025ReVision: A Dataset and Baseline VLM for Privacy-Preserving Task-Oriented Visual Instruction Rewritingcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMs
- 2026When Visual Privacy Protection Meets Multimodal Large Language Models
- 2026Unveiling Privacy Risks in Multi-modal Large Language Models: Task-specific Vulnerabilities and Mitigation Challenges
- 2024Multi-PA: A Multi-perspective Benchmark on Privacy Assessment for Large Vision-Language Models
- 2026Unsafe2Safe: Controllable Image Anonymization for Downstream Utility
- 2025On the Robustness of Vision-Language Models in Zero-shot Privacy Classification
- 2025Defeating Cerberus: Concept-Guided Privacy-Leakage Mitigation in Multimodal Language Models
- 2026Beyond Visual Evidence: Revealing and Mitigating Relational Privacy Leakage in Document MLLMs