Masking Is Not Enough: Generative Restoration for Multimodal De-Identification in Medical AI
Not on the map. Why?
Abstract (arXiv)
Medical image-text data can expose protected health information (PHI) through both visible image content as well as accompanying text, creating a barrier to privacy-preserving medical AI systems. This risk is especially prominent in multimodal systems, where images, questions, reports, and clinical context may enter training, evaluation, or inference pipelines. Existing medical vision-language benchmarks primarily emphasize task utility, while de-identification methods are often evaluated separately from downstream reasoning. We introduce ClinX, an end-to-end multimodal PHI sanitization framework for medical image-text data. ClinX detects visible identifiers with optical character recognition (OCR), constructs binary PHI masks, and applies ClinX-PRISM, a no-skip generative restoration module with privacy-oriented post-processing for burned-in identifier suppression. In parallel, text-side PHI is reduced through progressive de-identification levels: regex masking, context-aware masking, and rewrite-based sanitization. We evaluate ClinX in medical visual question answering (MedVQA), jointly measuring PHI leakage and downstream utility across image-side, text-side, and combined de-identification settings. Results show that OCR-only masking is not sufficient as a standalone solution, and restoration-based sanitization better preserves clinically relevant visual context while sharply reducing recoverable PHI.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 29 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
14 of 29 references.
References · 14
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
- 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
- 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Reviewcited by 125
- 2018Patch-Based Image Inpainting with Generative Adversarial Networkscited by 70
- 2024De-Identification of Medical Imaging Data: A Comprehensive Tool for Ensuring Patient Privacycited by 7
Built on by
Not cited yet.