mlsanityData to 14 Oct 2026

Masking Is Not Enough: Generative Restoration for Multimodal De-Identification in Medical AI

arXiv 2608.21133 ↗First posted 21 Aug 2026cs.CV cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Medical image-text data can expose protected health information (PHI) through both visible image content as well as accompanying text, creating a barrier to privacy-preserving medical AI systems. This risk is especially prominent in multimodal systems, where images, questions, reports, and clinical context may enter training, evaluation, or inference pipelines. Existing medical vision-language benchmarks primarily emphasize task utility, while de-identification methods are often evaluated separately from downstream reasoning. We introduce ClinX, an end-to-end multimodal PHI sanitization framework for medical image-text data. ClinX detects visible identifiers with optical character recognition (OCR), constructs binary PHI masks, and applies ClinX-PRISM, a no-skip generative restoration module with privacy-oriented post-processing for burned-in identifier suppression. In parallel, text-side PHI is reduced through progressive de-identification levels: regex masking, context-aware masking, and rewrite-based sanitization. We evaluate ClinX in medical visual question answering (MedVQA), jointly measuring PHI leakage and downstream utility across image-side, text-side, and combined de-identification settings. Results show that OCR-only masking is not sufficient as a standalone solution, and restoration-based sanitization better preserves clinically relevant visual context while sharply reducing recoverable PHI.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 29 references that are in the map. First posted on arXiv 21 Aug 2026.

Builds on

14 of 29 references.

References · 14

  1. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  2. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  3. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
  4. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
  5. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  6. 2018Generative Image Inpainting with Contextual Attentioncited by 580
  7. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  8. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
  9. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
  10. 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Reviewcited by 125
  11. 2018Patch-Based Image Inpainting with Generative Adversarial Networkscited by 70
  12. 2024De-Identification of Medical Imaging Data: A Comprehensive Tool for Ensuring Patient Privacycited by 7
2 more
  1. 2026Unveiling Privacy Risks in Multi-modal Large Language Models: Task-specific Vulnerabilities and Mitigation Challengescited by 4
  2. 2026From Redaction to Restoration: Deep Learning for Medical Image Anonymization and Reconstructioncited by 1

Built on by

Not cited yet.