Auditing Patient Privacy in Medical Generative Models: Scalable Memorization Detection with DeepSSIM++
Not on the map. Why?
Abstract (arXiv)
While deep generative models offer new opportunities for medical image synthesis and data sharing, their ability to memorize and reproduce training samples raises serious concerns about patient confidentiality. Detecting such memorization at scale remains challenging: traditional pixel-based metrics are sensitive to generation artifacts, whereas generic embedding-based metrics often lack the anatomical sensitivity required for medical data. To address this challenge, we introduce DeepSSIM++, a self-supervised similarity metric for scalable memorization auditing in medical generative models. By leveraging multi-scale feature aggregation and anatomy-preserving augmentations, DeepSSIM++ learns an embedding space where cosine similarity approximates the Structural Similarity Index (SSIM), eliminating the need for exact pixel-level registration. Compared with state-of-the-art baselines, DeepSSIM++ achieves an average Macro F1 improvement of 33 percentage points under ideal alignment and 46 percentage points under realistic spatial and intensity perturbations. Furthermore, it accelerates large-scale similarity computation by several orders of magnitude compared with analytical SSIM. By combining anatomical sensitivity and computational efficiency, DeepSSIM++ provides an open-source tool for scalable memorization auditing in medical generative AI. Code and data are publicly available at: https://github.com/brAIn-science/DeepSSIM.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 61 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
35 of 61 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2022A ConvNet for the 2020scited by 3,579
- 2016Deep Learning with Differential Privacycited by 2,728
23 more
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2021Membership Inference Attacks From First Principlescited by 878
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 864
- 2023Extracting Training Data from Diffusion Modelscited by 732
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 499
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 424
- 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 303
- 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 246
- 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 176
- 2022Reconstructing Training Data with Informed Adversariescited by 148
- 2023On Memorization in Diffusion Modelscited by 125
- 2021Generative Models as a Data Source for Multiview Representation Learningcited by 104
- 2025Why Diffusion Models Don't Memorize: The Role of Implicit Dynamical Regularization in Trainingcited by 81
- 2023Investigating Data Memorization in 3D Latent Diffusion Models for Medical Image Synthesiscited by 19
- 2025Brain Latent Progression: Individual-based Spatiotemporal Disease Progression on 3D Brain MRIs via Latent Diffusioncited by 17
- 2025CoCoLIT: ControlNet-Conditioned Latent Image Translation for MRI to Amyloid PET Synthesiscited by 5
- 2025A Novel Metric for Detecting Memorization in Generative Models for Brain MRI Synthesiscited by 2
Built on by
Not cited yet.