LCMem: A Universal Model for Robust Image Memorization Detection
Not on the map. Why?
Abstract (arXiv)
Recent advances in generative image modeling have achieved visual realism sufficient to deceive human experts, yet their potential for privacy preserving data sharing remains insufficiently understood. A central obstacle is the absence of reliable memorization detection mechanisms, limited quantitative evaluation, and poor generalization of existing privacy auditing methods across domains. To address this, we propose to view memorization detection as a unified problem at the intersection of re-identification and copy detection, whose complementary goals cover both identity consistency and augmentation-robust duplication, and introduce Latent Contrastive Memorization Network (LCMem), a cross-domain model evaluated jointly on both tasks. LCMem achieves this through a two-stage training strategy that first learns identity consistency before incorporating augmentation-robust copy detection. Across six benchmark datasets, LCMem achieves improvements of up to 16 percentage points on re-identification and 30 percentage points on copy detection, enabling substantially more reliable memorization detection at scale. Our results show that existing privacy filters provide limited performance and robustness, highlighting the need for stronger protection mechanisms. We show that LCMem sets a new standard for cross-domain privacy auditing, offering reliable and scalable memorization detection. Code and model is publicly available at https://github.com/MischaD/LCMem.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 48 of its 72 references that are in the map. First posted on arXiv 16 Dec 2025.
Builds on
48 of 72 references.
References · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
36 more
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2019Deep Leakage from Gradientscited by 1,004
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
- 2021Membership Inference Attacks From First Principlescited by 839
- 2019Towards Federated Learning at Scale: System Designcited by 826
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 718
- 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 707
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 704
- 2020The Future of Digital Health with Federated Learningcited by 625
- 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 286
- 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 199
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
- 2020A Patient-Centric Dataset of Images and Metadata for Identifying Melanomas Using Clinical Contextcited by 146
- 2022How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?cited by 92
- 2023Federated Learning for Medical Image Analysis: A Surveycited by 77
- 2024Isambard-AI: a leadership class supercomputer optimised specifically for Artificial Intelligencecited by 59
- 2024Unveiling and Mitigating Memorization in Text-to-image Diffusion Models through Cross Attentioncited by 57
- 2022Long-Tailed Classification of Thorax Diseases on Chest X-Ray: A New Benchmark Studycited by 45
- 2021Deep Learning-based Patient Re-identification Is able to Exploit the Biometric Nature of Medical Chest X-ray Datacited by 38
- 2022Compressed Gastric Image Generation Based on Soft-Label Dataset Distillation for Medical Data Sharingcited by 35
- 2023MedGen3D: A Deep Generative Framework for Paired 3D Image and Mask Generationcited by 34
- 2024Image Generation Diversity Issues and How to Tame Themcited by 22
- 2023Investigating Data Memorization in 3D Latent Diffusion Models for Medical Image Synthesiscited by 19
- 2024EchoNet-Synthetic: Privacy-preserving Video Generation for Safe Medical Data Sharingcited by 17
- 2025ReXGroundingCT: A 3D Chest CT Dataset for Segmentation of Findings from Free-Text Reportscited by 16
- 2023Synthesising Rare Cataract Surgery Samples with Guided Diffusion Modelscited by 14
- 2025Does Training with Synthetic Data Truly Protect Privacy?cited by 12
- 2024Controllable and Efficient Multi-Class Pathology Nuclei Data Augmentation using Text-Conditioned Diffusion Modelscited by 8
- 2025Federated Learning for Medical Image Classification: A Comprehensive Benchmarkcited by 6
- 2024Memory-efficient High-resolution OCT Volume Synthesis with Cascaded Amortized Latent Diffusion Modelscited by 5
- 2024RadiomicsFill-Mammo: Synthetic Mammogram Mass Manipulation with Radiomics Featurescited by 5
- 2023Generating Progressive Images from Pathological Transitions via Diffusion Modelcited by 4
- 2024An Organism Starts with a Single Pix-Cell: A Neural Cellular Diffusion for High-Resolution Image Synthesiscited by 4
- 2025Enabling PSO-Secure Synthetic Data Sharing Using Diversity-Aware Diffusion Modelscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Diffusion Models Memorize in Training -- and Generalize in Inferencecited by 2
- 2026The Learnability Gap in Medical Latent Diffusioncited by 1
- 2026Flow Matching with Optimized Subclass Priors for Medical Image Augmentationcited by 0
- 2026A Data-Interventional Framework for Auditing Privacy and Fairness in Generative Medical Imagingcited by 0
- 2026A Data-Interventional Framework for Auditing Privacy and Fairness in Generative Medical Imaging22 Sep 2026
- 2026The Learnability Gap in Medical Latent Diffusion16 May 2026
- 2026Flow Matching with Optimized Subclass Priors for Medical Image Augmentation15 May 2026
- 2026Diffusion Models Memorize in Training -- and Generalize in Inference12 Mar 2026