MUC: Machine Unlearning for Contrastive Learning with Black-box Evaluation
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Machine unlearning offers effective solutions for revoking the influence of specific training data on pre-trained model parameters. While existing approaches address unlearning for classification and generative models, they overlook an important category of machine learning models: contrastive learning (CL) methods. This paper addresses this gap by introducing the Machine Unlearning for Contrastive Learning (MUC) framework and adapting existing methods. We identify limitations in current approaches, noting that several methods perform inadequately as unlearners and that existing evaluation tools insufficiently validate unlearning effects in contrastive learning. To address these issues, we propose Alignment Calibration (AC), a novel method that explicitly considers contrastive learning properties and optimizes towards new auditing metrics for easy verification of unlearning. Through empirical comparisons with baseline methods on SimCLR, MoCo, and CLIP, we demonstrate that AC: (1) achieves state-of-the-art performance, approximating exact unlearning (retraining); (2) enables data owners to clearly visualize unlearning effects through black-box evaluation. The code is available at https://github.com/EhanW/Alignment-Calibration.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 55 of its 58 references that are in the map. First posted on arXiv 5 Jun 2024.
Builds on
55 of 58 references.
Closest ancestors · 21
Same direction, newest first
- 2024What makes unlearning hard and what to do about it3 Jun
- 2024SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning28 Apr
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
- 2024Label-Agnostic Forgetting: A Supervision-Free Unlearning in Deep Models31 Mar
- 2024Loss-Free Machine Unlearning29 Feb
- 2024Rethinking Machine Unlearning for Large Language Models13 Feb
- 2024An Information Theoretic Approach to Machine Unlearning2 Feb
- 2024Contrastive Unlearning: A Contrastive Approach to Machine Unlearning19 Jan
- 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
- 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
- 2023Who's Harry Potter? Approximate Unlearning in LLMs3 Oct
- 2023Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operation16 Aug
9 more
- 2023Right to be Forgotten in the Era of Large Language Models: Implications, Challenges, and Solutions8 Jul
- 2023Model Sparsity Can Simplify Machine Unlearning11 Apr
- 2023Boundary Unlearning21 Mar
- 2023Towards Unbounded Machine Unlearning20 Feb
- 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Models4 Oct
- 2021On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning22 Oct
- 2021Machine Unlearning of Features and Labels26 Aug
- 2021Remember What You Want to Forget: Algorithms for Machine Unlearning4 Mar
- 2021Machine Unlearning via Algorithmic Stability25 Feb
Other references · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2023GPT-4 Technical Reportcited by 18,278
- 2014Microsoft COCO: Common Objects in Contextcited by 17,550
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,712
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,492
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,915
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,730
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,141
22 more
- 2020Exploring Simple Siamese Representation Learningcited by 2,860
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,612
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,397
- 2019Machine Unlearningcited by 1,056
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 617
- 2023Erasing Concepts from Diffusion Modelscited by 535
- 2019Certified Data Removal from Machine Learning Modelscited by 532
- 2019A Theoretical Analysis of Contrastive Unsupervised Representation Learningcited by 530
- 2021Fast Model Editing at Scalecited by 493
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 462
- 2022Memory-Based Model Editing at Scalecited by 446
- 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 370
- 2020Descent-to-Delete: Gradient-Based Methods for Machine Unlearningcited by 310
- 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Modelscited by 301
- 2020Systematic Evaluation of Privacy Risks of Machine Learning Modelscited by 290
- 2020Approximate Data Deletion from Machine Learning Modelscited by 255
- 2023Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Modelscited by 177
- 2020Contrastive learning, multi-view redundancy, and linear modelscited by 146
- 2021EncoderMI: Membership Inference against Pre-trained Encoders in Contrastive Learningcited by 72
- 2021Self-supervised Representation Learning with Relative Predictive Codingcited by 27
- 2024Memorization in Self-Supervised Learning Improves Downstream Generalizationcited by 18
- 2024f-MICL: Understanding and Generalizing InfoNCE-based Contrastive Learningcited by 13
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Machine Unlearning in Contrastive Learning
- 2025CoUn: Empowering Machine Unlearning via Contrastive Learning
- 2025UCD: Unlearning in LLMs via Contrastive Decoding
- 2026Forgetting Similar Samples: Can Machine Unlearning Do it Better?
- 2024Learn while Unlearn: An Iterative Unlearning Framework for Generative Language Models
- 2025Reference-Specific Unlearning Metrics Can Hide the Truth: A Reality Check
- 2025MUBox: A Critical Evaluation Framework of Deep Machine Unlearning
- 2025Learning to Unlearn while Retaining: Combating Gradient Conflicts in Machine Unlearning