Don't Break the Boundary: Continual Unlearning for OOD Detection Based on Free Energy Repulsion
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Deploying trustworthy AI in open-world environments faces a dual challenge: the necessity for robust Out-of-Distribution (OOD) detection to ensure system safety, and the demand for flexible machine unlearning to satisfy privacy compliance and model rectification. However, this objective encounters a fundamental geometric contradiction: current OOD detectors rely on a static and compact data manifold, whereas traditional classification-oriented unlearning methods disrupt this delicate structure, leading to a catastrophic loss of the model's capability to discriminate anomalies while erasing target classes. To resolve this dilemma, we first define the problem of boundary-preserving class unlearning and propose a pivotal conceptual shift: in the context of OOD detection, effective unlearning is mathematically equivalent to transforming the target class into OOD samples. Based on this, we propose the TFER (Total Free Energy Repulsion) framework. Inspired by the free energy principle, TFER constructs a novel Push-Pull game mechanism: it anchors retained classes within a low-energy ID manifold through a pull mechanism, while actively expelling forgotten classes to high-energy OOD regions using a free energy repulsion force. This approach is implemented via parameter-efficient fine-tuning, circumventing the prohibitive cost of full retraining. Extensive experiments demonstrate that TFER achieves precise unlearning while maximally preserving the model's discriminative performance on remaining classes and external OOD data. More importantly, our study reveals that the unique Push-Pull equilibrium of TFER endows the model with inherent structural stability, allowing it to effectively resist catastrophic forgetting without complex additional constraints, thereby demonstrating exceptional potential in continual unlearning tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 23 of its 29 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
23 of 29 references.
Closest ancestors · 5
Same direction, newest first
- 2024On Large Language Model Continual Unlearning14 Jul
- 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
- 2022A Survey of Machine Unlearning6 Sep
- 2022Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representations27 Feb
- 2021Fast Yet Effective Machine Unlearning17 Nov
Other references · 18
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2019Machine Unlearningcited by 1,020
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 451
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 402
- 2020Descent-to-Delete: Gradient-Based Methods for Machine Unlearningcited by 303
6 more
- 2021Towards Open World Object Detectioncited by 297
- 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
- 2020Why Normalizing Flows Fail to Detect Out-of-Distribution Datacited by 220
- 2020When Machine Unlearning Jeopardizes Privacycited by 181
- 2019Unsupervised Out-of-Distribution Detection by Maximum Classifier Discrepancycited by 112
- 2023Meta OOD Learning for Continuously Adaptive OOD Detectioncited by 10
Built on by
Not cited yet.