mlsanityData to 13 Oct 2026

Trajectory-Guided Forget-Recover Network for Continual LLM Unlearning

arXiv 2608.03123 ↗First posted 4 Aug 2026cs.LG cs.AIcited by 0

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Machine unlearning aims to eliminate the influence of sensitive data on a model. In the real world, unlearning requests arrive continually, which gives rise to two challenges. First, an unlearning intervention may redistribute target-related computation across remaining pathways, allowing previously forgotten knowledge to re-emerge. Second, repeated unlearning interventions may progressively reduce the model capacity needed to preserve retained utility. To address these challenges, we propose the Trajectory-guided Forget-Recover Network (TFR-Net). TFR-Net tracks channel-level risk across requests. It separates persistent target-related channels from transient hotspots and suppresses only the persistent ones. TFR-Net also recovers model capacity by reactivating dormant channels. These channels make strong contributions to retained utility and show low current and historical forget risk. The recovery is accepted only when retained-utility degradation remains within a predefined tolerance. Experiments on four datasets show that TFR-Net consistently achieves a more favorable trade-off between unlearning effectiveness and retained utility than representative baselines.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 16 of its 27 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

16 of 27 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Attention Smoothing Is All You Need For Unlearning1 Mar
  2. 2024Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning9 Oct
  3. 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
  4. 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
  5. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Models4 Oct

Other references · 11

  1. 2020Language Models are Few-Shot Learnerscited by 32,320
  2. 2020Extracting Training Data from Large Language Modelscited by 2,181
  3. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,133
  4. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 498
  5. 2019Making AI Forget You: Data Deletion in Machine Learningcited by 462
  6. 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
  7. 2024Dynamic Graph Unlearning: A General and Efficient Post-Processing Method via Gradient Transformationcited by 15
  8. 2024Effective Instruction Parsing Plugin for Complex Logical Query Answering on Knowledge Graphscited by 8
  9. 2025GraphRAG-Induced Dual Knowledge Structure Graphs for Personalized Learning Path Recommendationcited by 6
  10. 2025Prompting Large Language Models with Partial Knowledge for Answering Questions with Unseen Entitiescited by 4
  11. 2026CAGE: Cognitive Attribution Graphs for Faithful Inline Citation Generation in Long-Form Question Answeringcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Beyond Sharp Minima: Robust LLM Unlearning via Feedback-Guided Multi-Point Optimization
  2. 2026Quantization-Robust Unlearning through the Lens of Retain-Forget Loss Landscapes Interaction
  3. 2026Unmerge: Efficient Machine Unlearning via Task Arithmetic
  4. 2025REMIND: Input Loss Landscapes Reveal Residual Memorization in Post-Unlearning LLMs
  5. 2026On the Plasticity Collapse in Continual Machine Unlearning
  6. 2026Not Every Change Is Necessary: Recoverable Drift in Large Language Model Unlearning
  7. 2026Learning What to Forget: Improving LLM Unlearning via Learned Token-Level Importance
  8. 2026PURGE: Projected Unlearning via Retain-Guided Erasure