mlsanityData to 7 Oct 2026

CUNO: Curriculum and Preference Optimization for Stable Graph Unlearning under Mass Deletion

arXiv 2609.08244 ↗First posted 8 Sep 2026cs.LG cs.AIcited by 0

On the map: LLM alignment / RLHF / preference optimisation → LLM preference optimization methods

also in 1 more
Abstract (arXiv)

Graph unlearning removes the influence of designated training data from a trained graph model without retraining from scratch. However, existing methods suffer a sharp drop in model utility under large deletion ratios (mass deletion), a phenomenon we refer to as catastrophic unlearning. We find that a key cause is the uniform treatment of all deleted samples, which is particularly damaging in graph learning: structural dependencies cause different nodes to play vastly different roles in the learned model, yet existing methods apply the same forgetting operation to the entire forget set. Based on this insight, we propose CUNO, a curriculum-based graph unlearning framework that removes the forget set progressively, ordering samples by their estimated unlearning difficulty across multiple stages. CUNO further employs a distribution-level negative preference optimization (NPO) objective at each curriculum stage that steers the model away from its original behavior on the current forget subset while preserving retained performance. Our theoretical analysis shows that the curriculum design is most beneficial when the forget set spans a wide range of unlearning difficulty, a condition naturally satisfied under mass deletion. Comprehensive experiments confirm that CUNO consistently mitigates catastrophic unlearning: at 20% deletion, it retains 74% of the original utility compared to 26-53% for existing methods, and maintains more than half the original utility even at 50% deletion. Our code is publicly available at https://anonymous.4open.science/r/cuno-D4FF.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in LLM preference optimization methods, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 43 of its 58 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

43 of 58 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Graph Unlearning Meets Influence-aware Negative Preference Optimization22 Oct
  2. 2024Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning9 Oct
  3. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr

Other references · 40

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2019Machine Unlearningcited by 1,020
  5. 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 332
  6. 2022A Survey of Machine Unlearningcited by 298
  7. 2021Curriculum Learning: A Surveycited by 257
  8. 2019Competence-based Curriculum Learning for Neural Machine Translationcited by 201
  9. 2017Teacher-Student Curriculum Learningcited by 197
  10. 2021Graph Unlearningcited by 129
  11. 2024What makes unlearning hard and what to do about itcited by 89
  12. 2023Calibration in Deep Learning: A Survey of the State-of-the-Artcited by 72
28 more
  1. 2023GIF: A General Graph Unlearning Strategy via Influence Functioncited by 59
  2. 2024A Closer Look at Machine Unlearning for Large Language Modelscited by 54
  3. 2023Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomycited by 44
  4. 2023GNNDelete: A General Strategy for Unlearning in Graph Neural Networkscited by 43
  5. 2023Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearningcited by 39
  6. 2024Machine Unlearning: A Comprehensive Surveycited by 33
  7. 2023Inductive Graph Unlearningcited by 30
  8. 2024Towards Effective and General Graph Unlearning via Mutual Evolutioncited by 29
  9. 2024Machine Unlearning: Taxonomy, Metrics, Applications, Challenges, and Prospectscited by 28
  10. 2022CLNode: Curriculum Learning for Node Classificationcited by 24
  11. 2024IDEA: A Flexible Framework of Certified Unlearning for Graph Neural Networkscited by 22
  12. 2023Efficiently Forgetting What You Have Learned in Graph Representation Learning via Projectioncited by 20
  13. 2025Learning Like Humans: Advancing LLM Reasoning Capabilities via Adaptive Difficulty Curriculum Learning and Expert-Guided Self-Reformulationcited by 20
  14. 2022MentorGNN: Deriving Curriculum for Pre-Training GNNscited by 18
  15. 2024Adversarial Machine Unlearningcited by 16
  16. 2023Curriculum Graph Machine Learning: A Surveycited by 15
  17. 2024Unlearn and Burn: Adversarial Machine Unlearning Requests Destroy Model Accuracycited by 15
  18. 2024Scalable and Certifiable Graph Unlearning: Overcoming the Approximation Error Barriercited by 13
  19. 2023A Survey of Graph Unlearningcited by 12
  20. 2024Erase then Rectify: A Training-Free Parameter Editing Approach for Cost-Effective Graph Unlearningcited by 12
  21. 2024Unlink to Unlearn: Simplifying Edge Unlearning in GNNscited by 11
  22. 2023Curriculum Learning for Graph Neural Networks: Which Edges Should We Learn Firstcited by 10
  23. 2024Improving Complex Reasoning over Knowledge Graph with Logic-Aware Curriculum Tuningcited by 10
  24. 2025OpenGU: A Comprehensive Benchmark for Graph Unlearningcited by 8
  25. 2023Deeper Understanding of Black-box Predictions via Generalized Influence Functionscited by 7
  26. 2018ScreenerNet: Learning Self-Paced Curriculum for Deep Neural Networkscited by 2
  27. 2025Adaptive Graph Unlearningcited by 2
  28. 2026Re-understanding Graph Unlearning through Memorizationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Unlearning of Knowledge Graph Embedding via Preference Optimization
  2. 2025Toward Scalable Graph Unlearning: A Node Influence Maximization based Approach
  3. 2024GraphWiz: An Instruction-Following Language Model for Graph Problems
  4. 2026Roots Beneath the Cut: Uncovering the Risk of Concept Revival in Pruning-Based Unlearning for Diffusion Models
  5. 2026Why Some Models Resist Unlearning: A Linear Stability Perspective
  6. 2026PECKER: A Precisely Efficient Critical Knowledge Erasure Recipe For Machine Unlearning in Diffusion Models
  7. 2025On the Impossibility of Retrain Equivalence in Machine Unlearning
  8. 2026From Domains to Instances: Dual-Granularity Data Synthesis for LLM Unlearning