mlsanityData to 7 Oct 2026

Published Unlearning Numbers Move Per Checkpoint, and Not Because the Removed Data Survives: An Audit of 263 Released Batch-Normalized Checkpoints

arXiv 2609.11490 ↗First posted 10 Sep 2026cs.AI cs.LGcited by 0

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

An unlearning audit reads its verdict off numbers that an unlearned model and its retrained reference each publish, and both also ship batch-normalization statistics that no gradient step wrote and no release records. Refitting them on kept data at bit-identical weights moves 47 of 221 released checkpoints past the spread their own release's seeds show, several inside a method whose average does not move: what moves is the checkpoint's property, not its method's. What does the moving is not the removed data surviving in the state: exchanging kept records for removed ones inside a fixed fitting pool moves a published cell by almost nothing, while how far a checkpoint's shipped state has drifted from any refit does track it. The consequence for a published decision is real but narrow: twelve verdicts cross, four clear a measured recalibration budget, two clear it on every replicate, and a population we trained and sited near its own criterion yields none. A release should therefore name the fitting convention beside the number, on the batch-normalized vision models where this channel exists.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 56 of its 67 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

56 of 67 references.

Closest ancestors · 30

Same direction, newest first

  1. 2026The BatchNorm Illusion: Diagnosing Normalization Artifacts in Machine Unlearning Evaluation8 Sep
  2. 2026Rethinking Demonstration Unlearning in Imitation Learning for Robotics21 Aug
  3. 2026Measure, Don't Optimize: Forecasting Recovery in LLM Unlearning11 Aug
  4. 2026Auditing of Unlearning Algorithms7 Jul
  5. 2026PURGE: Projected Unlearning via Retain-Guided Erasure2 Jun
  6. 2026DurableUn: Quantization-Induced Recovery Attacks in Machine Unlearning4 May
  7. 2026Mitigating Privacy Risk via Forget Set-Free Unlearning12 Apr
  8. 2026Governing AI Forgetting: Auditing for Machine Unlearning Compliance16 Feb
  9. 2026Inference-time Unlearning Using Conformal Prediction3 Feb
  10. 2025On the Impossibility of Retrain Equivalence in Machine Unlearning18 Oct
  11. 2025Unlearning Comparator: A Visual Analytics System for Comparative Evaluation of Machine Unlearning Methods18 Aug
  12. 2025From Dormant to Deleted: Tamper-Resistant Unlearning Through Weight-Space Regularization28 May
18 more
  1. 2025Are We Truly Forgetting? A Critical Re-examination of Machine Unlearning Evaluation Protocols10 Mar
  2. 2025Tackling Fake Forgetting through Uncertainty Quantification31 Jan
  3. 2024Catastrophic Failure of LLM Unlearning via Quantization21 Oct
  4. 2024Revisiting Machine Unlearning with Dimensional Alignment25 Jul
  5. 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Models8 Jul
  6. 2024MU-Bench: A Multitask Multimodal Benchmark for Machine Unlearning21 Jun
  7. 2024Are we making progress in unlearning? Findings from the first NeurIPS unlearning competition13 Jun
  8. 2024Inexact Unlearning Needs More Careful Evaluations to Avoid a False Sense of Privacy2 Mar
  9. 2024Remaining-data-free Machine Unlearning by Suppressing Sample Contribution23 Feb
  10. 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
  11. 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
  12. 2023Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampening15 Aug
  13. 2023Model Sparsity Can Simplify Machine Unlearning11 Apr
  14. 2023Towards Unbounded Machine Unlearning20 Feb
  15. 2022Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks using an Incompetent Teacher17 May
  16. 2022Towards Adversarial Evaluations for Inexact Machine Unlearning17 Jan
  17. 2021On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning22 Oct
  18. 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearning27 Sep

Other references · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2016Layer Normalizationcited by 5,579
  5. 2018Group Normalizationcited by 1,514
  6. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
  7. 2019Machine Unlearningcited by 1,020
  8. 2021Membership Inference Attacks From First Principlescited by 839
  9. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
  10. 2019Certified Data Removal from Machine Learning Modelscited by 512
  11. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 488
  12. 2019Making AI Forget You: Data Deletion in Machine Learningcited by 447
14 more
  1. 2020Improving robustness against common corruptions by covariate shift adaptationcited by 427
  2. 2019Data-Free Quantization Through Weight Equalization and Bias Correctioncited by 328
  3. 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 318
  4. 2020Amnesiac Machine Learningcited by 305
  5. 2016Revisiting Batch Normalization For Practical Domain Adaptationcited by 285
  6. 2017Are GANs Created Equal? A Large-Scale Studycited by 267
  7. 2020Evaluating Prediction-Time Batch Normalization for Robustness under Covariate Shiftcited by 235
  8. 2021Accounting for Variance in Machine Learning Benchmarkscited by 195
  9. 2020Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNscited by 103
  10. 2019A Step Toward Quantifying Independently Reproducible Machine Learning Researchcited by 77
  11. 2021Rethinking "Batch" in BatchNormcited by 44
  12. 2026Batch Normalization Amplifies Memorization and Privacy Riskscited by 1
  13. 2026Reading the Gate, Not the Interference: Output-Side Interference Measurement Does Not Track Merge Collapsecited by 1
  14. 2026Phantom Gains: Auditing Self-Improvement Against a Measured Nullcited by 1

Built on by

Not cited yet.