mlsanityData to 7 Oct 2026

When Is Deletion Ordering Tractable? From Update Dynamics to Permutation Structure

arXiv 2610.01149 ↗First posted 1 Oct 2026cs.DS cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Given a fixed set of pending deletion requests, retraining from scratch after each request is prohibitive, so a prescribed request-wise policy processes them sequentially. The resulting terminal model can depend on their order. Rather than prescribing an ordering rule, we study the permutation objective induced by the fixed policy and ask when it admits simpler structure. We identify two independent reductions: position additivity represents the objective by request--position costs, reducing optimization to assignment and, with a shared positional profile, sorting; suffix localization removes dependence on the distant prefix while retaining interactions among the surviving requests. Under shared affine updates, we characterize the quadratic interactions that obstruct additivity, prove the reductions' independence, and show that suffix-conditioned assignment improves the approximation rate from O(p^L) toO(p^(2L)). Experiments recover both structures in executed objectives. A controlled damped-Newton sweep shows that stronger contraction shifts the objective toward shorter, more suffix-specific dependence, while two full-network policies exhibit distinct positional and within-suffix structure. Structures identified from compact execution sets also predict unseen orders. These results frame deletion ordering as identifying the computational structure induced by the executed updates.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 29 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

20 of 29 references.

References · 20

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  3. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  4. 2015Train faster, generalize better: Stability of stochastic gradient descentcited by 547
  5. 2019Certified Data Removal from Machine Learning Modelscited by 512
  6. 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generationcited by 376
  7. 2023Towards Unbounded Machine Unlearningcited by 261
  8. 2023Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampeningcited by 177
  9. 2021Adaptive Machine Unlearningcited by 164
  10. 2024What makes unlearning hard and what to do about itcited by 89
  11. 2024On Large Language Model Continual Unlearningcited by 51
  12. 2025Certified Unlearning for Neural Networkscited by 25
8 more
  1. 2021Permutation-Based SGD: Is Random Optimal?cited by 16
  2. 2025Optimal Task Order for Continual Learning of Multiple Taskscited by 14
  3. 2025Ascent Fails to Forgetcited by 12
  4. 2022Learning to Learn: How to Continuously Teach Humans and Machinescited by 9
  5. 2023Coordinating Distributed Example Orders for Provably Accelerated Trainingcited by 7
  6. 2025On the Impossibility of Retrain Equivalence in Machine Unlearningcited by 6
  7. 2014Linearizable special cases of the QAPcited by 1
  8. 2024Composition Orderings for Linear Functions and Matrix Multiplication Orderingscited by 1

Built on by

Not cited yet.