mlsanityData to 13 Oct 2026

Revocable Learned State via Process Sidecars

arXiv 2606.30788 ↗First posted 29 Jun 2026cs.LG cs.CL cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Language models are often adapted in stages: a public skill phase, a private memory phase, and a later safety phase that learns to refuse outputs tied to the remembered entities. Revoking the memory after the safety phase is not the same problem as subtracting the memory update: the later safety optimizer has transported the memory direction. We introduce process sidecars, a two-coefficient edit family hatθ(λ,γ)=θAMS-λDeltaM-γhatRSleftarrowM, with hatRSleftarrowM=hatJS,varepsilon(DeltaM)-DeltaM, where hatJS,varepsilon is a centered secant through the realized future AdamW safety-training process. The implementation uses varepsilon=1 at the natural memory-edit scale; it reuses θAMS as the positive endpoint and computes one additional safety trace at θA-DeltaM. We prove two things. First, the exact sidecar, using the true transported direction RSleftarrowM rather than the secant estimate, at (λ,γ)=(1,1) recovers the counterfactual safety-only oracle θAS up to second order; the proof treats AdamW as an augmented-state map over parameters, first moments, and second moments. Second, this process information is necessary: whenever future safety training bends the memory direction, every scalar task-arithmetic edit leaves first-order counterfactual error, while the process-sidecar edit is second-order accurate. Across three models, the validation-selected 2D edit improves held-out refusal closure over naive task arithmetic in all trials, and over the γ=λ process-JVP subfamily, the diagonal slice of the cached 2D grid, in all paired trials.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 26 of its 35 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

26 of 35 references.

References · 26

  1. 2022Training language models to follow instructions with human feedbackcited by 15,856
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,231
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,986
  4. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,870
  5. 2017Understanding Black-box Predictions via Influence Functionscited by 1,729
  6. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,384
  7. 2022Editing Models with Task Arithmeticcited by 1,101
  8. 2019Machine Unlearningcited by 1,056
  9. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 808
  10. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 687
  11. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 617
  12. 2021Merging Models with Fisher-Weighted Averagingcited by 617
14 more
  1. 2019Certified Data Removal from Machine Learning Modelscited by 532
  2. 2019Meta-Learning with Implicit Gradientscited by 523
  3. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 519
  4. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 498
  5. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 496
  6. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 432
  7. 2023Who's Harry Potter? Approximate Unlearning in LLMscited by 376
  8. 2015Gradient-based Hyperparameter Optimization through Reversible Learningcited by 359
  9. 2019Optimizing Millions of Hyperparameters by Implicit Differentiationcited by 303
  10. 2023TRAK: Attributing Model Behavior at Scalecited by 279
  11. 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Modelscited by 257
  12. 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 192
  13. 2024An Adversarial Perspective on Machine Unlearning for AI Safetycited by 119
  14. 2024Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearningcited by 82

Built on by

Not cited yet.