Revocable Learned State via Process Sidecars
Not on the map. Why?
Abstract (arXiv)
Language models are often adapted in stages: a public skill phase, a private memory phase, and a later safety phase that learns to refuse outputs tied to the remembered entities. Revoking the memory after the safety phase is not the same problem as subtracting the memory update: the later safety optimizer has transported the memory direction. We introduce process sidecars, a two-coefficient edit family hatθ(λ,γ)=θAMS-λDeltaM-γhatRSleftarrowM, with hatRSleftarrowM=hatJS,varepsilon(DeltaM)-DeltaM, where hatJS,varepsilon is a centered secant through the realized future AdamW safety-training process. The implementation uses varepsilon=1 at the natural memory-edit scale; it reuses θAMS as the positive endpoint and computes one additional safety trace at θA-DeltaM. We prove two things. First, the exact sidecar, using the true transported direction RSleftarrowM rather than the secant estimate, at (λ,γ)=(1,1) recovers the counterfactual safety-only oracle θAS up to second order; the proof treats AdamW as an augmented-state map over parameters, first moments, and second moments. Second, this process information is necessary: whenever future safety training bends the memory direction, every scalar task-arithmetic edit leaves first-order counterfactual error, while the process-sidecar edit is second-order accurate. Across three models, the validation-selected 2D edit improves held-out refusal closure over naive task arithmetic in all trials, and over the γ=λ process-JVP subfamily, the diagonal slice of the cached 2D grid, in all paired trials.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 26 of its 35 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
26 of 35 references.
References · 26
- 2022Training language models to follow instructions with human feedbackcited by 15,856
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,231
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,986
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,870
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,729
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,384
- 2022Editing Models with Task Arithmeticcited by 1,101
- 2019Machine Unlearningcited by 1,056
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 808
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 687
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 617
- 2021Merging Models with Fisher-Weighted Averagingcited by 617
14 more
- 2019Certified Data Removal from Machine Learning Modelscited by 532
- 2019Meta-Learning with Implicit Gradientscited by 523
- 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 519
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 498
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 496
- 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 432
- 2023Who's Harry Potter? Approximate Unlearning in LLMscited by 376
- 2015Gradient-based Hyperparameter Optimization through Reversible Learningcited by 359
- 2019Optimizing Millions of Hyperparameters by Implicit Differentiationcited by 303
- 2023TRAK: Attributing Model Behavior at Scalecited by 279
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Modelscited by 257
- 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 192
- 2024An Adversarial Perspective on Machine Unlearning for AI Safetycited by 119
- 2024Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearningcited by 82
Built on by
Not cited yet.