Distribution-Specific Curvature Control with Finite-Sample Guarantees for Open-Weight Safety
Not on the map. Why?
Abstract (arXiv)
A short fine-tuning run can undo the safety guards of an open-weight model---retraining a refusal-trained assistant to aid weapons development or produce hate speech. Preventing such harmful fine-tuning while retaining benign adaptability remains difficult: the only prior method with an explicit curvature certificate, spectral deformation, inflates curvature globally and thereby obstructs benign adaptation along with harmful adaptation. We propose HarmAlign, which applies function-preserving spectral deformation along a estimated contrastive activation subspace. We derive finite-sample bounds for the estimated subspace energy and the resulting local harmful-distribution curvature lower bound. A stability--progress dichotomy for constant-step gradient descent turns the certified curvature into conditional convergence-rate control. Empirically, within a fixed-architecture, finite-budget first-order threat model, HarmAlign blocks direct fine-tuning and three data- or objective-adaptive attacks across a hazardous-knowledge relearning setting and a harmful-assistance fine-tuning setting, while the protected benign tasks remain trainable. The block persists across the tested first-order optimizer variants over every attack checkpoint, and under out-of-distribution harmful fine-tuning, and it extends to important cases in our threat model: accidental safety degradation and emergent misalignment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 30 references that are in the map. First posted on arXiv 24 Jul 2026.
Builds on
14 of 30 references.
References · 14
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
- 2019On the Convergence of Adam and Beyondcited by 834
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 828
- 2021Gradient Descent on Neural Networks Typically Occurs at the Edge of Stabilitycited by 413
- 2015An Introduction to Matrix Concentration Inequalitiescited by 391
- 2019Lower Bounds for Non-Convex Stochastic Optimizationcited by 303
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2022Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stabilitycited by 151
- 2024Tamper-Resistant Safeguards for Open-Weight LLMscited by 132
- 2024Why Transformers Need Adam: A Hessian Perspectivecited by 123
- 2024On Evaluating the Durability of Safeguards for Open-Weight LLMscited by 51
2 more
- 2024Towards Quantifying the Preconditioning Effect of Adamcited by 19
- 2026Limits of Convergence-Rate Control for Open-Weight Safetycited by 4
Built on by
Not cited yet.