mlsanityData to 7 Oct 2026

Distribution-Specific Curvature Control with Finite-Sample Guarantees for Open-Weight Safety

arXiv 2607.22929 ↗First posted 24 Jul 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

A short fine-tuning run can undo the safety guards of an open-weight model---retraining a refusal-trained assistant to aid weapons development or produce hate speech. Preventing such harmful fine-tuning while retaining benign adaptability remains difficult: the only prior method with an explicit curvature certificate, spectral deformation, inflates curvature globally and thereby obstructs benign adaptation along with harmful adaptation. We propose HarmAlign, which applies function-preserving spectral deformation along a estimated contrastive activation subspace. We derive finite-sample bounds for the estimated subspace energy and the resulting local harmful-distribution curvature lower bound. A stability--progress dichotomy for constant-step gradient descent turns the certified curvature into conditional convergence-rate control. Empirically, within a fixed-architecture, finite-budget first-order threat model, HarmAlign blocks direct fine-tuning and three data- or objective-adaptive attacks across a hazardous-knowledge relearning setting and a harmful-assistance fine-tuning setting, while the protected benign tasks remain trainable. The block persists across the tested first-order optimizer variants over every attack checkpoint, and under out-of-distribution harmful fine-tuning, and it extends to important cases in our threat model: accidental safety degradation and emergent misalignment.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 30 references that are in the map. First posted on arXiv 24 Jul 2026.

Builds on

14 of 30 references.

References · 14

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
  3. 2019On the Convergence of Adam and Beyondcited by 834
  4. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 828
  5. 2021Gradient Descent on Neural Networks Typically Occurs at the Edge of Stabilitycited by 413
  6. 2015An Introduction to Matrix Concentration Inequalitiescited by 391
  7. 2019Lower Bounds for Non-Convex Stochastic Optimizationcited by 303
  8. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  9. 2022Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stabilitycited by 151
  10. 2024Tamper-Resistant Safeguards for Open-Weight LLMscited by 132
  11. 2024Why Transformers Need Adam: A Hessian Perspectivecited by 123
  12. 2024On Evaluating the Durability of Safeguards for Open-Weight LLMscited by 51
2 more
  1. 2024Towards Quantifying the Preconditioning Effect of Adamcited by 19
  2. 2026Limits of Convergence-Rate Control for Open-Weight Safetycited by 4

Built on by

Not cited yet.