mlsanityData to 14 Oct 2026

Do Activation Monitors Survive Model Updates? Benchmarking, Predicting, and Repairing Activation-Monitor Staleness

arXiv 2606.15980 ↗First posted 14 Jun 2026cs.LG cs.AI cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Activation monitors -- lightweight probes trained on a language model's internal representations -- are an increasingly common layer in deployment safety stacks. Deployed models however are rarely static: they are quantized, fine-tuned, adapted with LoRA, or served with merged adapters while the monitor remains frozen. We present the first systematic test of whether this implicit contract holds: whether activation monitors trained on a base model remain reliable after these routine model updates. Across multiple safety-relevant monitors, model depths, update families, and open-weight models, we find a sharp split: quantization-style updates largely preserve frozen probe performance, while fine-tuning-style updates frequently make probes stale. Fragility is highly monitor-dependent, with privacy/PII probes most affected and refusal-compliance probes comparatively stable, showing that retraining a behavior need not stale its corresponding monitor. QLoRA is especially damaging despite NF4 quantization alone being relatively benign, suggesting that quantization becomes riskier when combined with adaptation. We further show that degradation is predictable from pre-deployment features, enabling revalidation budgets to be triaged toward the monitors most likely to fail. Finally, we test repair strategies and find that cheap label-free activation realignment repairs every repair-relevant stale cell, with none requiring score calibration, few-label heads, or labeled retraining. These results suggest that fine-tuning should trigger activation-monitor revalidation by default, with prediction triaging which monitors to check first and label-free realignment as the default repair.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 14 Jun 2026.

Builds on

19 of 33 references.

References · 19

  1. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  2. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
  3. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  4. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  5. 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
  6. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  7. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
  8. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  9. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
  10. 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
  11. 2023Shadow Alignment: The Ease of Subverting Safely-Aligned Language Modelscited by 297
  12. 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 243
7 more
  1. 2022Leveraging Unlabeled Data to Predict Out-of-Distribution Performancecited by 145
  2. 2024Safety Layers in Aligned Large Language Models: The Key to LLM Securitycited by 134
  3. 2024Decoding Compressed Trust: Scrutinizing the Trustworthiness of Efficient LLMs Under Compressioncited by 57
  4. 2025Understanding Refusal in Language Models with Sparse Autoencoderscited by 29
  5. 2024Locking Down the Finetuned LLMs Safetycited by 22
  6. 2025Anchoring Refusal Direction: Mitigating Safety Risks in Tuning via Projection Constraintcited by 7
  7. 2026Perplexity Can Miss SAE Feature Damage Under Quantizationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Measuring Activation Control in Large Language Models
  2. 2025Activation Approximations Can Incur Safety Vulnerabilities Even in Aligned LLMs: Comprehensive Analysis and Defense
  3. 2026The Knowing-Saying Gap: When Probes See Errors that Confidence Misses
  4. 2026AI Observability for Large Language Model Systems: A Multi-Layer Analysis of Monitoring Approaches from Confidence Calibration to Infrastructure Tracing ↗
  5. 2026Detecting Safety Training Modification in Language Models via Activation Analysis ↗
  6. 2026Prompted to Discriminate: Generalizing Malicious-Input Probes in the Wild
  7. 2026Closing the Activation-Cone Blind Spot: Response-Time Probing and Unified Defense
  8. 2026Do All LLMs Know When They're Being Harmful? A Reproducibility Study of Latent-Space Safety Probes Across Model Families