mlsanityData to 14 Oct 2026

Yesterday's Shield, Today's Spear: A Self-Evolving Safety Guardrail in Production

arXiv 2608.08471 ↗First posted 9 Aug 2026cs.AIcited by 0

On the map: Synthetic data and self-improvement for LLMs → Safety of self-evolving systems

also in 1 more
Abstract (arXiv)

Deployed LLM safety guardrails are predominantly static: trained once and frozen at release, while new jailbreak techniques and previously un-addressed harmful categories emerge within days, leaving the defense perpetually a step behind. We present SESG (Self-Evolving Safety Guardrails), a multi-agent system running in production. SESG monitors the live traffic behind a deployed guardrail and surfaces two classes of failure: jailbreaks novel in form and harmful categories novel in content. Once a failure is confirmed, a generation agent synthesizes paired training data targeted at it; a validation agent rebalances the batch toward the direction in which the deployed model errs, so that the model's own mistakes steer its training set; and a routing agent matches the training action to the diagnosed gap and returns the next version to production. Over six rounds of live evolution (V0 to V6), a 1.7B guardrail adapts to a new threat in 16-24 hours, with about 2 hours of human effort, versus the 40-90 hours of the manual process it replaces. On six emerging threats, it outperforms static guardrails from 0.6B to 9B and an adaptive baseline while preserving its general screening competence. Since April 2026, SESG has been the primary update pipeline of Sangfor's guardrail, autonomously closing 14 of 15 new threat scenarios in two months. We release 9 test sets for the 6 new threats at https://github.com/Trams1017/SESG. Warning: This paper contains examples that may be harmful or offensive.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety of self-evolving systems, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 28 of its 46 references that are in the map. First posted on arXiv 9 Aug 2026.

Builds on

28 of 46 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Membrane: A Self-Evolving Contrastive Safety Memory for LLM Agent Defense4 Jun

Other references · 27

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  4. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  5. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  6. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  7. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  8. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  9. 2025OpenAI GPT-5 System Cardcited by 989
  10. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  11. 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 367
  12. 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 243
15 more
  1. 2025Qwen3Guard Technical Reportcited by 155
  2. 2024AEGIS: Online Adaptive AI Content Safety Moderation with Ensemble of LLM Expertscited by 136
  3. 2024CodeChameleon: Personalized Encryption Framework for Jailbreaking Large Language Modelscited by 76
  4. 2024Building Guardrails for Large Language Modelscited by 65
  5. 2025Virus: Harmful Fine-tuning Attack for Large Language Models Bypassing Guardrail Moderationcited by 29
  6. 2025AgentAlign: Navigating Safety Alignment in the Shift from Informative to Agentic Large Language Modelscited by 21
  7. 2026YuFeng-XGuard: A Reasoning-Centric, Interpretable, and Flexible Guardrail Model for Large Language Modelscited by 19
  8. 2025Logic Jailbreak: Efficiently Unlocking LLM Safety Restrictions Through Formal Logical Expressioncited by 16
  9. 2024CHiSafetyBench: A Chinese Hierarchical Safety Benchmark for Large Language Modelscited by 15
  10. 2026Obscure but Effective: Classical Chinese Jailbreak Prompt Optimization via Bio-Inspired Searchcited by 13
  11. 2025ShieldLearner: A New Paradigm for Jailbreak Attack Defense in LLMscited by 7
  12. 2025Jailbreak Mimicry: Automated Discovery of Narrative-Based Jailbreaks for Large Language Modelscited by 5
  13. 2026SafeHarbor: Defining Precise Decision Boundaries via Hierarchical Memory-Augmented Guardrail for LLM Agent Safetycited by 4
  14. 2025AdaptiveGuard: Towards Adaptive Runtime Safety for LLM-Powered Softwarecited by 2
  15. 2026Lattice: Generative Guardrails for Conversational Agentscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Data
  2. 2026DreamGuard: Efficient Runtime Guardrail for LLM Agents via Risk-Aware World Model
  3. 2026Test-Time Training Undermines Safety Guardrails
  4. 2026SafeCoEvo: Co-Evolving Safety Harnesses and Guards for LLM Agents at Test-Time
  5. 2026From Risk Classification to Action Plan Remediation: A Guardrail Feedback Driven Framework for LLM Agents
  6. 2025LlamaFirewall: An open source guardrail system for building secure AI agents
  7. 2026StepGuard: Learning Step-Level Guardrails with Scalable Supervision and Safety-Utility Balancing
  8. 2025Learning Efficient Guardrails for Compliance