mlsanityData to 14 Oct 2026

Yuvion LLM: An Adversarially-Aware Large Language Model for Content And AI Safety

arXiv 2606.27632 ↗First posted 26 Jun 2026cs.CLcited by 0

On the map: LLM safety and security → Safety alignment, refusal and guardrails

Abstract (arXiv)

As large language models are increasingly deployed in real-world systems, safety failures can still lead to harmful outputs and dangerous misuse. We argue that the essence of safety is adversarial: many failures arise not from natural inputs alone, but from strategic attempts to evade model policies and safeguards. However, existing general-purpose model development largely overlook this adversarial nature, and often remain insufficient for realistic safety scenarios involving planning, tool use, and multi-step reasoning, causing measured safety performance to overestimate real deployment robustness. To address this gap, we present Yuvion LLM, a large language model built for adversarially robust content safety and broader AI safety. Yuvion LLM treats adversarial robustness and agentic capability as first-class objectives. Its pipeline combines adversarially aware data construction, knowledge-enhanced continued pretraining, and policy-grounded multi-task safety post-training, including risk-aware supervised fine-tuning and reinforcement learning-based policy optimization, together with safety-aware agentic reinforcement learning for tool use and multi-step reasoning in complex safety scenarios. We further introduce the Yuvion LLM RiskEval (YLRE), a collection of 93 benchmarks across four evaluation categories, covering diverse open and internal evaluations with a focus on safety, adversarial robustness, and real-world capability requirements. Across these evaluations, Yuvion LLM demonstrates clear advantages on safety-focused benchmarks and particularly strong robustness under adversarial conditions, while maintaining solid overall capability. Notably, Yuvion-8B outperforms most state-of-the-art baselines, including substantially larger models such as GPT-5.4 and Qwen3-MAX, on several safety tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 41 of its 78 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

41 of 78 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026YuFeng-XGuard: A Reasoning-Centric, Interpretable, and Flexible Guardrail Model for Large Language Models22 Jan
  2. 2025Qwen3Guard Technical Report16 Oct
  3. 2025ChineseHarm-Bench: A Chinese Harmful Content Detection Benchmark12 Jun

Other references · 38

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  6. 2025Qwen3 Technical Reportcited by 8,820
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  8. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  9. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  10. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  11. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  12. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
26 more
  1. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  2. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  3. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  4. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  5. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  6. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  7. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  8. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 729
  9. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  10. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  11. 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
  12. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
  13. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
  14. 2025ToolRL: Reward is All Tool Learning Needscited by 362
  15. 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
  16. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
  17. 2023SafetyBench: Evaluating the Safety of Large Language Modelscited by 199
  18. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 197
  19. 2024Are We Done with MMLU?cited by 194
  20. 2024AEGIS: Online Adaptive AI Content Safety Moderation with Ensemble of LLM Expertscited by 136
  21. 2025Tongyi DeepResearch Technical Reportcited by 66
  22. 2026SkillNet: Create, Evaluate, and Connect AI Skillscited by 53
  23. 2024S-Eval: Towards Automated and Comprehensive Safety Evaluation for Large Language Modelscited by 33
  24. 2025AIR: A Systematic Analysis of Annotations, Instructions, and Response Pairs in Preference Datasetcited by 9
  25. 2026Why Steering Works: Toward a Unified View of Language Model Parameter Dynamicscited by 9
  26. 2026How LoRA Remembers? A Parametric Memory Law for LLM Finetuningcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Yuvion VL: A Multimodal Foundation Model for Adversarial Content and AI Safety
  2. 2025Noise Injection Systemically Degrades Large Language Model Safety Guardrails
  3. 2025Adversarial Reinforcement Learning for Large Language Model Agent Safety
  4. 2024Large Language Model Safety: A Holistic Survey
  5. 2025Safety Instincts: LLMs Learn to Trust Their Internal Compass for Self-Defense
  6. 2025Agent Safety Alignment via Reinforcement Learning
  7. 2025Safety Alignment Can Be Not Superficial With Explicit Safety Signals
  8. 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks