Yuvion LLM: An Adversarially-Aware Large Language Model for Content And AI Safety
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
As large language models are increasingly deployed in real-world systems, safety failures can still lead to harmful outputs and dangerous misuse. We argue that the essence of safety is adversarial: many failures arise not from natural inputs alone, but from strategic attempts to evade model policies and safeguards. However, existing general-purpose model development largely overlook this adversarial nature, and often remain insufficient for realistic safety scenarios involving planning, tool use, and multi-step reasoning, causing measured safety performance to overestimate real deployment robustness. To address this gap, we present Yuvion LLM, a large language model built for adversarially robust content safety and broader AI safety. Yuvion LLM treats adversarial robustness and agentic capability as first-class objectives. Its pipeline combines adversarially aware data construction, knowledge-enhanced continued pretraining, and policy-grounded multi-task safety post-training, including risk-aware supervised fine-tuning and reinforcement learning-based policy optimization, together with safety-aware agentic reinforcement learning for tool use and multi-step reasoning in complex safety scenarios. We further introduce the Yuvion LLM RiskEval (YLRE), a collection of 93 benchmarks across four evaluation categories, covering diverse open and internal evaluations with a focus on safety, adversarial robustness, and real-world capability requirements. Across these evaluations, Yuvion LLM demonstrates clear advantages on safety-focused benchmarks and particularly strong robustness under adversarial conditions, while maintaining solid overall capability. Notably, Yuvion-8B outperforms most state-of-the-art baselines, including substantially larger models such as GPT-5.4 and Qwen3-MAX, on several safety tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 41 of its 78 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
41 of 78 references.
Closest ancestors · 3
Same direction, newest first
- 2026YuFeng-XGuard: A Reasoning-Centric, Interpretable, and Flexible Guardrail Model for Large Language Models22 Jan
- 2025Qwen3Guard Technical Report16 Oct
- 2025ChineseHarm-Bench: A Chinese Harmful Content Detection Benchmark12 Jun
Other references · 38
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
26 more
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 729
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2024Executable Code Actions Elicit Better LLM Agentscited by 564
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
- 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
- 2025ToolRL: Reward is All Tool Learning Needscited by 362
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
- 2023SafetyBench: Evaluating the Safety of Large Language Modelscited by 199
- 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 197
- 2024Are We Done with MMLU?cited by 194
- 2024AEGIS: Online Adaptive AI Content Safety Moderation with Ensemble of LLM Expertscited by 136
- 2025Tongyi DeepResearch Technical Reportcited by 66
- 2026SkillNet: Create, Evaluate, and Connect AI Skillscited by 53
- 2024S-Eval: Towards Automated and Comprehensive Safety Evaluation for Large Language Modelscited by 33
- 2025AIR: A Systematic Analysis of Annotations, Instructions, and Response Pairs in Preference Datasetcited by 9
- 2026Why Steering Works: Toward a Unified View of Language Model Parameter Dynamicscited by 9
- 2026How LoRA Remembers? A Parametric Memory Law for LLM Finetuningcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Yuvion VL: A Multimodal Foundation Model for Adversarial Content and AI Safety
- 2025Noise Injection Systemically Degrades Large Language Model Safety Guardrails
- 2025Adversarial Reinforcement Learning for Large Language Model Agent Safety
- 2024Large Language Model Safety: A Holistic Survey
- 2025Safety Instincts: LLMs Learn to Trust Their Internal Compass for Self-Defense
- 2025Agent Safety Alignment via Reinforcement Learning
- 2025Safety Alignment Can Be Not Superficial With Explicit Safety Signals
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks