Safety Compliance: Rethinking LLM Safety Reasoning through the Lens of Compliance
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
The proliferation of Large Language Models (LLMs) has demonstrated remarkable capabilities, elevating the critical importance of LLM safety. However, existing safety methods rely on ad-hoc taxonomy and lack a rigorous, systematic protection, failing to ensure safety for the nuanced and complex behaviors of modern LLM systems. To address this problem, we solve LLM safety from legal compliance perspectives, named safety compliance. In this work, we posit relevant established legal frameworks as safety standards for defining and measuring safety compliance, including the EU AI Act and GDPR, which serve as core legal frameworks for AI safety and data security in Europe. To bridge the gap between LLM safety and legal compliance, we first develop a new benchmark for safety compliance by generating realistic LLM safety scenarios seeded with legal statutes. Subsequently, we align Qwen3-8B using Group Policy Optimization (GRPO) to construct a safety reasoner, Compliance Reasoner, which effectively aligns LLMs with legal standards to mitigate safety risks. Our comprehensive experiments demonstrate that the Compliance Reasoner achieves superior performance on the new benchmark, with average improvements of +10.45% for the EU AI Act and +11.85% for GDPR.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 38 of its 40 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
38 of 40 references.
Closest ancestors · 4
Same direction, newest first
- 2025RSafe: Incentivizing proactive reasoning to build robust and adaptive LLM safeguards9 Jun
- 2025Context Reasoner: Incentivizing Reasoning Capability for Contextualized Privacy and Safety Compliance via Reinforcement Learning20 May
- 2025GuardReasoner: Towards Reasoning-based LLM Safeguards30 Jan
- 2024OpenAI o1 System Card21 Dec
Other references · 34
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Qwen Technical Reportcited by 3,344
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
22 more
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2021Ethical and social risks of harm from Language Modelscited by 966
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
- 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deepcited by 472
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
- 2023Multi-step Jailbreaking Privacy Attacks on ChatGPTcited by 333
- 2024PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preferencecited by 261
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
- 2025Aegis2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrailscited by 132
- 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?cited by 85
- 2025AgentDAM: Privacy Leakage Evaluation for Autonomous Web Agentscited by 82
- 2025How much do language models memorize?cited by 61
- 2023Privacy in Large Language Models: Attacks, Defenses and Future Directionscited by 51
- 2024FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Modelscited by 40
- 2024GoldCoin: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theorycited by 37
- 2025PrivaCI-Bench: Evaluating Privacy with Contextual Integrity and Legal Compliancecited by 37
- 2025MCIP: Protecting MCP Safety via Model Contextual Integrity Protocolcited by 34
- 2024Privacy Checklist: Privacy Violation Detection Grounding on Contextual Integrity Theorycited by 18
- 2025AI Agents and the Lawcited by 9
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026OmniCompliance-100K: A Multi-Domain, Rule-Grounded, Real-World Safety Compliance Dataset
- 2025LLM-based HSE Compliance Assessment: Benchmark, Performance, and Advancements
- 2026Reasoning over Precedents Alongside Statutes: Case-Augmented Deliberative Alignment for LLM Safety
- 2025Measuring What Matters: A Framework for Evaluating Safety Risks in Real-World LLM Applications
- 2026PolicyAlign: Direct Policy-Based Safety Alignment for Large Language Models
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment
- 2026Evaluating Implicit Regulatory Compliance in LLM Tool Invocation via Logic-Guided Synthesis
- 2025SafeLawBench: Towards Safe Alignment of Large Language Models