Beyond Static Alignment: Hierarchical Policy Control for LLM Safety via Risk-Aware Chain-of-Thought
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 2 more
Abstract (arXiv)
Large Language Models (LLMs) face a fundamental safety-helpfulness trade-off due to static, one-size-fits-all safety policies that lack runtime controllabilityxf, making it difficult to tailor responses to diverse application needs. %As a result, models may over-refuse benign requests or under-constrain harmful ones. We present PACT (Prompt-configured Action via Chain-of-Thought), a framework for dynamic safety control through explicit, risk-aware reasoning. PACT operates under a hierarchical policy architecture: a non-overridable global safety policy establishes immutable boundaries for critical risks (e.g., child safety, violent extremism), while user-defined policies can introduce domain-specific (non-global) risk categories and specify label-to-action behaviors to improve utility in real-world deployment settings. The framework decomposes safety decisions into structured ClassifyrightarrowAct paths that route queries to the appropriate action (comply, guide, or reject) and render the decision-making process transparent. Extensive experiments demonstrate that PACT achieves near state-of-the-art safety performance under global policy evaluation while attaining the best controllability under user-specific policy evaluation, effectively mitigating the safety-helpfulness trade-off. We will release the PACT model suite, training data, and evaluation protocols to facilitate reproducible research in controllable safety alignment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 23 of its 30 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
23 of 30 references.
Closest ancestors · 2
Same direction, newest first
- 2025Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable1 Mar
- 2024Deliberative Alignment: Reasoning Enables Safer Language Models20 Dec
Other references · 21
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2022Red Teaming Language Models with Language Modelscited by 1,026
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
9 more
- 2023The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learningcited by 257
- 2024WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Modelscited by 223
- 2025Llama-Nemotron: Efficient Reasoning Modelscited by 158
- 2025Qwen3Guard Technical Reportcited by 155
- 2023Safety Assessment of Chinese Large Language Modelscited by 85
- 2024Building Guardrails for Large Language Modelscited by 65
- 2024Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirementscited by 36
- 2025Efficient Switchable Safety Control in LLMs via Magic-Token-Guided Co-Trainingcited by 7
- 2024How Far Can In-Context Alignment Go? Exploring the State of In-Context Alignmentcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Beyond Reactive Safety: Risk-Aware LLM Alignment via Long-Horizon Simulation
- 2026PolicyAlign: Direct Policy-Based Safety Alignment for Large Language Models
- 2025RSafe: Incentivizing proactive reasoning to build robust and adaptive LLM safeguards
- 2026MOSAIC: Composable Safety Alignment with Modular Control Tokens
- 2026SAFESHIELD: A Decision-Organization Framework for Deployment-Time Safety of Small Language Models
- 2025GSPR: Aligning LLM Safeguards as Generalizable Safety Policy Reasoners
- 2026Reasoning over Precedents Alongside Statutes: Case-Augmented Deliberative Alignment for LLM Safety
- 2026Safety Paradox: How Enhanced Safety Awareness Leaves LLMs Vulnerable to Posterior Attack