PSG-Agent: Personality-Aware Safety Guardrail for LLM-based Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
Effective guardrails are essential for safely deploying LLM-based agents in critical applications. Despite recent advances, existing guardrails suffer from two fundamental limitations: (i) they apply uniform guardrail policies to all users, ignoring that the same agent behavior can harm some users while being safe for others; (ii) they check each response in isolation, missing how risks evolve and accumulate across multiple interactions. To solve these issues, we propose PSG-Agent, a personalized and dynamic system for LLM-based agents. First, PSG-Agent creates personalized guardrails by mining the interaction history for stable traits and capturing real-time states from current queries, generating user-specific risk thresholds and protection strategies. Second, PSG-Agent implements continuous monitoring across the agent pipeline with specialized guards, including Plan Monitor, Tool Firewall, Response Guard, Memory Guardian, that track cross-turn risk accumulation and issue verifiable verdicts. Finally, we validate PSG-Agent in multiple scenarios including healthcare, finance, and daily life automation scenarios with diverse user profiles. It significantly outperform existing agent guardrails including LlamaGuard3 and AGrail, providing an executable and auditable path toward personalized safety for LLM-based agents.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 32 of its 38 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
32 of 38 references.
Closest ancestors · 6
Same direction, newest first
- 2025Personalized Safety in LLMs: A Benchmark and A Planning-Based Agent Approach24 May
- 2025LlamaFirewall: An open source guardrail system for building secure AI agents6 May
- 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agents15 Apr
- 2025AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection17 Feb
- 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
Other references · 26
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2023Instruction Tuning for Large Language Models: A Surveycited by 623
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 382
- 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 353
14 more
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 339
- 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 218
- 2023Augmenting Language Models with Long-Term Memorycited by 189
- 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 164
- 2023LLM4Drive: A Survey of Large Language Models for Autonomous Drivingcited by 136
- 2024FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Makingcited by 113
- 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 78
- 2025Contextual Agent Security: A Policy for Every Purposecited by 59
- 2024Designing Heterogeneous LLM Agents for Financial Sentiment Analysiscited by 48
- 2024R2-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical Reasoningcited by 43
- 2024PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agentscited by 28
- 2025Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advancescited by 21
- 2025BingoGuard: LLM Content Moderation Tools with Risk Levelscited by 21
- 2025Is Safety Standard Same for Everyone? User-Specific Safety Evaluation of Large Language Modelscited by 10
Built on by
Citing papers per year: 2025: 3; 2026: 9.
12 papers.
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 44
- 2025A Survey on Agentic Security: Applications, Threats and Defensescited by 20
- 2026MemoryCD: Benchmarking Long-Context User Memory of LLM Agents for Lifelong Cross-Domain Personalizationcited by 17
- 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directionscited by 14
- 2026When Actions Go Off-Task: Detecting and Correcting Misaligned Actions in Computer-Use Agentscited by 8
- 2025Embracing Trustworthy Brain-Agent Collaboration as Paradigm Extension for Intelligent Assistive Technologiescited by 5
- 2026LiSA: Lifelong Safety Adaptation via Conservative Policy Inductioncited by 3
- 2026EMBGuard: Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agentscited by 3
- 2025MADIAVE: Multi-Agent Debate for Implicit Attribute Value Extractioncited by 2
- 2026SingGuard-NSFA: Extensible Guardrails for Agentic AI via Generative Reasoning and Real-Time Classificationcited by 2
- 2026Toward Secure AI-Powered Penetration Testing Agents: Security Threats, Guardrails, and Architectural Perspectivescited by 0
- 2026Evaluating Bounded Autonomy in Regulated Agentic AI: A Diagnostic Harness with Constitutional Rewards, Escalation Labels, and Runtime Governancecited by 0
- 2026Evaluating Bounded Autonomy in Regulated Agentic AI: A Diagnostic Harness with Constitutional Rewards, Escalation Labels, and Runtime Governance28 Sep 2026
- 2026Toward Secure AI-Powered Penetration Testing Agents: Security Threats, Guardrails, and Architectural Perspectives15 Sep 2026
- 2026SingGuard-NSFA: Extensible Guardrails for Agentic AI via Generative Reasoning and Real-Time Classification13 Jul 2026
- 2026EMBGuard: Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agents29 May 2026
- 2026LiSA: Lifelong Safety Adaptation via Conservative Policy Induction14 May 2026
- 2026MemoryCD: Benchmarking Long-Context User Memory of LLM Agents for Lifelong Cross-Domain Personalization26 Mar 2026
- 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directions26 Feb 2026
- 2026When Actions Go Off-Task: Detecting and Correcting Misaligned Actions in Computer-Use Agents9 Feb 2026
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents14 Jan 2026
- 2025Embracing Trustworthy Brain-Agent Collaboration as Paradigm Extension for Intelligent Assistive Technologies25 Oct 2025
- 2025A Survey on Agentic Security: Applications, Threats and Defenses7 Oct 2025
- 2025MADIAVE: Multi-Agent Debate for Implicit Attribute Value Extraction7 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2024GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoning
- 2026DreamGuard: Efficient Runtime Guardrail for LLM Agents via Risk-Aware World Model
- 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning
- 2026From Risk Classification to Action Plan Remediation: A Guardrail Feedback Driven Framework for LLM Agents
- 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Data
- 2026SafePred: A Predictive Guardrail for Computer-Using Agents via World Models
- 2025WebGuard: Building a Generalizable Guardrail for Web Agents
- 2026Yesterday's Shield, Today's Spear: A Self-Evolving Safety Guardrail in Production