mlsanityData to 14 Oct 2026

PSG-Agent: Personality-Aware Safety Guardrail for LLM-based Agents

arXiv 2509.23614 ↗First posted 28 Sep 2025cs.AIcited by 12

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

Effective guardrails are essential for safely deploying LLM-based agents in critical applications. Despite recent advances, existing guardrails suffer from two fundamental limitations: (i) they apply uniform guardrail policies to all users, ignoring that the same agent behavior can harm some users while being safe for others; (ii) they check each response in isolation, missing how risks evolve and accumulate across multiple interactions. To solve these issues, we propose PSG-Agent, a personalized and dynamic system for LLM-based agents. First, PSG-Agent creates personalized guardrails by mining the interaction history for stable traits and capturing real-time states from current queries, generating user-specific risk thresholds and protection strategies. Second, PSG-Agent implements continuous monitoring across the agent pipeline with specialized guards, including Plan Monitor, Tool Firewall, Response Guard, Memory Guardian, that track cross-turn risk accumulation and issue verifiable verdicts. Finally, we validate PSG-Agent in multiple scenarios including healthcare, finance, and daily life automation scenarios with diverse user profiles. It significantly outperform existing agent guardrails including LlamaGuard3 and AGrail, providing an executable and auditable path toward personalized safety for LLM-based agents.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 32 of its 38 references that are in the map. First posted on arXiv 28 Sep 2025.

Builds on

32 of 38 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Personalized Safety in LLMs: A Benchmark and A Planning-Based Agent Approach24 May
  2. 2025LlamaFirewall: An open source guardrail system for building secure AI agents6 May
  3. 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agents15 Apr
  4. 2025AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection17 Feb
  5. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
  6. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct

Other references · 26

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  5. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  6. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  7. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  8. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  9. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
  10. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
  11. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 382
  12. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 353
14 more
  1. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 339
  2. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 218
  3. 2023Augmenting Language Models with Long-Term Memorycited by 189
  4. 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 164
  5. 2023LLM4Drive: A Survey of Large Language Models for Autonomous Drivingcited by 136
  6. 2024FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Makingcited by 113
  7. 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 78
  8. 2025Contextual Agent Security: A Policy for Every Purposecited by 59
  9. 2024Designing Heterogeneous LLM Agents for Financial Sentiment Analysiscited by 48
  10. 2024R2-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical Reasoningcited by 43
  11. 2024PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agentscited by 28
  12. 2025Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advancescited by 21
  13. 2025BingoGuard: LLM Content Moderation Tools with Risk Levelscited by 21
  14. 2025Is Safety Standard Same for Everyone? User-Specific Safety Evaluation of Large Language Modelscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 9.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024GuardAgent: Safeguard LLM Agents by a Guard Agent via Knowledge-Enabled Reasoning
  2. 2026DreamGuard: Efficient Runtime Guardrail for LLM Agents via Risk-Aware World Model
  3. 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning
  4. 2026From Risk Classification to Action Plan Remediation: A Guardrail Feedback Driven Framework for LLM Agents
  5. 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Data
  6. 2026SafePred: A Predictive Guardrail for Computer-Using Agents via World Models
  7. 2025WebGuard: Building a Generalizable Guardrail for Web Agents
  8. 2026Yesterday's Shield, Today's Spear: A Self-Evolving Safety Guardrail in Production