Personalization Meets Safety:Mechanisms,Risks,and Mitigations in Personalized LLMs
On the map: Mixture-of-experts → Expert routing strategies
Abstract (arXiv)
Large Language Models (LLMs) have enabled increasingly personalized interactions by adapting to users' preferences, contexts, and long-term histories. However, the mechanisms that enable personalization also expand the safety landscape in ways not systematically addressed by existing literature. Existing reviews typically focus either on personalization or safety, leaving their intersection largely unexplored. We present the first comprehensive, safety-aware review of personalized LLMs. We organize personalization along three dimensions-user representation, personalization paradigm, and evaluation-and introduce a unified taxonomy of safety risks. At the representation level, we analyze risks arising from diverse user representations. Across mainstream personalization paradigms, we delineate vulnerabilities inherent to prompting, retrieval augmentation, parameter fine-tuning, reinforcement learning, Mixture-of-Experts (MoE), pruning, agent frameworks, and multimodal personalization, and synthesize mitigation strategies across the model lifecycle. Beyond these fine-grained risks, we characterize paradigm-agnostic safety risks arising from personalized adaptation. We further summarize personalized datasets and evaluation methodologies. Through a case study of OpenClaw, we analyze deployment trends in personalized agent ecosystems. Our analysis reveals three structural inadequacies in existing research: safety is evaluated as user-invariant rather than relational, personalization techniques are analyzed in isolation rather than in composition, and evaluation frameworks cannot capture emergent long-term risks. By jointly examining personalized representations, personalization paradigms, safety risks, defenses, and evaluation methods, we provide a unified framework for developing safe personalized LLMs and highlight key directions for future research.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Expert routing strategies, one of 12 directions in Mixture-of-experts. Builds on 96 of its 332 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
96 of 332 references.
Closest ancestors · 3
Same direction, newest first
- 2026Spectral Manifold Regularization for Stable and Modular Routing in Deep MoE Architectures7 Jan
- 2025ERMoE: Eigen-Reparameterized Mixture-of-Experts for Stable Routing and Interpretable Specialization14 Nov
- 2025MoEcho: Exploiting Side-Channel Attacks to Compromise User Privacy in Mixture-of-Experts LLMs20 Aug
Other references · 93
- 2017Proximal Policy Optimization Algorithmscited by 14,592
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,986
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,103
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,389
- 2020Extracting Training Data from Large Language Modelscited by 2,181
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,141
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,032
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 853
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 824
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 760
- 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 648
- 2023LaMP: When Large Language Models Meet Personalizationcited by 430
38 more
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 421
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 406
- 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 396
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 388
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agentscited by 360
- 2023Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Mergingcited by 275
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 269
- 2016A Persona-Based Neural Conversation Modelcited by 223
- 2022Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpointscited by 208
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
- 2023Simple synthetic data reduces sycophancy in large language modelscited by 185
- 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 179
- 2025Qwen3Guard Technical Reportcited by 147
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 145
- 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contextscited by 144
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 139
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interactioncited by 138
- 2025MemOS: A Memory OS for AI Systemcited by 134
- 2023Distributional Preference Learning: Understanding and Accounting for Hidden Context in RLHFcited by 130
- 2024Personalized Language Modeling from Personalized Human Feedbackcited by 129
- 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 124
- 2024MaxMin-RLHF: Alignment with Diverse Human Preferencescited by 123
- 2024MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentationcited by 119
- 2024AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agentscited by 102
- 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 95
- 2024LongLaMP: A Benchmark for Personalized Long-form Text Generationcited by 93
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 87
- 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 84
- 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agentscited by 76
- 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolutioncited by 71
- 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedbackcited by 70
- 2024Large Language Model Safety: A Holistic Surveycited by 59
- 2024Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometricscited by 58
- 2024PersonalLLM: Tailoring LLMs to Individual Preferencescited by 58
- 2023Faithful Persona-based Conversational Dataset Generation with Large Language Modelscited by 47
- 2025Hindsight is 20/20: Building Agent Memory that Retains, Recalls, and Reflectscited by 42
- 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applicationscited by 41
- 2024LLMs + Persona-Plug = Personalized LLMscited by 30
50 most cited of 93 All 93 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Exploring Safety-Utility Trade-Offs in Personalized Language Models
- 2026Large Language Models Should Learn Personalized Rather Than Aggregated Human Preferences
- 2026Towards Natural Personalization: Evaluating Long-Horizon Preference Following in Personalized User-LLM Interactions
- 2026Re-Centering Humans in LLM Personalization
- 2025Personalize Your LLM: Fake it then Align it
- 2026Many Preferences, Few Policies: Towards Scalable Language Model Personalization
- 2026Synthetic Interaction Data for Scalable Personalization in Large Language Models
- 2025Evaluating Personalized Tool-Augmented LLMs from the Perspectives of Personalization and Proactivity