mlsanityData to 13 Oct 2026

Personalization Meets Safety:Mechanisms,Risks,and Mitigations in Personalized LLMs

arXiv 2606.09038 ↗First posted 8 Jun 2026cs.AIcited by 0

On the map: Mixture-of-experts → Expert routing strategies

Abstract (arXiv)

Large Language Models (LLMs) have enabled increasingly personalized interactions by adapting to users' preferences, contexts, and long-term histories. However, the mechanisms that enable personalization also expand the safety landscape in ways not systematically addressed by existing literature. Existing reviews typically focus either on personalization or safety, leaving their intersection largely unexplored. We present the first comprehensive, safety-aware review of personalized LLMs. We organize personalization along three dimensions-user representation, personalization paradigm, and evaluation-and introduce a unified taxonomy of safety risks. At the representation level, we analyze risks arising from diverse user representations. Across mainstream personalization paradigms, we delineate vulnerabilities inherent to prompting, retrieval augmentation, parameter fine-tuning, reinforcement learning, Mixture-of-Experts (MoE), pruning, agent frameworks, and multimodal personalization, and synthesize mitigation strategies across the model lifecycle. Beyond these fine-grained risks, we characterize paradigm-agnostic safety risks arising from personalized adaptation. We further summarize personalized datasets and evaluation methodologies. Through a case study of OpenClaw, we analyze deployment trends in personalized agent ecosystems. Our analysis reveals three structural inadequacies in existing research: safety is evaluated as user-invariant rather than relational, personalization techniques are analyzed in isolation rather than in composition, and evaluation frameworks cannot capture emergent long-term risks. By jointly examining personalized representations, personalization paradigms, safety risks, defenses, and evaluation methods, we provide a unified framework for developing safe personalized LLMs and highlight key directions for future research.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Expert routing strategies, one of 12 directions in Mixture-of-experts. Builds on 96 of its 332 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

96 of 332 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026Spectral Manifold Regularization for Stable and Modular Routing in Deep MoE Architectures7 Jan
  2. 2025ERMoE: Eigen-Reparameterized Mixture-of-Experts for Stable Routing and Interpretable Specialization14 Nov
  3. 2025MoEcho: Exploiting Side-Channel Attacks to Compromise User Privacy in Mixture-of-Experts LLMs20 Aug

Other references · 93

  1. 2017Proximal Policy Optimization Algorithmscited by 14,592
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,986
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,103
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,389
  5. 2020Extracting Training Data from Large Language Modelscited by 2,181
  6. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,141
  7. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,032
  8. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 853
  9. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 824
  10. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 760
  11. 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 648
  12. 2023LaMP: When Large Language Models Meet Personalizationcited by 430
38 more
  1. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 421
  2. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 406
  3. 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 396
  4. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 388
  5. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agentscited by 360
  6. 2023Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Mergingcited by 275
  7. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 269
  8. 2016A Persona-Based Neural Conversation Modelcited by 223
  9. 2022Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpointscited by 208
  10. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
  11. 2023Simple synthetic data reduces sycophancy in large language modelscited by 185
  12. 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 179
  13. 2025Qwen3Guard Technical Reportcited by 147
  14. 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 145
  15. 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contextscited by 144
  16. 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 139
  17. 2025Memory Injection Attacks on LLM Agents via Query-Only Interactioncited by 138
  18. 2025MemOS: A Memory OS for AI Systemcited by 134
  19. 2023Distributional Preference Learning: Understanding and Accounting for Hidden Context in RLHFcited by 130
  20. 2024Personalized Language Modeling from Personalized Human Feedbackcited by 129
  21. 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 124
  22. 2024MaxMin-RLHF: Alignment with Diverse Human Preferencescited by 123
  23. 2024MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentationcited by 119
  24. 2024AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agentscited by 102
  25. 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 95
  26. 2024LongLaMP: A Benchmark for Personalized Long-form Text Generationcited by 93
  27. 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 87
  28. 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 84
  29. 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agentscited by 76
  30. 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolutioncited by 71
  31. 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedbackcited by 70
  32. 2024Large Language Model Safety: A Holistic Surveycited by 59
  33. 2024Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometricscited by 58
  34. 2024PersonalLLM: Tailoring LLMs to Individual Preferencescited by 58
  35. 2023Faithful Persona-based Conversational Dataset Generation with Large Language Modelscited by 47
  36. 2025Hindsight is 20/20: Building Agent Memory that Retains, Recalls, and Reflectscited by 42
  37. 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applicationscited by 41
  38. 2024LLMs + Persona-Plug = Personalized LLMscited by 30

50 most cited of 93 All 93 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Exploring Safety-Utility Trade-Offs in Personalized Language Models
  2. 2026Large Language Models Should Learn Personalized Rather Than Aggregated Human Preferences
  3. 2026Towards Natural Personalization: Evaluating Long-Horizon Preference Following in Personalized User-LLM Interactions
  4. 2026Re-Centering Humans in LLM Personalization
  5. 2025Personalize Your LLM: Fake it then Align it
  6. 2026Many Preferences, Few Policies: Towards Scalable Language Model Personalization
  7. 2026Synthetic Interaction Data for Scalable Personalization in Large Language Models
  8. 2025Evaluating Personalized Tool-Augmented LLMs from the Perspectives of Personalization and Proactivity