Personalization of Large Language Models: A Survey
Not on the map. Why?
Abstract (arXiv)
Personalization of Large Language Models (LLMs) has recently become increasingly important with a wide range of applications. Despite the importance and recent progress, most existing works on personalized LLMs have focused either entirely on (a) personalized text generation or (b) leveraging LLMs for personalization-related downstream applications, such as recommendation systems. In this work, we bridge the gap between these two separate main directions for the first time by introducing a taxonomy for personalized LLM usage and summarizing the key differences and challenges. We provide a formalization of the foundations of personalized LLMs that consolidates and expands notions of personalization of LLMs, defining and discussing novel facets of personalization, usage, and desiderata of personalized LLMs. We then unify the literature across these diverse fields and usage scenarios by proposing systematic taxonomies for the granularity of personalization, personalization techniques, datasets, evaluation methods, and applications of personalized LLMs. Finally, we highlight challenges and important open problems that remain to be addressed. By unifying and surveying recent research using the proposed taxonomies, we aim to provide a clear guide to the existing literature and different facets of personalization in LLMs, empowering both researchers and practitioners.
Key facts. Cited by 104 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Oct 2024.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 50; 2026: 54.
104 papers.
Sort:
By area:
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
- 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agentscited by 106
- 2025PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memorycited by 88
- 2025A Survey of Personalized Large Language Models: Progress and Future Directionscited by 71
- 2025FalseReject: A Resource for Improving Contextual Safety and Mitigating Over-Refusals in LLMs via Structured Reasoningcited by 58
- 2025Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalizationcited by 45
- 2026Doc-to-LoRA: Learning to Instantly Internalize Contextscited by 43
- 2025Personalized Text Generation with Contrastive Activation Steeringcited by 34
- 2025Language Model Personalization via Reward Factorizationcited by 31
- 2026TiMem: Temporal-Hierarchical Memory Consolidation for Long-Horizon Conversational Agentscited by 31
- 2025A Survey on Personalized and Pluralistic Preference Alignment in Large Language Modelscited by 27
- 2025Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignmentcited by 24
38 more
- 2025Open Character Training: Shaping the Persona of AI Assistants through Constitutional AIcited by 24
- 2025Representation Engineering for Large-Language Models: Survey and Research Challengescited by 21
- 2025Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personascited by 19
- 2025CiteEval: Principle-Driven Citation Evaluation for Source Attributioncited by 19
- 2025A Personalized Conversational Benchmark: Towards Simulating Personalized Conversationscited by 17
- 2025Evaluating Long-Context Reasoning in LLM-Based WebAgentscited by 15
- 2026Skill-R1: Agent Skill Evolution via Reinforcement Learningcited by 15
- 2025Epistemic Alignment: A Mediating Framework for User-LLM Knowledge Deliverycited by 14
- 2025The Era of Real-World Human Interaction: RL from User Conversationscited by 13
- 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactionscited by 12
- 2026PersonaVLM: Long-Term Personalized Multimodal LLMscited by 11
- 2025Rethinking Diverse Human Preference Learning through Principal Component Analysiscited by 10
- 2025In-context Ranking Preference Optimizationcited by 9
- 2025AdaBoN: Adaptive Best-of-N Alignmentcited by 9
- 2025No for Some, Yes for Others: Persona Prompts and Other Sources of False Refusal in Language Modelscited by 9
- 2025Personalization Toolkit: Training Free Personalization of Large Vision Language Modelscited by 8
- 2025Capturing Individual Human Preferences with Reward Featurescited by 8
- 2025Advancing and Benchmarking Personalized Tool Invocation for LLMscited by 8
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
- 2025T-POP: Test-Time Personalization with Online Preference Feedbackcited by 7
- 2026User as Code: Executable Memory for Personalized Agentscited by 7
- 2025ToolSpectrum : Towards Personalized Tool Utilization for Large Language Modelscited by 6
- 2025Beyond Data Privacy: New Privacy Risks for Large Language Modelscited by 6
- 2025Dissecting Persona-Driven Reasoning in Language Models via Activation Patchingcited by 5
- 2025PREF: Reference-Free Evaluation of Personalised Text Generation in LLMscited by 5
- 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Modelscited by 5
- 2026Long Context, Less Focus: A Scaling Gap in LLMs Revealed through Privacy and Personalizationcited by 5
- 2026Personalization Increases Affective Alignment but Has Role-Dependent Effects on Epistemic Independence in LLMscited by 5
- 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AIcited by 5
- 2025Reasoning Meets Personalization: Unleashing the Potential of Large Reasoning Model for Personalized Generationcited by 4
- 2025RPM: Reasoning-Level Personalization for Black-Box Large Language Modelscited by 3
- 2026Rethinking Personalization in Large Language Models at the Token Levelcited by 3
- 2026GISTBench: Evaluating LLM User Understanding via Evidence-Based Interest Verificationcited by 3
- 2026Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interestcited by 3
- 2026Personal Visual Context Learning in Large Multimodal Modelscited by 3
- 2025UC-MOA: Utility-Conditioned Multi-Objective Alignment for Distributional Pareto-Optimalitycited by 2
- 2025PersonaBOT: Bringing Customer Personas to Life with LLMs and RAGcited by 2
- 2025Aligning VLM Assistants with Personalized Situated Cognitioncited by 2
50 most cited of 104 All 104 (JSON)
- 2026Fine-Tuning a 3B-Parameter LLM on a Smartphone: Characterizing Sustained Training5 Oct 2026
- 2026Extracting Persona Subspaces Through Iterative Nullspace Projection For Modulation3 Oct 2026
- 2026PB-GRPO: Learning Socially Adaptive LLM Agents from Persona-Driven Simulation with Preference-Batched GRPO2 Oct 2026
- 2026Personalized Image Generation with Reasoning and Reflection30 Sep 2026
- 2026Privacy in Personalized AI Is a System Property, Not Just a Model Property29 Sep 2026
- 2026Rubric-Aware On-Policy Self-Distillation for LLM Personalization28 Sep 2026
- 2026Using Context Is Not Enough: Test-Time Training for Personalized Reward Modeling28 Sep 2026
- 2026Kernel-Managed Shared Memory for System-Wide Personalization9 Sep 2026
- 2026CAPTURE: Disentangling Preference Drift from Memory Poisoning in Personalized LLM Agents2 Sep 2026
- 2026Hypotheses-Guided Self Distillation for Continual Personalization31 Aug 2026
- 2026Weightless Fine-Tuning: Personalizing LLMs via Logit-Space Transport11 Aug 2026
- 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AI11 Aug 2026
38 more
- 2026SPIEval: Evaluating Large Language Models as Mobile Assistants over Scattered Personal Information11 Aug 2026
- 2026PaperRouter-Agent: A Content-Grounded LLM Agent for Personalized Hierarchical Paper Routing13 Jul 2026
- 2026REAR: Test-time Preference Realignment through Reward Decomposition29 Jun 2026
- 2026Bounded Personas Match Retrieval on Classification but Not Regression for a Frozen Agent25 Jun 2026
- 2026Prompt-Space Meta-Learning Does Not Transfer Across Users: A Frozen-LLM Negative Result25 Jun 2026
- 2026Retrieval-Augmented Personalization with Foundation Models for Wearable Stress Detection23 Jun 2026
- 2026MemSlides: A Hierarchical Memory Driven Agent Framework for Personalized Slide Generation with Multi-turn Local Revision15 Jun 2026
- 2026User as Code: Executable Memory for Personalized Agents15 Jun 2026
- 2026RL-Index: Reinforcement Learning for Retrieval Index Reasoning15 Jun 2026
- 2026Preference-Aware Rubric Learning for Personalized Evaluation29 May 2026
- 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions26 May 2026
- 2026MATO: Multi-objective Personalized Alignment with Test-time Optimization for Large Language Models25 May 2026
- 2026OLIVIA: Online Learning via Inference-time Action Adaptation for Decision Making in LLM ReAct Agents11 May 2026
- 2026Personal Visual Context Learning in Large Multimodal Models11 May 2026
- 2026Reasoning Is Not Free: Robust Adaptive Cost-Efficient Routing for LLM-as-a-Judge11 May 2026
- 2026LLM Agents Enable User-Governed Personalization Beyond Platform Boundaries10 May 2026
- 2026Skill-R1: Agent Skill Evolution via Reinforcement Learning10 May 2026
- 2026Skill-CMIB: Multimodal Agent Skill for Consistent Action via Conditional Multimodal Information Bottleneck8 May 2026
- 2026Sparse Personalized Text Generation with Multi-Trajectory Reasoning27 Apr 2026
- 2026Alignment has a Fantasia Problem23 Apr 2026
- 2026JudgeMeNot: Personalizing Large Language Models to Emulate Judicial Reasoning in Hebrew20 Apr 2026
- 2026Hierarchical Alignment: Enforcing Hierarchical Instruction-Following in LLMs through Logical Consistency10 Apr 2026
- 2026Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interest9 Apr 2026
- 2026High-Stakes Personalization: Rethinking LLM Customization for Individual Investor Decision-Making5 Apr 2026
- 2026DeltaMem: Towards Agentic Memory Management via Reinforcement Learning2 Apr 2026
- 2026GISTBench: Evaluating LLM User Understanding via Evidence-Based Interest Verification31 Mar 2026
- 2026EpiPersona: Persona Projection and Episode Coupling for Pluralistic Preference Modeling30 Mar 2026
- 2026Riding Brainwaves in LLM Space: Understanding Activation Patterns Using Individual Neural Signatures23 Mar 2026
- 2026PersonaVLM: Long-Term Personalized Multimodal LLMs20 Mar 2026
- 2026Learning Dynamic Belief Graphs for Theory-of-mind Reasoning20 Mar 2026
- 2026Hybrid Intent-Aware Personalization with Machine Learning and RAG-Enabled Large Language Models for Financial Services Marketing11 Mar 2026
- 2026Ego: Embedding-Guided Personalization of Vision-Language Models10 Mar 2026
- 2026Life-Bench: A Benchmark and Knowledge Graph Framework for Multimodal Personalization Beyond Concept Recognition22 Feb 2026
- 2026Personalized Group Relative Policy Optimization for Heterogenous Preference Alignment17 Feb 2026
- 2026Long Context, Less Focus: A Scaling Gap in LLMs Revealed through Privacy and Personalization16 Feb 2026
- 2026Doc-to-LoRA: Learning to Instantly Internalize Contexts13 Feb 2026
- 2026Rethinking Personalization in Large Language Models at the Token Level4 Feb 2026
- 2026Personalization Increases Affective Alignment but Has Role-Dependent Effects on Epistemic Independence in LLMs3 Feb 2026
50 newest of 104 All 104 (JSON)
- 2025FalseReject: A Resource for Improving Contextual Safety and Mitigating Over-Refusals in LLMs via Structured Reasoningcited by 58
- 2026Doc-to-LoRA: Learning to Instantly Internalize Contextscited by 43
- 2025Evaluating Long-Context Reasoning in LLM-Based WebAgentscited by 15
- 2025Rethinking Diverse Human Preference Learning through Principal Component Analysiscited by 10
- 2025Dissecting Persona-Driven Reasoning in Language Models via Activation Patchingcited by 5
- 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Modelscited by 5
- 2025Reasoning Meets Personalization: Unleashing the Potential of Large Reasoning Model for Personalized Generationcited by 4
- 2025RPM: Reasoning-Level Personalization for Black-Box Large Language Modelscited by 3
- 2026Rethinking Personalization in Large Language Models at the Token Levelcited by 3
- 2026Reasoning Is Not Free: Robust Adaptive Cost-Efficient Routing for LLM-as-a-Judgecited by 2
- 2026OLIVIA: Online Learning via Inference-time Action Adaptation for Decision Making in LLM ReAct Agentscited by 2
- 2026RL-Index: Reinforcement Learning for Retrieval Index Reasoningcited by 2
12 most cited of 19 All 19 (JSON)
- 2026PB-GRPO: Learning Socially Adaptive LLM Agents from Persona-Driven Simulation with Preference-Batched GRPO2 Oct 2026
- 2026RL-Index: Reinforcement Learning for Retrieval Index Reasoning15 Jun 2026
- 2026OLIVIA: Online Learning via Inference-time Action Adaptation for Decision Making in LLM ReAct Agents11 May 2026
- 2026Reasoning Is Not Free: Robust Adaptive Cost-Efficient Routing for LLM-as-a-Judge11 May 2026
- 2026Sparse Personalized Text Generation with Multi-Trajectory Reasoning27 Apr 2026
- 2026JudgeMeNot: Personalizing Large Language Models to Emulate Judicial Reasoning in Hebrew20 Apr 2026
- 2026High-Stakes Personalization: Rethinking LLM Customization for Individual Investor Decision-Making5 Apr 2026
- 2026Learning Dynamic Belief Graphs for Theory-of-mind Reasoning20 Mar 2026
- 2026Personalized Group Relative Policy Optimization for Heterogenous Preference Alignment17 Feb 2026
- 2026Doc-to-LoRA: Learning to Instantly Internalize Contexts13 Feb 2026
- 2026Rethinking Personalization in Large Language Models at the Token Level4 Feb 2026
- 2026Reasoning-Based Personalized Generation for Users with Sparse Data31 Jan 2026
12 newest of 19 All 19 (JSON)
- 2025Language Model Personalization via Reward Factorizationcited by 31
- 2025A Survey on Personalized and Pluralistic Preference Alignment in Large Language Modelscited by 27
- 2025Open Character Training: Shaping the Persona of AI Assistants through Constitutional AIcited by 24
- 2025Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personascited by 19
- 2025In-context Ranking Preference Optimizationcited by 9
- 2025AdaBoN: Adaptive Best-of-N Alignmentcited by 9
- 2025Capturing Individual Human Preferences with Reward Featurescited by 8
- 2025T-POP: Test-Time Personalization with Online Preference Feedbackcited by 7
- 2025UC-MOA: Utility-Conditioned Multi-Objective Alignment for Distributional Pareto-Optimalitycited by 2
- 2026Preference-Aware Rubric Learning for Personalized Evaluationcited by 2
- 2026EpiPersona: Persona Projection and Episode Coupling for Pluralistic Preference Modelingcited by 0
- 2026MATO: Multi-objective Personalized Alignment with Test-time Optimization for Large Language Modelscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Using Context Is Not Enough: Test-Time Training for Personalized Reward Modeling28 Sep 2026
- 2026REAR: Test-time Preference Realignment through Reward Decomposition29 Jun 2026
- 2026Preference-Aware Rubric Learning for Personalized Evaluation29 May 2026
- 2026MATO: Multi-objective Personalized Alignment with Test-time Optimization for Large Language Models25 May 2026
- 2026EpiPersona: Persona Projection and Episode Coupling for Pluralistic Preference Modeling30 Mar 2026
- 2025Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI3 Nov 2025
- 2025T-POP: Test-Time Personalization with Online Preference Feedback29 Sep 2025
- 2025AdaBoN: Adaptive Best-of-N Alignment17 May 2025
- 2025In-context Ranking Preference Optimization21 Apr 2025
- 2025A Survey on Personalized and Pluralistic Preference Alignment in Large Language Models9 Apr 2025
- 2025Capturing Individual Human Preferences with Reward Features21 Mar 2025
- 2025UC-MOA: Utility-Conditioned Multi-Objective Alignment for Distributional Pareto-Optimality10 Mar 2025
12 newest of 14 All 14 (JSON)
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
- 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agentscited by 106
- 2025PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memorycited by 88
- 2026TiMem: Temporal-Hierarchical Memory Consolidation for Long-Horizon Conversational Agentscited by 31
- 2026Skill-R1: Agent Skill Evolution via Reinforcement Learningcited by 15
- 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactionscited by 12
- 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AIcited by 5
- 2026DeltaMem: Towards Agentic Memory Management via Reinforcement Learningcited by 2
- 2026LLM Agents Enable User-Governed Personalization Beyond Platform Boundariescited by 2
- 2026Skill-CMIB: Multimodal Agent Skill for Consistent Action via Conditional Multimodal Information Bottleneckcited by 1
- 2026PaperRouter-Agent: A Content-Grounded LLM Agent for Personalized Hierarchical Paper Routingcited by 0
- 2026CAPTURE: Disentangling Preference Drift from Memory Poisoning in Personalized LLM Agentscited by 0
- 2026CAPTURE: Disentangling Preference Drift from Memory Poisoning in Personalized LLM Agents2 Sep 2026
- 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AI11 Aug 2026
- 2026PaperRouter-Agent: A Content-Grounded LLM Agent for Personalized Hierarchical Paper Routing13 Jul 2026
- 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions26 May 2026
- 2026LLM Agents Enable User-Governed Personalization Beyond Platform Boundaries10 May 2026
- 2026Skill-R1: Agent Skill Evolution via Reinforcement Learning10 May 2026
- 2026Skill-CMIB: Multimodal Agent Skill for Consistent Action via Conditional Multimodal Information Bottleneck8 May 2026
- 2026DeltaMem: Towards Agentic Memory Management via Reinforcement Learning2 Apr 2026
- 2026TiMem: Temporal-Hierarchical Memory Consolidation for Long-Horizon Conversational Agents6 Jan 2026
- 2025PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memory7 Dec 2025
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul 2025
- 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents11 Mar 2025
- 2026PersonaVLM: Long-Term Personalized Multimodal LLMscited by 11
- 2025Personalization Toolkit: Training Free Personalization of Large Vision Language Modelscited by 8
- 2026Personal Visual Context Learning in Large Multimodal Modelscited by 3
- 2025Aligning VLM Assistants with Personalized Situated Cognitioncited by 2
- 2026Ego: Embedding-Guided Personalization of Vision-Language Modelscited by 0
- 2026Personal Visual Context Learning in Large Multimodal Models11 May 2026
- 2026PersonaVLM: Long-Term Personalized Multimodal LLMs20 Mar 2026
- 2026Ego: Embedding-Guided Personalization of Vision-Language Models10 Mar 2026
- 2025Aligning VLM Assistants with Personalized Situated Cognition1 Jun 2025
- 2025Personalization Toolkit: Training Free Personalization of Large Vision Language Models4 Feb 2025
- 2025A Survey of Personalized Large Language Models: Progress and Future Directionscited by 71
- 2025Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalizationcited by 45
- 2025Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignmentcited by 24
- 2025CiteEval: Principle-Driven Citation Evaluation for Source Attributioncited by 19
- 2025A Personalized Conversational Benchmark: Towards Simulating Personalized Conversationscited by 17
- 2025Epistemic Alignment: A Mediating Framework for User-LLM Knowledge Deliverycited by 14
- 2025The Era of Real-World Human Interaction: RL from User Conversationscited by 13
- 2025No for Some, Yes for Others: Persona Prompts and Other Sources of False Refusal in Language Modelscited by 9
- 2025Advancing and Benchmarking Personalized Tool Invocation for LLMscited by 8
- 2026User as Code: Executable Memory for Personalized Agentscited by 7
- 2025ToolSpectrum : Towards Personalized Tool Utilization for Large Language Modelscited by 6
- 2025Beyond Data Privacy: New Privacy Risks for Large Language Modelscited by 6
12 most cited of 47 All 47 (JSON)
- 2026Fine-Tuning a 3B-Parameter LLM on a Smartphone: Characterizing Sustained Training5 Oct 2026
- 2026Extracting Persona Subspaces Through Iterative Nullspace Projection For Modulation3 Oct 2026
- 2026Personalized Image Generation with Reasoning and Reflection30 Sep 2026
- 2026Privacy in Personalized AI Is a System Property, Not Just a Model Property29 Sep 2026
- 2026Kernel-Managed Shared Memory for System-Wide Personalization9 Sep 2026
- 2026Weightless Fine-Tuning: Personalizing LLMs via Logit-Space Transport11 Aug 2026
- 2026SPIEval: Evaluating Large Language Models as Mobile Assistants over Scattered Personal Information11 Aug 2026
- 2026Bounded Personas Match Retrieval on Classification but Not Regression for a Frozen Agent25 Jun 2026
- 2026Prompt-Space Meta-Learning Does Not Transfer Across Users: A Frozen-LLM Negative Result25 Jun 2026
- 2026Retrieval-Augmented Personalization with Foundation Models for Wearable Stress Detection23 Jun 2026
- 2026MemSlides: A Hierarchical Memory Driven Agent Framework for Personalized Slide Generation with Multi-turn Local Revision15 Jun 2026
- 2026User as Code: Executable Memory for Personalized Agents15 Jun 2026
12 newest of 47 All 47 (JSON)