Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalization
Not on the map. Why?
Abstract (arXiv)
Personalizing Large Language Models (LLMs) has become a critical step in facilitating their widespread application to enhance individual life experiences. In pursuit of personalization, distilling key preference information from an individual's historical data as instructional preference context to customize LLM generation has emerged as a promising direction. However, these methods face a fundamental limitation by overlooking the inter-user comparative analysis, which is essential for identifying the inter-user differences that truly shape preferences. To address this limitation, we propose Difference-aware Personalization Learning (DPL), a novel approach that emphasizes extracting inter-user differences to enhance LLM personalization. DPL strategically selects representative users for comparison and establishes a structured standard to extract meaningful, task-relevant differences for customizing LLM generation. Extensive experiments on real-world datasets demonstrate that DPL significantly enhances LLM personalization. We release our code at https://github.com/SnowCharmQ/DPL.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Builds on 43 of its 84 references that are in the map. First posted on arXiv 4 Mar 2025.
Builds on
43 of 84 references.
References · 43
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
- 2023LaMP: When Large Language Models Meet Personalizationcited by 425
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 336
- 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Securitycited by 257
31 more
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 224
- 2024Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoderscited by 213
- 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 142
- 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
- 2023Do LLMs Understand User Preferences? Evaluating LLMs On User Rating Predictioncited by 113
- 2023GPT4Rec: A Generative Framework for Personalized Recommendation and User Interests Interpretationcited by 101
- 2024Personalization of Large Language Models: A Surveycited by 100
- 2023CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendationcited by 99
- 2024Optimization Methods for Personalizing Large Language Models through Retrieval Augmentationcited by 98
- 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrieverscited by 91
- 2024LongLaMP: A Benchmark for Personalized Long-form Text Generationcited by 91
- 2024On Softmax Direct Preference Optimization for Recommendationcited by 64
- 2024Large Language Models Empowered Personalized Web Agentscited by 64
- 2024HYDRA: Model Factorization Framework for Black-Box LLM Personalizationcited by 59
- 2024PAD: Personalized Alignment of LLMs at Decoding-Timecited by 58
- 2023Teach LLMs to Personalize -- An Approach inspired by Writing Educationcited by 48
- 2024Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinementcited by 47
- 2024On the Multi-turn Instruction Following for Conversational Web Agentscited by 42
- 2023SentimentGPT: Exploiting GPT for Advanced Sentiment Analysis and its Departure from Current Machine Learningcited by 38
- 2024Harnessing Large Language Models for Text-Rich Sequential Recommendationcited by 38
- 2024Leveraging Large Language Models for NLG Evaluation: Advances and Challengescited by 37
- 2025Reasoning-Enhanced Self-Training for Long-Form Personalized Text Generationcited by 26
- 2022How Far are We from Robust Long Abstractive Summarization?cited by 25
- 2024Text-like Encoding of Collaborative Information in Large Language Models for Recommendationcited by 25
- 2023Large Language Models for User Interest Journeyscited by 24
- 2025Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMscited by 22
- 2024Customizing Language Model Responses with Contrastive In-Context Learningcited by 19
- 2025Self-Improvement Towards Pareto Optimality: Mitigating Preference Conflicts in Multi-Objective Alignmentcited by 15
- 2024Review-LLM: Harnessing Large Language Models for Personalized Review Generationcited by 14
- 2019A Lexical, Syntactic, and Semantic Perspective for Understanding Style in Textcited by 8
- 2024Leveraging Memory Retrieval to Enhance LLM-based Generative Recommendationcited by 6
Built on by
Citing papers per year: 2025: 16; 2026: 28.
44 papers.
Sort:
By area:
- 2025O-Mem: Omni Memory System for Personalized, Long Horizon, Self-Evolving Agentscited by 30
- 2025Think-While-Generating: On-the-Fly Reasoning for Personalized Long-Form Generationcited by 29
- 2025Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignmentcited by 22
- 2025Latent Inter-User Difference Modeling for LLM Personalizationcited by 20
- 2025L-MTP: Leap Multi-Token Prediction Beyond Adjacent Context for Large Language Modelscited by 14
- 2025Anthropomimetic Uncertainty: What Verbalized Uncertainty in Language Models is Missingcited by 14
- 2025Persona-judge: Personalized Alignment of Large Language Models via Token-level Self-judgmentcited by 11
- 2025TOM-SWE: User Mental Modeling For Software Engineering Agentscited by 11
- 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directionscited by 10
- 2025MemWeaver: A Hierarchical Memory from Textual Interactive Behaviors for Personalized Generationcited by 8
- 2025SteerX: Disentangled Steering for LLM Personalizationcited by 7
- 2026AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignmentcited by 6
32 more
- 2025POPI: Personalizing LLMs via Optimized Natural Language Preference Inferencecited by 5
- 2026PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Modelscited by 5
- 2025Reinforced Strategy Optimization for Conversational Recommender Systems via Network-of-Expertscited by 4
- 2025Tagging the Thought: Unlocking Personalization Reasoning via Reinforcement Learningcited by 3
- 2026Know You Before You Speak: User-State Modeling for LLM Personalization in Multi-Turn Conversationcited by 3
- 2025Mnemosyne: An Unsupervised, Human-Inspired Long-Term Memory Architecture for Edge-Based LLMscited by 2
- 2026CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generationcited by 2
- 2026When Personalization Misleads: Understanding and Mitigating Hallucinations in Personalized LLMscited by 2
- 2026Meet Dynamic Individual Preferences: Resolving Conflicting Human Value with Paired Fine-Tuningcited by 2
- 2026Preference Heads in Large Language Models: A Mechanistic Framework for Interpretable Personalizationcited by 2
- 2026Preference-Aware Rubric Learning for Personalized Evaluationcited by 2
- 2026TSUBASA: Improving Long-Horizon Personalization via Evolving Memory and Self-Learning with Context Distillationcited by 1
- 2026LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generationcited by 1
- 2026Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMscited by 1
- 2025Explain Less, Understand More: Data-Efficient Personalization of Reader-Dependent Jargonscited by 0
- 2025Comparative Personalization for Multi-document Summarizationcited by 0
- 2026Do Implicit Personalization and Explicit Styles Conflict? PsPLUG: A Lightweight Plug-in for Balancing Personalization and Style in Customized LLMscited by 0
- 2026The Subjectivity of Respect in Police Traffic Stops: Modeling Community Perspectives in Body-Worn Camera Footagecited by 0
- 2026NextAds: Towards Next-generation Personalized Video Advertisingcited by 0
- 2026Recall Isn't Enough: Bounding Commitments in Personalized Language Systemscited by 0
- 2026StreamProfileBench: A Benchmark for Fine-Grained User Profile Inference in Real-World Streaming Scenarioscited by 0
- 2026ChildEval: When large language models meet children's personalitiescited by 0
- 2026PAFO: Pareto Fairness Optimization for Personalized Reward Modelingcited by 0
- 2026The Personalization Mirage: How LLMs Fabricate User Profiles, and Why Self-Monitoring Misleadscited by 0
- 2026PersonaEdit: Representative Sample Selection for Personalized Model Editingcited by 0
- 2026VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don't Mean Preferencescited by 0
- 2026PLUME: Parameter-Efficient Personalization of Large Language Models via Low-Rank User Modulation in Shared Subspacescited by 0
- 2026HyperTrace: Hypothesis-Based Preference Tracing for Online LLM Personalizationcited by 0
- 2026COPE: Continual Personalization of LLMs under Sparse User Feedback via User Embeddings and Self-Evaluationcited by 0
- 2026Beyond End-to-End Black Box Mapping: An Intentional Agent Framework for Cognitive-driven Facial Reaction Generationcited by 0
- 2026Rubric-Aware On-Policy Self-Distillation for LLM Personalizationcited by 0
- 2026Gradient-Aligned Pair Selection for Personalized Preference Optimizationcited by 0
- 2026Rubric-Aware On-Policy Self-Distillation for LLM Personalization28 Sep 2026
- 2026Beyond End-to-End Black Box Mapping: An Intentional Agent Framework for Cognitive-driven Facial Reaction Generation28 Sep 2026
- 2026COPE: Continual Personalization of LLMs under Sparse User Feedback via User Embeddings and Self-Evaluation22 Sep 2026
- 2026HyperTrace: Hypothesis-Based Preference Tracing for Online LLM Personalization9 Sep 2026
- 2026Gradient-Aligned Pair Selection for Personalized Preference Optimization4 Sep 2026
- 2026PLUME: Parameter-Efficient Personalization of Large Language Models via Low-Rank User Modulation in Shared Subspaces4 Sep 2026
- 2026VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don't Mean Preferences1 Sep 2026
- 2026PersonaEdit: Representative Sample Selection for Personalized Model Editing28 Aug 2026
- 2026The Personalization Mirage: How LLMs Fabricate User Profiles, and Why Self-Monitoring Misleads5 Aug 2026
- 2026Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMs22 Jun 2026
- 2026PAFO: Pareto Fairness Optimization for Personalized Reward Modeling6 Jun 2026
- 2026Preference-Aware Rubric Learning for Personalized Evaluation29 May 2026
32 more
- 2026ChildEval: When large language models meet children's personalities27 May 2026
- 2026LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generation26 May 2026
- 2026StreamProfileBench: A Benchmark for Fine-Grained User Profile Inference in Real-World Streaming Scenarios25 May 2026
- 2026Know You Before You Speak: User-State Modeling for LLM Personalization in Multi-Turn Conversation23 May 2026
- 2026Recall Isn't Enough: Bounding Commitments in Personalized Language Systems15 May 2026
- 2026Preference Heads in Large Language Models: A Mechanistic Framework for Interpretable Personalization24 Apr 2026
- 2026Meet Dynamic Individual Preferences: Resolving Conflicting Human Value with Paired Fine-Tuning14 Apr 2026
- 2026TSUBASA: Improving Long-Horizon Personalization via Evolving Memory and Self-Learning with Context Distillation9 Apr 2026
- 2026AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignment9 Mar 2026
- 2026NextAds: Towards Next-generation Personalized Video Advertising2 Mar 2026
- 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directions26 Feb 2026
- 2026The Subjectivity of Respect in Police Traffic Stops: Modeling Community Perspectives in Body-Worn Camera Footage10 Feb 2026
- 2026When Personalization Misleads: Understanding and Mitigating Hallucinations in Personalized LLMs16 Jan 2026
- 2026PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Models15 Jan 2026
- 2026Do Implicit Personalization and Explicit Styles Conflict? PsPLUG: A Lightweight Plug-in for Balancing Personalization and Style in Customized LLMs10 Jan 2026
- 2026CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generation9 Jan 2026
- 2025Think-While-Generating: On-the-Fly Reasoning for Personalized Long-Form Generation7 Dec 2025
- 2025O-Mem: Omni Memory System for Personalized, Long Horizon, Self-Evolving Agents17 Nov 2025
- 2025SteerX: Disentangled Steering for LLM Personalization25 Oct 2025
- 2025TOM-SWE: User Mental Modeling For Software Engineering Agents24 Oct 2025
- 2025POPI: Personalizing LLMs via Optimized Natural Language Preference Inference17 Oct 2025
- 2025MemWeaver: A Hierarchical Memory from Textual Interactive Behaviors for Personalized Generation9 Oct 2025
- 2025Mnemosyne: An Unsupervised, Human-Inspired Long-Term Memory Architecture for Edge-Based LLMs7 Oct 2025
- 2025Reinforced Strategy Optimization for Conversational Recommender Systems via Network-of-Experts30 Sep 2025
- 2025Tagging the Thought: Unlocking Personalization Reasoning via Reinforcement Learning27 Sep 2025
- 2025Comparative Personalization for Multi-document Summarization25 Sep 2025
- 2025Latent Inter-User Difference Modeling for LLM Personalization28 Jul 2025
- 2025Anthropomimetic Uncertainty: What Verbalized Uncertainty in Language Models is Missing11 Jul 2025
- 2025L-MTP: Leap Multi-Token Prediction Beyond Adjacent Context for Large Language Models23 May 2025
- 2025Explain Less, Understand More: Data-Efficient Personalization of Reader-Dependent Jargons22 May 2025
- 2025Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignment21 May 2025
- 2025Persona-judge: Personalized Alignment of Large Language Models via Token-level Self-judgment17 Apr 2025
- 2025Persona-judge: Personalized Alignment of Large Language Models via Token-level Self-judgmentcited by 11
- 2026PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Modelscited by 5
- 2026CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generationcited by 2
- 2026Meet Dynamic Individual Preferences: Resolving Conflicting Human Value with Paired Fine-Tuningcited by 2
- 2026Preference-Aware Rubric Learning for Personalized Evaluationcited by 2
- 2026PAFO: Pareto Fairness Optimization for Personalized Reward Modelingcited by 0
- 2026VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don't Mean Preferencescited by 0
- 2026HyperTrace: Hypothesis-Based Preference Tracing for Online LLM Personalizationcited by 0
- 2026HyperTrace: Hypothesis-Based Preference Tracing for Online LLM Personalization9 Sep 2026
- 2026VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don't Mean Preferences1 Sep 2026
- 2026PAFO: Pareto Fairness Optimization for Personalized Reward Modeling6 Jun 2026
- 2026Preference-Aware Rubric Learning for Personalized Evaluation29 May 2026
- 2026Meet Dynamic Individual Preferences: Resolving Conflicting Human Value with Paired Fine-Tuning14 Apr 2026
- 2026PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Models15 Jan 2026
- 2026CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generation9 Jan 2026
- 2025Persona-judge: Personalized Alignment of Large Language Models via Token-level Self-judgment17 Apr 2025
- 2025Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignmentcited by 22
- 2025Latent Inter-User Difference Modeling for LLM Personalizationcited by 20
- 2025L-MTP: Leap Multi-Token Prediction Beyond Adjacent Context for Large Language Modelscited by 14
- 2025Anthropomimetic Uncertainty: What Verbalized Uncertainty in Language Models is Missingcited by 14
- 2025MemWeaver: A Hierarchical Memory from Textual Interactive Behaviors for Personalized Generationcited by 8
- 2025SteerX: Disentangled Steering for LLM Personalizationcited by 7
- 2026AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignmentcited by 6
- 2025POPI: Personalizing LLMs via Optimized Natural Language Preference Inferencecited by 5
- 2025Reinforced Strategy Optimization for Conversational Recommender Systems via Network-of-Expertscited by 4
- 2026Know You Before You Speak: User-State Modeling for LLM Personalization in Multi-Turn Conversationcited by 3
- 2025Mnemosyne: An Unsupervised, Human-Inspired Long-Term Memory Architecture for Edge-Based LLMscited by 2
- 2026When Personalization Misleads: Understanding and Mitigating Hallucinations in Personalized LLMscited by 2
12 most cited of 31 All 31 (JSON)
- 2026Rubric-Aware On-Policy Self-Distillation for LLM Personalization28 Sep 2026
- 2026Beyond End-to-End Black Box Mapping: An Intentional Agent Framework for Cognitive-driven Facial Reaction Generation28 Sep 2026
- 2026COPE: Continual Personalization of LLMs under Sparse User Feedback via User Embeddings and Self-Evaluation22 Sep 2026
- 2026Gradient-Aligned Pair Selection for Personalized Preference Optimization4 Sep 2026
- 2026PLUME: Parameter-Efficient Personalization of Large Language Models via Low-Rank User Modulation in Shared Subspaces4 Sep 2026
- 2026PersonaEdit: Representative Sample Selection for Personalized Model Editing28 Aug 2026
- 2026The Personalization Mirage: How LLMs Fabricate User Profiles, and Why Self-Monitoring Misleads5 Aug 2026
- 2026Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMs22 Jun 2026
- 2026ChildEval: When large language models meet children's personalities27 May 2026
- 2026LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generation26 May 2026
- 2026StreamProfileBench: A Benchmark for Fine-Grained User Profile Inference in Real-World Streaming Scenarios25 May 2026
- 2026Know You Before You Speak: User-State Modeling for LLM Personalization in Multi-Turn Conversation23 May 2026
12 newest of 31 All 31 (JSON)