mlsanityData to 7 Oct 2026

LaMP: When Large Language Models Meet Personalization

arXiv 2304.11406 ↗First posted 22 Apr 2023cs.CLcited by 425

Not on the map. Why?

Cited by 64 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

This paper highlights the importance of personalization in large language models and introduces the LaMP benchmark -- a novel benchmark for training and evaluating language models for producing personalized outputs. LaMP offers a comprehensive evaluation framework with diverse language tasks and multiple entries for each user profile. It consists of seven personalized tasks, spanning three text classification and four text generation tasks. We additionally propose two retrieval augmentation approaches that retrieve personal items from each user profile for personalizing language model outputs. To this aim, we study various retrieval models, including term matching, semantic matching, and time-aware methods. Extensive experiments on LaMP for zero-shot and fine-tuned language models demonstrate the efficacy of the proposed retrieval augmentation approach and highlight the impact of personalization in various natural language tasks.

Key facts. Cited by 425 papers in the map (data through 7 Oct 2026). Builds on 37 of its 87 references that are in the map. First posted on arXiv 22 Apr 2023.

Builds on

37 of 87 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  6. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  7. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  8. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  9. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  10. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  11. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
  12. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
25 more
  1. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
  2. 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
  3. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  4. 2017Beam Search Strategies for Neural Machine Translationcited by 232
  5. 2022The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluationcited by 133
  6. 2018Training Millions of Personalized Dialogue Agentscited by 126
  7. 2022Jury Learning: Integrating Dissenting Voices into Machine Learning Modelscited by 115
  8. 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 86
  9. 2019Generating Personalized Recipes from Historical User Preferencescited by 52
  10. 2022Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generationcited by 47
  11. 2022News Category Datasetcited by 42
  12. 2020Citation Recommendation: Approaches and Datasetscited by 36
  13. 2021UserIdentifier: Implicit User Representations for Simple and Effective Personalized Sentiment Analysiscited by 28
  14. 2020Pchatbot: A Large-Scale Dataset for Personalized Chatbotcited by 26
  15. 2018Personalized Language Model for Query Auto-Completioncited by 25
  16. 2019Towards Controllable and Personalized Review Generationcited by 24
  17. 2022Unifying Data Perspectivism and Personalization: An Application to Social Normscited by 22
  18. 2018Compact Personalized Models for Neural Machine Translationcited by 19
  19. 2021Idiosyncratic but not Arbitrary: Learning Idiolects in Online Registers Reveals Distinctive yet Consistent Individual Stylescited by 18
  20. 2021Refocusing on Relevance: Personalization in NLGcited by 18
  21. 2022Rethinking Personalized Ranking at Pinterest: An End-to-End Approachcited by 16
  22. 2021Two Contrasting Data Annotation Paradigms for Subjective NLP Taskscited by 12
  23. 2022Human Language Modelingcited by 5
  24. 2021Transformer-based Lexically Constrained Headline Generationcited by 3
  25. 2023Reference-less Analysis of Context Specificity in Translation with Personalised Language Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 35; 2024: 91; 2025: 120; 2026: 179.

425 papers.

Sort:

By area:

  1. 2023Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Mergingcited by 271
  2. 2023Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewardscited by 232
  3. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
  4. 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 198
  5. 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 173
  6. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 170
  7. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 163
  8. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
  9. 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 142
  10. 2023Large Language Models as Zero-Shot Conversational Recommenderscited by 126
  11. 2024A Survey on Large Language Model-Based Game Agentscited by 106
  12. 2024Can LLM be a Personalized Judge?cited by 99
38 more
  1. 2023Aligning Language Models to User Opinionscited by 98
  2. 2024Optimization Methods for Personalizing Large Language Models through Retrieval Augmentationcited by 98
  3. 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrieverscited by 91
  4. 2024LongLaMP: A Benchmark for Personalized Long-form Text Generationcited by 91
  5. 2024Evaluating Retrieval Quality in Retrieval-Augmented Generationcited by 90
  6. 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunitiescited by 89
  7. 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
  8. 2024PersonaGym: Evaluating Persona Agents and LLMscited by 89
  9. 2025PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memorycited by 82
  10. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 76
  11. 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussionscited by 72
  12. 2024Personalized Pieces: Efficient Personalized Large Language Models through Collaborative Effortscited by 71
  13. 2024LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Playcited by 65
  14. 2025A Survey of Personalized Large Language Models: Progress and Future Directionscited by 65
  15. 2024Large Language Models Empowered Personalized Web Agentscited by 64
  16. 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMscited by 62
  17. 2024HYDRA: Model Factorization Framework for Black-Box LLM Personalizationcited by 59
  18. 2023ONCE: Boosting Content-based Recommendation with Both Open- and Closed-source Large Language Modelscited by 54
  19. 2024MC-LLaVA: Multi-Concept Personalized Vision-Language Modelcited by 53
  20. 2023Multimodal LLMs for health grounded in individual-specific datacited by 48
  21. 2023Teach LLMs to Personalize -- An Approach inspired by Writing Educationcited by 48
  22. 2024SocialBench: Sociality Evaluation of Role-Playing Conversational Agentscited by 48
  23. 2024Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinementcited by 47
  24. 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
  25. 2023Knowledge Card: Filling LLMs' Knowledge Gaps with Plug-in Specialized Language Modelscited by 46
  26. 2023LLM-based Medical Assistant Personalization with Short- and Long-Term Memory Coordinationcited by 46
  27. 2023ChatCounselor: A Large Language Models for Mental Health Supportcited by 44
  28. 2025Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalizationcited by 44
  29. 2025PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistantscited by 44
  30. 2023Knowledge-Augmented Large Language Models for Personalized Contextual Query Suggestioncited by 43
  31. 2023Compressed Context Memory For Online Language Model Interactioncited by 42
  32. 2023Learning to Rewrite Prompts for Personalized Text Generationcited by 40
  33. 2023Integrating Summarization and Retrieval for Enhanced Personalization via Large Language Modelscited by 40
  34. 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applicationscited by 40
  35. 2024UniMS-RAG: A Unified Multi-source Retrieval-Augmented Generation for Personalized Dialogue Systemscited by 38
  36. 2024Operationalizing Contextual Integrity in Privacy-Conscious Assistantscited by 36
  37. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topicscited by 36
  38. 2024MathVC: An LLM-Simulated Multi-Character Virtual Classroom for Mathematics Educationcited by 35

50 most cited of 425 All 425 (JSON)