mlsanityData to 7 Oct 2026

LongLaMP: A Benchmark for Personalized Long-form Text Generation

arXiv 2407.11016 ↗First posted 27 Jun 2024cs.CL cs.LGcited by 91

Not on the map. Why?

Abstract (arXiv)

Long-text generation is seemingly ubiquitous in real-world applications of large language models such as generating an email or writing a review. Despite the fundamental importance and prevalence of long-text generation in many practical applications, existing work on personalized generation has focused on the generation of very short text. To overcome these limitations, we study the problem of personalized long-text generation, that is, generating long-text that is personalized for a specific user while being practically useful for the vast majority of real-world applications that naturally require the generation of longer text. In this work, we demonstrate the importance of user-specific personalization for long-text generation tasks and develop the Long-text Language Model Personalization (LongLaMP) Benchmark. LongLaMP provides a comprehensive and diverse evaluation framework for personalized long-text generation. Extensive experiments on LongLaMP for zero-shot and fine-tuned language tasks demonstrate the effectiveness of the proposed benchmark and its utility for developing and evaluating techniques for personalized long-text generation across a wide variety of long-text generation tasks. The results highlight the importance of personalization across a wide variety of long-text generation tasks. Finally, we release the benchmark for others to use for this important problem.

Key facts. Cited by 91 papers in the map (data through 7 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 27 Jun 2024.

Builds on

22 of 37 references.

References · 22

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  5. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  6. 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
  7. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  8. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 734
  9. 2023LaMP: When Large Language Models Meet Personalizationcited by 425
  10. 2017Beam Search Strategies for Neural Machine Translationcited by 232
  11. 2018Training Millions of Personalized Dialogue Agentscited by 126
  12. 2024Optimization Methods for Personalizing Large Language Models through Retrieval Augmentationcited by 98
10 more
  1. 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrieverscited by 91
  2. 2023Teach LLMs to Personalize -- An Approach inspired by Writing Educationcited by 48
  3. 2023Learning to Rewrite Prompts for Personalized Text Generationcited by 40
  4. 2024UniMS-RAG: A Unified Multi-source Retrieval-Augmented Generation for Personalized Dialogue Systemscited by 38
  5. 2023Unsupervised Dense Retrieval with Relevance-Aware Contrastive Pre-Trainingcited by 35
  6. 2021UserIdentifier: Implicit User Representations for Simple and Effective Personalized Sentiment Analysiscited by 28
  7. 2019Towards Controllable and Personalized Review Generationcited by 24
  8. 2022Learning to Transfer Prompts for Text Generationcited by 22
  9. 2024Personalized Text Generation with Fine-Grained Linguistic Controlcited by 20
  10. 2020Knowledge-Enhanced Personalized Review Generation with Capsule Graph Neural Networkcited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 38; 2026: 46.

91 papers.

Sort:

By area:

  1. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 163
  2. 2025A Survey of Personalized Large Language Models: Progress and Future Directionscited by 65
  3. 2024LongGenBench: Benchmarking Long-Form Generation in Long Context LLMscited by 47
  4. 2025Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalizationcited by 44
  5. 2025PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistantscited by 44
  6. 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applicationscited by 40
  7. 2025Personalized Text Generation with Contrastive Activation Steeringcited by 30
  8. 2025LaMP-QA: A Benchmark for Personalized Long-form Question Answeringcited by 30
  9. 2024LLMs + Persona-Plug = Personalized LLMscited by 29
  10. 2025Think-While-Generating: On-the-Fly Reasoning for Personalized Long-Form Generationcited by 29
  11. 2025Reasoning-Enhanced Self-Training for Long-Form Personalized Text Generationcited by 26
  12. 2025ExPerT: Effective and Explainable Evaluation of Personalized Long-Form Text Generationcited by 26
38 more
  1. 2025A Survey of Personalization: From RAG to Agentcited by 26
  2. 2025A Survey on Personalized and Pluralistic Preference Alignment in Large Language Modelscited by 25
  3. 2024Comparing Retrieval-Augmentation and Parameter-Efficient Fine-Tuning for Privacy-Preserving Personalization of Large Language Modelscited by 20
  4. 2024Personalized Multimodal Large Language Models: A Surveycited by 19
  5. 2025PRIME: Large Language Model Personalization with Cognitive Dual-Memory and Personalized Thought Processcited by 16
  6. 2025Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Informationcited by 16
  7. 2025Instant Personalized Large Language Model Adaptation via Hypernetworkcited by 15
  8. 2024Personalized Image Generation with Large Multimodal Modelscited by 14
  9. 2024Accelerating Retrieval-Augmented Generationcited by 14
  10. 2025A Cognitive Writing Perspective for Constrained Long-Form Text Generationcited by 14
  11. 2025Personalized Safety in LLMs: A Benchmark and A Planning-Based Agent Approachcited by 14
  12. 2025SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generationcited by 14
  13. 2026Persona2Web: Benchmarking Personalized Web Agents for Contextual Reasoning with User Historycited by 14
  14. 2025LongWriter-Zero: Mastering Ultra-Long Text Generation via Reinforcement Learningcited by 13
  15. 2025Personalized LLM Decoding via Contrasting Personal Preferencecited by 12
  16. 2025CoSteer: Collaborative Decoding-Time Personalization via Local Delta Steeringcited by 12
  17. 2025A Survey on Transformer Context Extension: Approaches and Evaluationcited by 11
  18. 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactionscited by 11
  19. 2025Personalized Graph-Based Retrieval for Large Language Modelscited by 10
  20. 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directionscited by 10
  21. 2026Towards Natural Personalization: Evaluating Long-Horizon Preference Following in Personalized User-LLM Interactionscited by 8
  22. 2026Lost in Stories: Consistency Bugs in Long Story Generation by LLMscited by 6
  23. 2026SpecSteer: Synergizing Local Context and Global Reasoning for Efficient Personalized Generationcited by 6
  24. 2025WikiAutoGen: Towards Multi-Modal Wikipedia-Style Article Generationcited by 5
  25. 2025PREF: Reference-Free Evaluation of Personalised Text Generation in LLMscited by 5
  26. 2025Learning from Natural Language Feedback for Personalized Question Answeringcited by 5
  27. 2026Optimizing User Profiles via Contextual Bandits for Retrieval-Augmented LLM Personalizationcited by 5
  28. 2025Tuning-Free Personalized Alignment via Trial-Error-Explain In-Context Learningcited by 4
  29. 2025DynaKV: Enabling Accurate and Efficient Long-Sequence LLM Decoding on Smartphonescited by 4
  30. 2026SPRInG: Continual LLM Personalization via Selective Parametric Adaptation and Retrieval-Interpolated Generationcited by 4
  31. 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AIcited by 4
  32. 2024Persona-SQ: A Personalized Suggested Question Generation Framework For Real-world Documentscited by 3
  33. 2026CURP: Codebook-based Continuous User Representation for Personalized Generation with LLMscited by 3
  34. 2026Rethinking Personalization in Large Language Models at the Token Levelcited by 3
  35. 2025LaMP-Cap: Personalized Figure Caption Generation With Multimodal Figure Profilescited by 2
  36. 2025Evaluating Style-Personalized Text Generation: Challenges and Directionscited by 2
  37. 2025IPQA: A Benchmark for Core Intent Identification in Personalized Question Answeringcited by 2
  38. 2026CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generationcited by 2

50 most cited of 91 All 91 (JSON)