mlsanityData to 14 Oct 2026

Sparse Personalized Text Generation with Multi-Trajectory Reasoning

arXiv 2604.24996 ↗First posted 27 Apr 2026cs.AIcited by 0

On the map: LLM reasoning → Reinforcement learning for reasoning

Abstract (arXiv)

As Large Language Models (LLMs) advance, personalization has become a key mechanism for tailoring outputs to individual user needs. However, most existing methods rely heavily on dense interaction histories, making them ineffective in cold-start scenarios where such data is sparse or unavailable. While external signals (e.g., content of similar users) can offer a potential remedy, leveraging them effectively remains challenging: raw context is often noisy, and existing methods struggle to reason over heterogeneous data sources. To address these issues, we introduce PAT (Personalization with Aligned Trajectories), a reasoning framework for cold-start LLM personalization. PAT first retrieves information along two complementary trajectories: writing-style cues from stylistically similar users and topic-specific context from preference-aligned users. It then employs a reinforcement learning-based, iterative dual-reasoning mechanism that enables the LLM to jointly refine and integrate these signals. Experimental results across real-world personalization benchmarks show that PAT consistently improves generation quality and alignment under sparse-data conditions, establishing a strong solution to the cold-start personalization problem.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 29 references that are in the map. First posted on arXiv 27 Apr 2026.

Builds on

21 of 29 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Reasoning-Enhanced Self-Training for Long-Form Personalized Text Generation7 Jan
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Model29 May

Other references · 19

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2017Inductive Representation Learning on Large Graphscited by 6,320
  3. 2023Qwen Technical Reportcited by 3,344
  4. 2023LaMP: When Large Language Models Meet Personalizationcited by 437
  5. 2023Fine-Grained Human Feedback Gives Better Rewards for Language Model Trainingcited by 401
  6. 2023Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Mergingcited by 280
  7. 2024Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoderscited by 224
  8. 2022Fine-tuning language models to find agreement among humans with diverse preferencescited by 189
  9. 2024A Roadmap to Pluralistic Alignmentcited by 184
  10. 2024Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learningcited by 155
  11. 2024Personalized Language Modeling from Personalized Human Feedbackcited by 132
  12. 2023SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHFcited by 111
7 more
  1. 2024Personalization of Large Language Models: A Surveycited by 104
  2. 2024LongLaMP: A Benchmark for Personalized Long-form Text Generationcited by 97
  3. 2022Same Author or Just Same Topic? Towards Content-Independent Style Representationscited by 86
  4. 2019Optimizing Data Usage via Differentiable Rewardscited by 48
  5. 2024RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rewardscited by 33
  6. 2025Cold-Start Recommendation towards the Era of Large Language Models (LLMs): A Comprehensive Survey and Roadmapcited by 20
  7. 2025Personalized Graph-Based Retrieval for Large Language Modelscited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reasoning-Based Personalized Generation for Users with Sparse Data
  2. 2026From Profiles to Steering Vectors: Global Sparse Priors and Local Semantic Calibration for Personalized Text Generation
  3. 2025T-POP: Test-Time Personalization with Online Preference Feedback
  4. 2025Iterative Critique-Refine Framework for Enhancing LLM Personalization
  5. 2025Reflective Personalization Optimization: A Post-hoc Rewriting Framework for Black-Box Large Language Models
  6. 2026Text as a Universal Interface for Transferable Personalization
  7. 2026LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generation
  8. 2026PrefReward: Learning User Preference Matrix for Personalized Text Generation