LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generation
Not on the map. Why?
Abstract (arXiv)
Personalized generation with frozen large language models requires a conditioning signal that is both compact and current. Existing personalization methods typically retrieve or summarize user histories in text, or compress them into static latent profiles and soft prompts. These approaches are efficient, but they treat a user's past behavior as an aggregate profile and therefore mix stable identity, recent drift, and item content in the same representation. We propose LAtent Trajectory Tracking and Extrapolation (LATTE), a framework that represents personalization as forecasting a peer anchored relative preference state. For each historical session, LATTE subtracts a time masked baseline formed from comparable users who responded to the same item, producing a state that measures how the target user differs from peers under a shared item context. A lightweight sequence predictor then forecasts the next state in this trajectory, and a State to Token Bridge injects the forecast into a frozen instruction tuned LLM through a single anchored soft token. We provide a latent factor analysis showing when peer anchoring cancels shared item variation and why temporal forecasting trades off stale averages against noisy recent states. Experiments on Amazon Reviews 2023 and MemoryCD show that LATTE consistently outperforms retrieval, summary memory, static latent profiles, difference aware latent profiles, and soft prompt compression baselines. On Amazon Reviews 2023, LATTE improves average ROUGE-L from 0.219 for a static latent profile and 0.245 for the strongest added latent compression baseline to 0.259. Additional pairwise comparisons and diagnostic analyses suggest that the improvement is mainly due to forecasting user-specific trajectory information, rather than merely adding a soft prompt interface.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 37 of its 40 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
37 of 40 references.
References · 37
- 2017Attention Is All You Needcited by 60,361
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
25 more
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2023LaMP: When Large Language Models Meet Personalizationcited by 437
- 2022Recurrent Memory Transformercited by 203
- 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 148
- 2024Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimizationcited by 118
- 2024Optimization Methods for Personalizing Large Language Models through Retrieval Augmentationcited by 99
- 2024MEMORYLLM: Towards Self-Updatable Large Language Modelscited by 93
- 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrieverscited by 92
- 2024User-LLM: Efficient LLM Contextualization with User Embeddingscited by 76
- 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusioncited by 74
- 2024Personalized Pieces: Efficient Personalized Large Language Models through Collaborative Effortscited by 74
- 2024HYDRA: Model Factorization Framework for Black-Box LLM Personalizationcited by 60
- 2024PersonalLLM: Tailoring LLMs to Individual Preferencescited by 60
- 2025Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalizationcited by 45
- 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answeringcited by 34
- 2024Customizing Language Models with Instance-wise LoRA for Sequential Recommendationcited by 32
- 2025Latent Inter-User Difference Modeling for LLM Personalizationcited by 21
- 2026MemoryCD: Benchmarking Long-Context User Memory of LLM Agents for Lifelong Cross-Domain Personalizationcited by 17
- 2024PERSOMA: PERsonalized SOft ProMpt Adapter Architecture for Personalized Language Promptingcited by 14
- 2026PeReGrINE: Evaluating Personalized Review Fidelity with User Item Graph Contextcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026HyperTrace: Hypothesis-Based Preference Tracing for Online LLM Personalization
- 2026Towards Natural Personalization: Evaluating Long-Horizon Preference Following in Personalized User-LLM Interactions
- 2026Synthetic Interaction Data for Scalable Personalization in Large Language Models
- 2026Many Preferences, Few Policies: Towards Scalable Language Model Personalization
- 2025POPI: Personalizing LLMs via Optimized Natural Language Preference Inference
- 2026Sparse Personalized Text Generation with Multi-Trajectory Reasoning
- 2024Orchestrating LLMs with Different Personalizations
- 2025TWICE: Modeling the Temporal Evolution of Personalized User Behavior via Event-Driven Agents