mlsanityData to 14 Oct 2026

Don't Waste It: Guiding Generative Recommenders with Structured Human Priors via Multi-Head Decoding

arXiv 2511.10492 ↗First posted 13 Nov 2025cs.IR cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Optimizing recommender systems for objectives beyond accuracy, such as diversity, novelty, and personalization, is crucial for long-term user satisfaction. To this end, industrial practitioners have accumulated vast amounts of structured domain knowledge, which we term human priors (e.g., item taxonomies, temporal patterns). This knowledge is typically applied through post-hoc adjustments during ranking or post-ranking. However, this approach remains decoupled from the core model learning, which is particularly undesirable as the industry shifts to end-to-end generative recommendation foundation models. On the other hand, many methods targeting these beyond-accuracy objectives often require architecture-specific modifications and discard these valuable human priors by learning user intent in a fully unsupervised manner. Instead of discarding the human priors accumulated over years of practice, we introduce a backbone-agnostic framework that seamlessly integrates these human priors directly into the end-to-end training of generative recommenders. With lightweight, prior-conditioned adapter heads inspired by efficient LLM decoding strategies, our approach guides the model to disentangle user intent along human-understandable axes (e.g., interaction types, long- vs. short-term interests). We also introduce a hierarchical composition strategy for modeling complex interactions across different prior types. Extensive experiments on three large-scale datasets demonstrate that our method significantly enhances both accuracy and beyond-accuracy objectives. We also show that human priors allow the backbone model to more effectively leverage longer context lengths and larger model sizes.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 13 Nov 2025.

Builds on

28 of 40 references.

References · 28

  1. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  2. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,809
  3. 2018Self-Attentive Sequential Recommendationcited by 1,184
  4. 2017Neural Collaborative Filteringcited by 1,111
  5. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  6. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
  7. 2024Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Headscited by 843
  8. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  9. 2020Contrastive Learning with Hard Negative Samplescited by 628
  10. 2018From Louvain to Leiden: guaranteeing well-connected communitiescited by 385
  11. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  12. 2019Knowledge Enhanced Contextual Word Representationscited by 296
16 more
  1. 2022Is GPT-3 a Good Data Annotator?cited by 208
  2. 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
  3. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
  4. 2019Multi-Interest Network with Dynamic Routing for Recommendation at Tmallcited by 114
  5. 2019Learning Disentangled Representations for Recommendationcited by 110
  6. 2020Controllable Multi-Interest Framework for Recommendationcited by 93
  7. 2024HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modelingcited by 63
  8. 2021HieRec: Hierarchical User Interest Modeling for Personalized News Recommendationcited by 31
  9. 2023An Image Dataset for Benchmarking Recommender Systems with Raw Pixelscited by 18
  10. 2023Impatient Bandits: Optimizing Recommendations for the Long-Term Without Delaycited by 17
  11. 2019Towards Neural Mixture Recommender for Long Range Dependent User Sequencescited by 15
  12. 2024EB-NeRD: A Large-Scale Dataset for News Recommendationcited by 12
  13. 2023Rethinking Multi-Interest Learning for Candidate Matching in Recommender Systemscited by 11
  14. 2024MerRec: A Large-scale Multipurpose Mercari Dataset for Consumer-to-Consumer Recommendation Systemscited by 6
  15. 2024DualVAE: Dual Disentangled Variational AutoEncoder for Recommendationcited by 5
  16. 2025We're Still Doing It (All) Wrong: Recommender Systems, Fifteen Years Latercited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.