mlsanityData to 14 Oct 2026

EchoRec: Multi-Item Prediction-Empowered Generative Recommendation via Cycle-Consistent Preference Alignment

arXiv 2608.14011 ↗First posted 14 Aug 2026cs.IR cs.AIcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Preference alignment for recommenders and RAG

Abstract (arXiv)

Generative recommendation autoregressively generates the semantic IDs of the target item, unifying preference modeling and index retrieval within the shared token space. Recent attempts have introduced Multi-Token Prediction (MTP) into this field, yet they primarily inherit its efficiency merit, leaving its potential as dense supervision unexplored. Unlocking this potential hinges on whether future behaviors qualify as informative supervision. Our analysis reveals that future behaviors carry a semantic echo of the current one far above that of random pairs, which nevertheless decays along horizons under intent transitions, making them informative yet order-dependent signals. Motivated by this, we propose EchoRec, which empowers MTP with cycle-consistent holistic preference alignment across multi-horizon for generative recommendation. It comprises two synergistic modules. Horizon-aware Preference Generation (HPG) sequentially chains lightweight auxiliary branches upon the base recommender, where each branch conditions on its predecessor to respect preference evolution. Verifiable Holistic-Preference Alignment (VHA) further consolidates them into the holistic preference and echoes it back through cycle-consistent projectors to suppress spurious alignment, with theoretical guarantees that exclude the rank-collapse form of spurious alignment under an invertible transport, enabling the holistic preference to be retained in the decoding representation. All auxiliary components serve as disposable scaffolding discarded at inference, introducing negligible online serving overhead. Extensive experiments on three datasets demonstrate the superiority of our EchoRec, together with its naturally acquired multi-item generation ability. Our code and datasets will be available upon acceptance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Preference alignment for recommenders and RAG, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 26 of its 34 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

26 of 34 references.

References · 26

  1. 2024Better & Faster Large Language Models via Multi-token Predictioncited by 360
  2. 2024The pitfalls of next-token predictioncited by 160
  3. 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
  4. 2024Learnable Item Tokenization for Generative Recommendationcited by 110
  5. 2024EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaborationcited by 58
  6. 2025OneRec-Think: In-Text Reasoning for Generative Recommendationcited by 51
  7. 2025MTGR: Industrial-Scale Generative Recommendation Framework in Meituancited by 49
  8. 2025Your LLM Knows the Future: Uncovering Its Multi-Token Prediction Potentialcited by 47
  9. 2024Plug-in Diffusion Model for Sequential Recommendationcited by 37
  10. 2024Generative Recommender with End-to-End Learnable Item Tokenizationcited by 34
  11. 2025Cycle Consistency as Reward: Learning Image-Text Alignment without Human Preferencescited by 22
  12. 2025Order-agnostic Identifier for Large Language Model-based Generative Recommendationcited by 21
14 more
  1. 2026Differentiable Semantic ID for Generative Recommendationcited by 19
  2. 2025Multi-Token Prediction Needs Registerscited by 16
  3. 2025Semantic IDs for Joint Generative Search and Recommendationcited by 14
  4. 2025A Survey on Generative Recommendation: Data, Model, and Taskscited by 9
  5. 2025From IDs to Semantics: A Generative Framework for Cross-Domain Recommendation with Adaptive Semantic Tokenizationcited by 9
  6. 2025GPR: Towards a Generative Pre-trained One-Model Paradigm for Large-Scale Advertising Recommendationcited by 9
  7. 2025DiscRec: Disentangled Semantic-Collaborative Modeling for Generative Recommendationcited by 8
  8. 2025EGA-V2: An End-to-end Generative Framework for Industrial Advertisingcited by 6
  9. 2025Understanding and Enhancing the Planning Capability of Language Models via Multi-Token Predictioncited by 6
  10. 2025Large Language Model Empowered Recommendation Meets All-domain Continual Pre-Trainingcited by 4
  11. 2025GReF: A Unified Generative Framework for Efficient Reranking via Ordered Multi-token Predictioncited by 4
  12. 2026Expressiveness Limits of Autoregressive Semantic ID Generation in Generative Recommendationcited by 4
  13. 2025Pctx: Tokenizing Personalized Context for Generative Recommendationcited by 3
  14. 2026Two-Way Is Better Than One: Bidirectional Alignment with Cycle Consistency for Exemplar-Free Class-Incremental Learningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GenRec: A Preference-Oriented Generative Framework for Large-Scale Recommendation
  2. 2025CoFiRec: Coarse-to-Fine Tokenization for Generative Recommendation
  3. 2025MiniOneRec: An Open-Source Framework for Scaling Generative Recommendation
  4. 2025Align3GR: Unified Multi-Level Alignment for LLM-based Generative Recommendation
  5. 2026OxygenREC-v2: Internalizing Discrimination into Generative Recommendation ↗
  6. 2026VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation
  7. 2025MindRec: A Diffusion-driven Coarse-to-Fine Paradigm for Generative Recommendation
  8. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignment