Conditional Memory Enhanced Item Representation for Generative Recommendation
Not on the map. Why?
Abstract (arXiv)
Generative recommendation (GR) has emerged as a promising paradigm that predicts target items by autoregressively generating their semantic identifiers (SID). Most GR methods follow a quantization-representation-generation pipeline, first assigning each item a SID, then constructing input representations from SID-token embeddings, and finally predicting the target SID through autoregressive generation. Existing item-level representation constructions mainly take two forms: directly merging SID-token embeddings into a compact vector, or enriching item-level representations with external inputs through additional networks. However, these item-level constructors still expose two practical challenges: direct merging may amplify the information loss caused by quantization and ID collision while obscuring SID code relations, whereas external-input-based methods can strengthen item semantics but cannot reliably preserve the SID-structured evidence required for token-level generation. These limitations make representation construction an underexplored bottleneck, leading to two severe problems, ie the Identity-Structure Preservation Conflict and Input-Output Granularity Mismatch. To this end, we propose ComeIR, a Conditional Memory enhanced Item Representation framework that reconstructs SID-token embeddings into item-aware inputs and restores the token granularity during SID decoding. Specifically, MM-guided token scoring adaptively estimates the contribution of each code within the SID, dual-level Engram memory captures intra-item code composition and inter-item transition patterns, and a memory-restoring prediction head reuses the memories during SID decoding. Extensive experiments demonstrate the effectiveness and flexibility of ComeIR, and further reveal scalable gains from enlarging conditional memory.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 44 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
24 of 44 references.
References · 24
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
- 2024When Attention Sink Emerges in Language Models: An Empirical Viewcited by 200
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 167
- 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
- 2024Learnable Item Tokenization for Generative Recommendationcited by 106
- 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
- 2023Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Studycited by 63
- 2024EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaborationcited by 55
- 2017Hash Embeddings for Efficient Word Representationscited by 54
12 more
- 2025Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense Representationscited by 35
- 2025OneTrans: Unified Feature Interaction and Sequence Modeling with One Transformer in Industrial Recommendercited by 34
- 2024CoST: Contrastive Quantization based Semantic Tokenization for Generative Recommendationcited by 26
- 2024Inductive Generative Recommendation via Retrieval-based Speculationcited by 15
- 2025HiD-VAE: Interpretable Generative Recommendation via Hierarchical and Disentangled Semantic IDscited by 11
- 2025NEZHA: A Zero-sacrifice and Hyperspeed Decoding Architecture for Generative Recommendationscited by 5
- 2026Stop Treating Collisions Equally: Qualification-Aware Semantic ID Learning for Recommendation at Industrial Scalecited by 5
- 2025Bi-Level Optimization for Generative Recommendation: Bridging Tokenization and Generationcited by 3
- 2026Beyond the Flat Sequence: Hierarchical and Preference-Aware Generative Recommendationscited by 3
- 2026A Collision-Free Hot-Tier Extension for Engram-Style Conditional Memory: A Controlled Study of Training Dynamicscited by 2
- 2026Pooling Engram Conditional Memory in Large Language Models using CXLcited by 2
- 2026IntRR: A Framework for Integrating SID Redistribution and Length Reductioncited by 1
Built on by
Not cited yet.