Interpretable Representation via LLM-Driven Generative Disentanglement for Local-Life Service Recommendation
Not on the map. Why?
Abstract (arXiv)
While large language models (LLMs) have advanced ID-based recommendation through Semantic ID (SID) modeling, existing SID generation frameworks largely follow a single-representation-then-quantization paradigm. This design faces two bottlenecks: semantic entanglement mixes heterogeneous attributes, such as geography, brand, and category, causing information loss during quantization, low-quality SIDs, and severe collisions; moreover, black-box representation learning provides neither explicit attribute semantics nor clear geographic or semantic meanings for SID positions. These limitations weaken both retrieval reliability and the ability to diagnose or control SID generation. We propose Interpretable Representation via LLM-Driven Generative Disentanglement for Local-Life Service Recommendation (LGRID). LGRID introduces a generative disentanglement paradigm through an Encode -> Disentangle -> Align -> Quantize pipeline. It first uses joint LLM encoding to preserve cross-attribute geographic-semantic dependencies, rather than encoding fields independently. A Structured Disentangled Block then routes hidden states into attribute-aligned slots for geographic and semantic factors. Synergistic Alignment Learning makes these slots both generatively decodable and discriminative for retrieval, while Dual-Stream Residual Quantization separately discretizes the two streams into compact SIDs with explicit attribute correspondence. This design yields interpretable SIDs with positions grounded in item attributes and local-service semantics. Experiments on Kuaishou and Foursquare show that LGRID consistently outperforms strong SID baselines, achieving up to a 5.44 percent relative AUC gain. It also achieves over 99 percent attribute-decoding accuracy for coarse geographic fields and reduces the full-SID collision rate to 39.9 percent, compared with 97.0 percent for LGSID.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 53 of its 70 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
53 of 70 references.
References · 53
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2020Object-Centric Learning with Slot Attentioncited by 876
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
38 more
- 2021Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depthcited by 419
- 2017Deep & Cross Network for Ad Click Predictionscited by 393
- 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 338
- 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 264
- 2015Highway Networkscited by 260
- 2024Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Modelscited by 235
- 2023Recommender Systems with Generative Retrievalcited by 198
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
- 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 177
- 2024Learnable Item Tokenization for Generative Recommendationcited by 110
- 2022Personalized Prompt Learning for Explainable Recommendationcited by 79
- 2024EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaborationcited by 58
- 2025OneRec-Think: In-Text Reasoning for Generative Recommendationcited by 51
- 2021End-to-End User Behavior Retrieval in Click-Through RatePrediction Modelcited by 45
- 2025RankMixer: Scaling Up Ranking Models in Industrial Recommenderscited by 42
- 2024Activation Scaling for Steering and Interpreting Language Modelscited by 35
- 2025Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense Representationscited by 35
- 2024TWIN V2: Scaling Ultra-Long User Behavior Sequence Modeling for Enhanced CTR Prediction at Kuaishoucited by 30
- 2025PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendationscited by 30
- 2025OneRec-V2 Technical Reportcited by 29
- 2024QARM: Quantitative Alignment Multi-Modal Recommendation at Kuaishoucited by 28
- 2025OneRec Technical Reportcited by 25
- 2023Language Models As Semantic Indexerscited by 20
- 2025Enhancing Embedding Representation Stability in Recommendation Systems with Semantic IDcited by 19
- 2025Towards Efficient Partially Relevant Video Retrieval with Active Moment Discoveringcited by 18
- 2025FORGE: Forming Semantic Identifiers for Generative Retrieval in Industrial Datasetscited by 17
- 2025Generative Next POI Recommendation with Semantic IDcited by 13
- 2025MMQ: Multimodal Mixture-of-Quantization Tokenization for Semantic ID Generation and User Behavioral Adaptationcited by 10
- 2025Unified Semantic and ID Representation Learning for Deep Recommenderscited by 8
- 2025FIM: Frequency-Aware Multi-View Interest Modeling for Local-Life Service Recommendationcited by 6
- 2025OneLoc: Geo-Aware Generative Recommender Systems for Local Life Servicecited by 5
- 2023Fragment and Integrate Network (FIN): A Novel Spatial-Temporal Modeling Based on Long Sequential Behavior for Online Food Ordering Click-Through Rate Predictioncited by 3
- 2025LocalGPT: Benchmarking and Advancing Large Language Models for Local Life Services in Meituancited by 3
- 2025GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow Networkscited by 3
- 2025Enhancing Partially Relevant Video Retrieval with Robust Alignment Learningcited by 3
- 2025LLM-Aligned Geographic Item Tokenization for Local-Life Recommendationcited by 3
- 2025Dynamic Forgetting and Spatio-Temporal Periodic Interest Modeling for Local-Life Service Recommendationcited by 2
- 2026Reasoning Over Space: Enabling Geographic Reasoning for LLM-Based Generative Next POI Recommendationcited by 2
50 most cited of 53 All 53 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025HiD-VAE: Interpretable Generative Recommendation via Hierarchical and Disentangled Semantic IDs
- 2026Rethinking Generative Recommender Tokenizer: Recsys-Native Encoding and Semantic Quantization Beyond LLMs
- 2026Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation
- 2025Understanding Generative Recommendation with Semantic IDs from a Model-scaling View
- 2026Reasoning over Semantic IDs Enhances Generative Recommendation
- 2026VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation
- 2026Deep Interest Mining for Intent-Enriched Semantic IDs in Multimodal Generative Recommendation
- 2025HiGR: Industrial-Scale Hierarchical Generative Slate Recommendation Framework in Tencent