A Unified Language Model for Large Scale Search, Recommendation, and Reasoning
On the map: LLM reasoning → LLM reasoning for recommendation
Abstract (arXiv)
LLMs are increasingly applied to recommendation, retrieval, and reasoning, yet deploying a single end-to-end model that can jointly support these behaviors over large, heterogeneous catalogs remains challenging. Such systems must generate unambiguous references to real items, handle multiple entity types, and operate under strict latency and reliability constraints requirements that are difficult to satisfy with text-only generation. While tool-augmented recommender systems address parts of this problem, they introduce orchestration complexity and limit end-to-end optimization. We view this setting as an instance of a broader research problem: how to adapt LLMs to reason jointly over multiple-domain entities, users, and language in a fully self-contained manner. To this end, we introduce NEO, a framework that adapts a pre-trained decoder-only LLM into a tool-free, catalog-grounded generator. NEO represents items as SIDs and trains a single model to interleave natural language and typed item identifiers within a shared sequence. Text prompts control the task, target entity type, and output format (IDs, text, or mixed), while constrained decoding guarantees catalog-valid item generation without restricting free-form text. We refer to this instruction-conditioned controllability as language-steerability. We treat SIDs as a distinct modality and study design choices for integrating discrete entity representations into LLMs via staged alignment and instruction tuning. We evaluate NEO at scale on a real-world catalog of over 10M items across multiple media types and discovery tasks, including recommendation, search, and user understanding. In offline experiments, NEO consistently outperforms strong task-specific baselines and exhibits cross-task transfer, demonstrating a practical path toward consolidating large-scale discovery capabilities into a single language-steerable generative model.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in LLM reasoning for recommendation, one of 17 directions in LLM reasoning. Builds on 30 of its 75 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
30 of 75 references.
References · 30
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2025Qwen3 Technical Reportcited by 8,195
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
- 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 184
- 2023Emu: Generative Pretraining in Multimodalitycited by 156
- 2023CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendationcited by 99
18 more
- 2023Leveraging Large Language Models in Conversational Recommender Systemscited by 63
- 2023Better Generalization with Semantic IDs: A Case Study in Ranking for Recommendationscited by 50
- 2024IDGenRec: LLM-RecSys Alignment with Textual ID Learningcited by 50
- 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
- 2025Vision as LoRAcited by 37
- 2025PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendationscited by 27
- 2024CoST: Contrastive Quantization based Semantic Tokenization for Generative Recommendationcited by 26
- 2025Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontierscited by 26
- 2020Embedding-based Zero-shot Retrieval through Query Generationcited by 24
- 2024MIO: A Foundation Model on Multimodal Tokenscited by 24
- 2023OpenP5: An Open-Source Platform for Developing, Training, and Evaluating LLM-based Recommender Systemscited by 19
- 2025Embedding-to-Prefix: Parameter-Efficient Personalization for Pre-Trained Large Language Modelscited by 10
- 2024STAR: A Simple Training-free Approach for Recommendations using Large Language Modelscited by 8
- 2025TALKPLAY: Multimodal Music Recommendation with Large Language Modelscited by 7
- 2024Learning Multi-Aspect Item Palette: A Semantic Tokenization Framework for Generative Recommendationcited by 6
- 2025Realizing Scaling Laws in Recommender Systems: A Foundation-Expert Paradigm for Hyperscale Model Deploymentcited by 4
- 2025TalkPlay-Tools: Conversational Music Recommendation with LLM Tool Callingcited by 4
- 2024MVIGER: Multi-View Variational Integration of Complementary Knowledge for Generative Recommendercited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challenges
- 2024Aligning Large Language Models with Recommendation Knowledge
- 2025Rethinking LLM-Based Recommendations: A Personalized Query-Driven Parallel Integration
- 2024All Roads Lead to Rome: Unveiling the Trajectory of Recommender Systems Across the LLM Era
- 2025Catalog-Native LLM: Speaking Item-ID Dialect with Less Entanglement for Recommendation
- 2026RRCM: Ranking-Driven Retrieval over Collaborative and Meta Memories for LLM Recommendation
- 2025EAGER-LLM: Enhancing Large Language Models as Recommenders through Exogenous Behavior-Semantic Integration
- 2023Recommender AI Agent: Integrating Large Language Models for Interactive Recommendations