Deep Learning Recommendation Model for Personalization and Recommendation Systems
Not on the map. Why?
Abstract (arXiv)
With the advent of deep learning, neural network-based recommendation models have emerged as an important tool for tackling personalization and recommendation tasks. These networks differ significantly from other deep learning networks due to their need to handle categorical features and are not well studied or understood. In this paper, we develop a state-of-the-art deep learning recommendation model (DLRM) and provide its implementation in both PyTorch and Caffe2 frameworks. In addition, we design a specialized parallelization scheme utilizing model parallelism on the embedding tables to mitigate memory constraints while exploiting data parallelism to scale-out compute from the fully-connected layers. We compare DLRM against existing recommendation models and characterize its performance on the Big Basin AI platform, demonstrating its usefulness as a benchmark for future algorithmic experimentation and system co-design.
Key facts. Cited by 327 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 51; 2022: 55; 2023: 70; 2024: 63; 2025: 45; 2026: 42.
327 papers.
Sort:
By area:
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 815
- 2023LaMP: When Large Language Models Meet Personalizationcited by 437
- 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
- 2024Large Language Models for Education: A Survey and Outlookcited by 188
- 2022Compute Trends Across Three Eras of Machine Learningcited by 163
- 2024The Road Less Scheduledcited by 163
- 2023Microscaling Data Formats for Deep Learningcited by 152
- 2023Prodigy: An Expeditiously Adaptive Parameter-Free Learnercited by 133
- 2023Learning-Rate-Free Learning by D-Adaptationcited by 113
- 2024Optimization Methods for Personalizing Large Language Models through Retrieval Augmentationcited by 99
- 2024AI and Memory Wallcited by 92
- 2023Data Distillation: A Surveycited by 87
38 more
- 2021Software-Hardware Co-design for Fast and Scalable Training of Deep Learning Recommendation Modelscited by 78
- 2023A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scalecited by 77
- 2021Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Modelscited by 76
- 2024Wukong: Towards a Scaling Law for Large-Scale Recommendationcited by 74
- 2021TT-Rec: Tensor Train Compression for Deep Learning Recommendation Modelscited by 58
- 2023With Shared Microexponents, A Little Shifting Goes a Long Waycited by 50
- 2023Optimal Linear Decay Learning Rate Schedules and Further Refinementscited by 43
- 2021Torch.fx: Practical Program Capture and Transformation for Deep Learning in Pythoncited by 40
- 2023Oobleck: Resilient Distributed Training of Large Models Using Pipeline Templatescited by 40
- 2022Machine Learning Model Sizes and the Parameter Gapcited by 39
- 2022Understanding Scaling Laws for Recommendation Modelscited by 38
- 2022BlindFL: Vertical Federated Machine Learning without Peeking into Your Datacited by 36
- 2021RecSSD: Near Data Processing for Solid State Drive Based Recommendation Inferencecited by 35
- 2022MetaBalance: Improving Multi-Task Recommendations via Adapting Gradient Magnitudes of Auxiliary Taskscited by 34
- 2025LaMP-QA: A Benchmark for Personalized Long-form Question Answeringcited by 31
- 2022Tensor Program Optimization with Probabilistic Programscited by 30
- 2023Efficient Post-training Quantization with FP8 Formatscited by 29
- 2021Understanding Data Storage and Ingestion for Large-Scale Deep Recommendation Model Trainingcited by 28
- 2021HET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Frameworkcited by 28
- 2022RecShard: Statistical Feature-Based Memory Optimization for Industry-Scale Neural Recommendationcited by 28
- 2024Exploring Safety-Utility Trade-Offs in Personalized Language Modelscited by 27
- 2025Reasoning-Enhanced Self-Training for Long-Form Personalized Text Generationcited by 27
- 2025A Survey of Personalization: From RAG to Agentcited by 27
- 2023CASSINI: Network-Aware Job Scheduling in Machine Learning Clusterscited by 26
- 2025ExPerT: Effective and Explainable Evaluation of Personalized Long-Form Text Generationcited by 26
- 2021Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecturecited by 25
- 2021Accelerating Recommendation System Training by Leveraging Popular Choicescited by 22
- 2021CoSA: Scheduling by Constrained Optimization for Spatial Acceleratorscited by 22
- 2024MMREC: LLM Based Multi-Modal Recommender Systemcited by 22
- 2022SurCo: Learning Linear Surrogates For Combinatorial Nonlinear Optimization Problemscited by 21
- 2023Scaling User Modeling: Large-scale Online User Representations for Ads Personalization in Metacited by 21
- 2023Model Extraction Attacks Revisitedcited by 21
- 2022Infinite Recommendation Networks: A Data-Centric Approachcited by 20
- 2022Merlin HugeCTR: GPU-accelerated Recommender System Training and Inferencecited by 20
- 2023Cross-domain recommendation via user interest alignmentcited by 19
- 2025Enhancing Embedding Representation Stability in Recommendation Systems with Semantic IDcited by 19
- 2021Bolt: Bridging the Gap between Auto-tuners and Hardware-native Performancecited by 18
- 2025OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking Systemcited by 18
50 most cited of 327 All 327 (JSON)
- 2026Personalized Image Generation with Reasoning and Reflection30 Sep 2026
- 2026How Much of a Real Workload Can LLM-Generated GPU Kernels Actually Reach?17 Sep 2026
- 2026QueryFormer: Winning Solution for KDD Cup 2026 Tencent UniRec Challenge15 Sep 2026
- 2026Enabling and Understanding Personalization in AI-Generated Advertising Imagery11 Sep 2026
- 2026I Am AdMan: A Pipeline for Automatic Generation of Personalized Advertising Imagery11 Sep 2026
- 2026CORAL: An LLM-Native Harness for Production Recommender Systems2 Sep 2026
- 2026From Language to Behavior: Scaling Sequence Transformers for Industrial Recommendation Ranking with Rec-Native Designs1 Sep 2026
- 2026SA-RSQ: A Versatile Sparse Representation Framework for Multi-modal Recommender Systems24 Aug 2026
- 2026Shape Your Feed: An LLM-based Agentic System for Conversational Recommendation6 Aug 2026
- 2026ROCS: Request-Oriented Compute Sharing for Efficient Large-Scale Recommendation30 Jul 2026
- 2026Memory Layer: Train the In-Model Cache for Recommendation Models27 Jul 2026
- 2026Probabilistic Residual Learning for Online Recommendations23 Jul 2026
38 more
- 2026PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Tasks16 Jul 2026
- 2026MESH: Scaling Up Retrieval with Heterogeneous Content Unification14 Jul 2026
- 2026SlimPer: Make Personalization Model Slim and Smart14 Jul 2026
- 2026Tokenizing Numerical and Embedding Features for LLM RecSys10 Jul 2026
- 2026NEXT: Reasoning-Driven Video Recommendation via a Vision-Language Model27 Jun 2026
- 2026ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendation8 Jun 2026
- 2026LLM Retrieval for Stable and Predictable Ad Recommendations21 May 2026
- 2026Agentic Recommender System with Hierarchical Belief-State Memory14 May 2026
- 2026MLCommons Chakra: Advancing Performance Benchmarking and Co-design using Standardized Execution Traces11 May 2026
- 2026LoKA: Low-precision Kernel Applications for Recommendation Models At Scale11 May 2026
- 2026LLM Agents Enable User-Governed Personalization Beyond Platform Boundaries10 May 2026
- 2026A General Framework for Multimodal LLM-Based Multimedia Understanding in Large-Scale Recommendation Systems10 May 2026
- 2026When KV Meets Embeddings: Dynamic GPU Memory Allocation for Accelerating Generative Recommender Serving6 May 2026
- 2026SURGE: SuperBatch Unified Resource-efficient GPU Encoding for Heterogeneous Partitioned Data1 May 2026
- 2026Intelligent Elastic Feature Fading: Enabling Model Retrain-Free Feature Efficiency Rollouts at Scale1 May 2026
- 2026FreeScale: Distributed Training for Sequence Recommendation Models with Minimal Scaling Cost27 Apr 2026
- 2026Beyond N-gram: Data-Aware X-GRAM Extraction for Efficient Embedding Parameter Scaling23 Apr 2026
- 2026SOLARIS: Speculative Offloading of Latent-bAsed Representation for Inference Scaling13 Apr 2026
- 2026Design Once, Deploy at Scale: Template-Driven ML Development for Large Model Ecosystems26 Mar 2026
- 2026UniScale: Synergistic Entire Space Data and Model Scaling for Search Ranking25 Mar 2026
- 2026Beyond Interleaving: Causal Attention Reformulations for Generative Recommender Systems11 Mar 2026
- 2026LocalSUG: City-Preference-Enhanced LLM for Query Suggestion in Local-Life Services5 Mar 2026
- 2026Rethinking ANN-based Retrieval: Multifaceted Learnable Index for Large-scale Recommendation System18 Feb 2026
- 2026Self-EvolveRec: Self-Evolving Recommender Systems with LLM-based Directional Feedback13 Feb 2026
- 2026Distribution-Aware End-to-End Embedding for Streaming Numerical Features in Click-Through Rate Prediction3 Feb 2026
- 2026GRAB: An LLM-Inspired Sequence-First Click-Through Rate Prediction Modeling Paradigm2 Feb 2026
- 2026Zenith: Scaling up Ranking Models for Billion-scale Livestreaming Recommendation29 Jan 2026
- 2026LLaTTE: Scaling Laws for Multi-Stage Sequence Modeling in Large-Scale Ads Recommendation27 Jan 2026
- 2026Efficient Content-based Recommendation Model Training via Noise-aware Coreset Selection15 Jan 2026
- 2026RelayGR: Scaling Long-Sequence Generative Recommendation via Cross-Stage Relay-Race Inference5 Jan 2026
- 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Meta29 Dec 2025
- 2025Faster Distributed Inference-Only Recommender Systems via Bounded Lag Synchronous Collectives22 Dec 2025
- 2025LinkedOut: Linking World Knowledge Representation Out of Video LLM for Next-Generation Video Recommendation18 Dec 2025
- 2025Near-Zero-Overhead Freshness for Recommendation Systems via Inference-Side Model Updates13 Dec 2025
- 2025xGR: Efficient Generative Recommendation Serving at Scale12 Dec 2025
- 2025LayerPipe2: Multistage Pipelining and Weight Recompute via Improved Exponential Moving Average for Training Neural Networks9 Dec 2025
- 2025Exploring Test-time Scaling via Prediction Merging on Large-Scale Recommendation8 Dec 2025
- 2025Efficient Hyperparameter Search for Non-Stationary Model Training1 Dec 2025
50 newest of 327 All 327 (JSON)
- 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Metacited by 5
- 2026Agentic Recommender System with Hierarchical Belief-State Memorycited by 5
- 2026ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendationcited by 3
- 2026LLM Agents Enable User-Governed Personalization Beyond Platform Boundariescited by 2
- 2026Shape Your Feed: An LLM-based Agentic System for Conversational Recommendationcited by 0
- 2026PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Taskscited by 0
- 2026Shape Your Feed: An LLM-based Agentic System for Conversational Recommendation6 Aug 2026
- 2026PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Tasks16 Jul 2026
- 2026ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendation8 Jun 2026
- 2026Agentic Recommender System with Hierarchical Belief-State Memory14 May 2026
- 2026LLM Agents Enable User-Governed Personalization Beyond Platform Boundaries10 May 2026
- 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Meta29 Dec 2025
- 2025Reasoning-Enhanced Self-Training for Long-Form Personalized Text Generationcited by 27
- 2025OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking Systemcited by 18
- 2025Exploring Test-time Scaling via Prediction Merging on Large-Scale Recommendationcited by 0
- 2026NEXT: Reasoning-Driven Video Recommendation via a Vision-Language Modelcited by 0
- 2026NEXT: Reasoning-Driven Video Recommendation via a Vision-Language Model27 Jun 2026
- 2025Exploring Test-time Scaling via Prediction Merging on Large-Scale Recommendation8 Dec 2025
- 2025OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking System22 Sep 2025
- 2025Reasoning-Enhanced Self-Training for Long-Form Personalized Text Generation7 Jan 2025
- 2020Adversarial Mixture Of Experts with Category Hierarchy Soft Constraintcited by 6
- 2023MCR-DL: Mix-and-Match Communication Runtime for Deep Learningcited by 4
- 2024MoC-System: Efficient Fault Tolerance for Sparse Mixture-of-Experts Model Trainingcited by 4
- 2025FarSkip-Collective: Unhobbling Blocking Communication in Mixture of Experts Modelscited by 1
- 2025FarSkip-Collective: Unhobbling Blocking Communication in Mixture of Experts Models14 Nov 2025
- 2024MoC-System: Efficient Fault Tolerance for Sparse Mixture-of-Experts Model Training8 Aug 2024
- 2023MCR-DL: Mix-and-Match Communication Runtime for Deep Learning15 Mar 2023
- 2020Adversarial Mixture Of Experts with Category Hierarchy Soft Constraint24 Jul 2020
- 2023Efficient Post-training Quantization with FP8 Formatscited by 29
- 2023Efficient Post-training Quantization with FP8 Formats26 Sep 2023
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 815
- 2023LaMP: When Large Language Models Meet Personalizationcited by 437
- 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
- 2024Large Language Models for Education: A Survey and Outlookcited by 188
- 2022Compute Trends Across Three Eras of Machine Learningcited by 163
- 2024The Road Less Scheduledcited by 163
- 2023Microscaling Data Formats for Deep Learningcited by 152
- 2023Prodigy: An Expeditiously Adaptive Parameter-Free Learnercited by 133
- 2023Learning-Rate-Free Learning by D-Adaptationcited by 113
- 2024AI and Memory Wallcited by 92
- 2023Data Distillation: A Surveycited by 87
- 2021Software-Hardware Co-design for Fast and Scalable Training of Deep Learning Recommendation Modelscited by 78
12 most cited of 302 All 302 (JSON)
- 2026Personalized Image Generation with Reasoning and Reflection30 Sep 2026
- 2026How Much of a Real Workload Can LLM-Generated GPU Kernels Actually Reach?17 Sep 2026
- 2026QueryFormer: Winning Solution for KDD Cup 2026 Tencent UniRec Challenge15 Sep 2026
- 2026Enabling and Understanding Personalization in AI-Generated Advertising Imagery11 Sep 2026
- 2026I Am AdMan: A Pipeline for Automatic Generation of Personalized Advertising Imagery11 Sep 2026
- 2026CORAL: An LLM-Native Harness for Production Recommender Systems2 Sep 2026
- 2026From Language to Behavior: Scaling Sequence Transformers for Industrial Recommendation Ranking with Rec-Native Designs1 Sep 2026
- 2026SA-RSQ: A Versatile Sparse Representation Framework for Multi-modal Recommender Systems24 Aug 2026
- 2026ROCS: Request-Oriented Compute Sharing for Efficient Large-Scale Recommendation30 Jul 2026
- 2026Memory Layer: Train the In-Model Cache for Recommendation Models27 Jul 2026
- 2026Probabilistic Residual Learning for Online Recommendations23 Jul 2026
- 2026MESH: Scaling Up Retrieval with Heterogeneous Content Unification14 Jul 2026
12 newest of 302 All 302 (JSON)