PEPNet: Parameter and Embedding Personalized Network for Infusing with Personalized Prior Information
Not on the map. Why?
Abstract (arXiv)
With the increase of content pages and interactive buttons in online services such as online-shopping and video-watching websites, industrial-scale recommender systems face challenges in multi-domain and multi-task recommendations. The core of multi-task and multi-domain recommendation is to accurately capture user interests in multiple scenarios given multiple user behaviors. In this paper, we propose a plug-and-play textitParameter and Embedding Personalized Network (PEPNet) for multi-domain and multi-task recommendation. PEPNet takes personalized prior information as input and dynamically scales the bottom-level Embedding and top-level DNN hidden units through gate mechanisms. textitEmbedding Personalized Network (EPNet) performs personalized selection on Embedding to fuse features with different importance for different users in multiple domains. textitParameter Personalized Network (PPNet) executes personalized modification on DNN parameters to balance targets with different sparsity for different users in multiple tasks. We have made a series of special engineering optimizations combining the Kuaishou training framework and the online deployment environment. By infusing personalized selection of Embedding and personalized modification of DNN parameters, PEPNet tailored to the interests of each individual obtains significant performance gains, with online improvements exceeding 1% in multiple task metrics across multiple domains. We have deployed PEPNet in Kuaishou apps, serving over 300 million users every day.
Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Feb 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 3; 2024: 24; 2025: 18; 2026: 15.
60 papers.
Sort:
By area:
- 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Frameworkcited by 32
- 2023STEM: Unleashing the Power of Embeddings for Multi-task Recommendationcited by 19
- 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendationcited by 19
- 2024HoME: Hierarchy of Multi-Gate Experts for Multi-Task Learning at Kuaishoucited by 16
- 2024Ads Recommendation in a Collapsed and Entangled Worldcited by 13
- 2024A Survey of Controllable Learning: Methods and Applications in Information Retrievalcited by 12
- 2025MMQ: Multimodal Mixture-of-Quantization Tokenization for Semantic ID Generation and User Behavioral Adaptationcited by 10
- 2024PhysMLE: Generalizable and Priors-Inclusive Multi-task Remote Physiological Measurementcited by 9
- 2024Entire Chain Uplift Modeling with Context-Enhanced Learning for Intelligent Marketingcited by 7
- 2024MerRec: A Large-scale Multipurpose Mercari Dataset for Consumer-to-Consumer Recommendation Systemscited by 6
- 2024DNS-Rec: Data-aware Neural Architecture Search for Recommender Systemscited by 4
- 2024Ensure Timeliness and Accuracy: A Novel Sliding Window Data Stream Paradigm for Live Streaming Recommendationcited by 4
38 more
- 2024Retrievable Domain-Sensitive Feature Memory for Multi-Domain Recommendationcited by 4
- 2024GLINT-RU: Gated Lightweight Intelligent Recurrent Units for Sequential Recommender Systemscited by 4
- 2024Scene-wise Adaptive Network for Dynamic Cold-start Scenes Optimization in CTR Predictioncited by 4
- 2025Align the GAP: Prior-based Unified Multi-Task Remote Physiological Measurement Framework For Domain Generalization and Personalizationcited by 4
- 2024GPRec: Bi-level User Modeling for Deep Recommenderscited by 3
- 2025Revisiting Feature Interactions from the Perspective of Quadratic Neural Networks for Click-through Rate Predictioncited by 3
- 2025MTmixAtt: Integrating Mixture-of-Experts with Multi-Mix Attention for Large-Scale Recommendationcited by 3
- 2026TokenFormer: Unify the Multi-Field and Sequential Recommendation Worldscited by 3
- 2024UnifiedRL: A Reinforcement Learning Algorithm Tailored for Multi-Task Fusion in Large-Scale Recommender Systemscited by 2
- 2024Dynamic User Interest Augmentation via Stream Clustering and Memory Networks in Large-Scale Recommender Systemscited by 2
- 2025Macro Graph of Experts for Billion-Scale Multi-Task Recommendationcited by 2
- 2025PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matchingcited by 2
- 2025DGenCTR: Towards a Universal Generative Paradigm for Click-Through Rate Prediction via Discrete Diffusioncited by 2
- 2023Cross-Element Combinatorial Selection for Multi-Element Creative in Display Advertisingcited by 1
- 2024Effective Two-Stage Knowledge Transfer for Multi-Entity Cross-Domain Recommendationcited by 1
- 2024Large-Scale Multi-Domain Recommendation: an Automatic Domain Feature Extraction and Personalized Integration Frameworkcited by 1
- 2024Scenario-Adaptive Fine-Grained Personalization Network: Tailoring User Behavior Representation to the Scenario Contextcited by 1
- 2025Mini-Game Lifetime Value Prediction in WeChatcited by 1
- 2025FOUNDv2: Learning Unified User Quantized Tokenizers for User Representationcited by 1
- 2025Direct Routing Gradient (DRGrad): A Personalized Information Surgery for Multi-Task Learning (MTL) Recommendationscited by 1
- 2025Target-Aware Early Stage Rankingcited by 1
- 2026Compute Only Once: UG-Separation for Efficient Large Recommendation Modelscited by 1
- 2026Jointly Optimizing Debiased CTR and Uplift for Coupons Marketing: A Unified Causal Frameworkcited by 1
- 2023Methodologies for Improving Modern Industrial Recommender Systemscited by 0
- 2024Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularizationcited by 0
- 2024HMDN: Hierarchical Multi-Distribution Network for Click-Through Rate Predictioncited by 0
- 2024EnhancedRL: An Enhanced-State Reinforcement Learning Algorithm for Multi-Task Fusion in Recommender Systemscited by 0
- 2024Adaptive Conditional Expert Selection Network for Multi-domain Recommendationcited by 0
- 2024Adaptive2: Adaptive Domain Mining for Fine-grained Domain Adaptation Modelingcited by 0
- 2025Addressing Information Loss and Interaction Collapse: A Dual Enhanced Attention Framework for Feature Interactioncited by 0
- 2025UDuo: Universal Dual Optimization Framework for Online Matchingcited by 0
- 2025Reinforcing User Interest Evolution in Multi-Scenario Learning for recommender systemscited by 0
- 2025Large Foundation Model for Ads Recommendationcited by 0
- 2025MATT-CTR: Unleashing a Model-Agnostic Test-Time Paradigm for CTR Prediction with Confidence-Guided Inference Pathscited by 0
- 2025TextBridgeGNN: Pre-training Graph Neural Network for Cross-Domain Recommendation via Text-Guided Transfercited by 0
- 2025Distillation-based Scenario-Adaptive Mixture-of-Experts for the Matching Stage of Multi-scenario Recommendationcited by 0
- 2026MDL: A Unified Multi-Distribution Learner in Large-scale Industrial Recommendation through Tokenizationcited by 0
- 2026DAIAN: Deep Adaptive Intent-Aware Network for CTR Prediction in Trigger-Induced Recommendationcited by 0
50 most cited of 60 All 60 (JSON)
- 2026PRIME: Mitigating Subgroup Optimization Competition in Shared CTR Top Networks with Plug-in Residual Input-Conditioned Mixture of Expert31 Aug 2026
- 2026MARCO: Click-Intent Decomposition for Calibrated Ads Conversion Prediction11 Aug 2026
- 2026Heterogeneous Ranking in Industrial-Scale Recommender Systems: A Case Study30 Jul 2026
- 2026Bumblebee: Interleaved Mixed-Layer Building Blocks for Large-Scale Recommendation Systems6 Jul 2026
- 2026DUET -- Dual User Embedding Transformers for Offsite Conversion Prediction8 Jun 2026
- 2026Self-Balancing Gradient Allocation for Heterogeneity-Aware Feature Generation in Click-Through Rate Prediction24 May 2026
- 2026Action-Aware Generative Sequence Modeling for Short Video Recommendation28 Apr 2026
- 2026TokenFormer: Unify the Multi-Field and Sequential Recommendation Worlds15 Apr 2026
- 2026UniScale: Synergistic Entire Space Data and Model Scaling for Search Ranking25 Mar 2026
- 2026Deferred is Better: A Framework for Multi-Granularity Deferred Interaction of Heterogeneous Features13 Mar 2026
- 2026Trinity: A Scenario-Aware Recommendation Framework for Large-Scale Cold-Start Users28 Feb 2026
- 2026DAIAN: Deep Adaptive Intent-Aware Network for CTR Prediction in Trigger-Induced Recommendation15 Feb 2026
38 more
- 2026Jointly Optimizing Debiased CTR and Uplift for Coupons Marketing: A Unified Causal Framework13 Feb 2026
- 2026Compute Only Once: UG-Separation for Efficient Large Recommendation Models11 Feb 2026
- 2026MDL: A Unified Multi-Distribution Learner in Large-scale Industrial Recommendation through Tokenization7 Feb 2026
- 2025Distillation-based Scenario-Adaptive Mixture-of-Experts for the Matching Stage of Multi-scenario Recommendation28 Nov 2025
- 2025Target-Aware Early Stage Ranking26 Nov 2025
- 2025TextBridgeGNN: Pre-training Graph Neural Network for Cross-Domain Recommendation via Text-Guided Transfer25 Nov 2025
- 2025MTmixAtt: Integrating Mixture-of-Experts with Multi-Mix Attention for Large-Scale Recommendation17 Oct 2025
- 2025MATT-CTR: Unleashing a Model-Agnostic Test-Time Paradigm for CTR Prediction with Confidence-Guided Inference Paths10 Oct 2025
- 2025Direct Routing Gradient (DRGrad): A Personalized Information Surgery for Multi-Task Learning (MTL) Recommendations4 Oct 2025
- 2025MMQ: Multimodal Mixture-of-Quantization Tokenization for Semantic ID Generation and User Behavioral Adaptation21 Aug 2025
- 2025Large Foundation Model for Ads Recommendation20 Aug 2025
- 2025DGenCTR: Towards a Universal Generative Paradigm for Click-Through Rate Prediction via Discrete Diffusion20 Aug 2025
- 2025FOUNDv2: Learning Unified User Quantized Tokenizers for User Representation1 Aug 2025
- 2025PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matching23 Jun 2025
- 2025Reinforcing User Interest Evolution in Multi-Scenario Learning for recommender systems21 Jun 2025
- 2025Align the GAP: Prior-based Unified Multi-Task Remote Physiological Measurement Framework For Domain Generalization and Personalization19 Jun 2025
- 2025Macro Graph of Experts for Billion-Scale Multi-Task Recommendation12 Jun 2025
- 2025UDuo: Universal Dual Optimization Framework for Online Matching28 May 2025
- 2025Revisiting Feature Interactions from the Perspective of Quadratic Neural Networks for Click-through Rate Prediction23 May 2025
- 2025Mini-Game Lifetime Value Prediction in WeChat21 May 2025
- 2025Addressing Information Loss and Interaction Collapse: A Dual Enhanced Attention Framework for Feature Interaction14 Mar 2025
- 2024Adaptive2: Adaptive Domain Mining for Fine-grained Domain Adaptation Modeling11 Dec 2024
- 2024Adaptive Conditional Expert Selection Network for Multi-domain Recommendation11 Nov 2024
- 2024GPRec: Bi-level User Modeling for Deep Recommenders28 Oct 2024
- 2024EnhancedRL: An Enhanced-State Reinforcement Learning Algorithm for Multi-Task Fusion in Recommender Systems18 Sep 2024
- 2024HoME: Hierarchy of Multi-Gate Experts for Multi-Task Learning at Kuaishou10 Aug 2024
- 2024Scene-wise Adaptive Network for Dynamic Cold-start Scenes Optimization in CTR Prediction3 Aug 2024
- 2024HMDN: Hierarchical Multi-Distribution Network for Click-Through Rate Prediction2 Aug 2024
- 2024A Survey of Controllable Learning: Methods and Applications in Information Retrieval4 Jul 2024
- 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendation18 Jun 2024
- 2024GLINT-RU: Gated Lightweight Intelligent Recurrent Units for Sequential Recommender Systems6 Jun 2024
- 2024Dynamic User Interest Augmentation via Stream Clustering and Memory Networks in Large-Scale Recommender Systems21 May 2024
- 2024Retrievable Domain-Sensitive Feature Memory for Multi-Domain Recommendation21 May 2024
- 2024PhysMLE: Generalizable and Priors-Inclusive Multi-task Remote Physiological Measurement10 May 2024
- 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework29 Apr 2024
- 2024UnifiedRL: A Reinforcement Learning Algorithm Tailored for Multi-Task Fusion in Large-Scale Recommender Systems19 Apr 2024
- 2024Scenario-Adaptive Fine-Grained Personalization Network: Tailoring User Behavior Representation to the Scenario Context15 Apr 2024
- 2024Large-Scale Multi-Domain Recommendation: an Automatic Domain Feature Extraction and Personalized Integration Framework12 Apr 2024
50 newest of 60 All 60 (JSON)
- 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Frameworkcited by 32
- 2024HoME: Hierarchy of Multi-Gate Experts for Multi-Task Learning at Kuaishoucited by 16
- 2025MTmixAtt: Integrating Mixture-of-Experts with Multi-Mix Attention for Large-Scale Recommendationcited by 3
- 2024HMDN: Hierarchical Multi-Distribution Network for Click-Through Rate Predictioncited by 0
- 2024Adaptive Conditional Expert Selection Network for Multi-domain Recommendationcited by 0
- 2025Distillation-based Scenario-Adaptive Mixture-of-Experts for the Matching Stage of Multi-scenario Recommendationcited by 0
- 2026Heterogeneous Ranking in Industrial-Scale Recommender Systems: A Case Studycited by 0
- 2026PRIME: Mitigating Subgroup Optimization Competition in Shared CTR Top Networks with Plug-in Residual Input-Conditioned Mixture of Expertcited by 0
- 2026PRIME: Mitigating Subgroup Optimization Competition in Shared CTR Top Networks with Plug-in Residual Input-Conditioned Mixture of Expert31 Aug 2026
- 2026Heterogeneous Ranking in Industrial-Scale Recommender Systems: A Case Study30 Jul 2026
- 2025Distillation-based Scenario-Adaptive Mixture-of-Experts for the Matching Stage of Multi-scenario Recommendation28 Nov 2025
- 2025MTmixAtt: Integrating Mixture-of-Experts with Multi-Mix Attention for Large-Scale Recommendation17 Oct 2025
- 2024Adaptive Conditional Expert Selection Network for Multi-domain Recommendation11 Nov 2024
- 2024HoME: Hierarchy of Multi-Gate Experts for Multi-Task Learning at Kuaishou10 Aug 2024
- 2024HMDN: Hierarchical Multi-Distribution Network for Click-Through Rate Prediction2 Aug 2024
- 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework29 Apr 2024
- 2023STEM: Unleashing the Power of Embeddings for Multi-task Recommendationcited by 19
- 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendationcited by 19
- 2024Ads Recommendation in a Collapsed and Entangled Worldcited by 13
- 2024A Survey of Controllable Learning: Methods and Applications in Information Retrievalcited by 12
- 2025MMQ: Multimodal Mixture-of-Quantization Tokenization for Semantic ID Generation and User Behavioral Adaptationcited by 10
- 2024PhysMLE: Generalizable and Priors-Inclusive Multi-task Remote Physiological Measurementcited by 9
- 2024Entire Chain Uplift Modeling with Context-Enhanced Learning for Intelligent Marketingcited by 7
- 2024MerRec: A Large-scale Multipurpose Mercari Dataset for Consumer-to-Consumer Recommendation Systemscited by 6
- 2024DNS-Rec: Data-aware Neural Architecture Search for Recommender Systemscited by 4
- 2024Ensure Timeliness and Accuracy: A Novel Sliding Window Data Stream Paradigm for Live Streaming Recommendationcited by 4
- 2024Retrievable Domain-Sensitive Feature Memory for Multi-Domain Recommendationcited by 4
- 2024GLINT-RU: Gated Lightweight Intelligent Recurrent Units for Sequential Recommender Systemscited by 4
12 most cited of 49 All 49 (JSON)
- 2026MARCO: Click-Intent Decomposition for Calibrated Ads Conversion Prediction11 Aug 2026
- 2026Bumblebee: Interleaved Mixed-Layer Building Blocks for Large-Scale Recommendation Systems6 Jul 2026
- 2026DUET -- Dual User Embedding Transformers for Offsite Conversion Prediction8 Jun 2026
- 2026Action-Aware Generative Sequence Modeling for Short Video Recommendation28 Apr 2026
- 2026TokenFormer: Unify the Multi-Field and Sequential Recommendation Worlds15 Apr 2026
- 2026UniScale: Synergistic Entire Space Data and Model Scaling for Search Ranking25 Mar 2026
- 2026Deferred is Better: A Framework for Multi-Granularity Deferred Interaction of Heterogeneous Features13 Mar 2026
- 2026Trinity: A Scenario-Aware Recommendation Framework for Large-Scale Cold-Start Users28 Feb 2026
- 2026DAIAN: Deep Adaptive Intent-Aware Network for CTR Prediction in Trigger-Induced Recommendation15 Feb 2026
- 2026Jointly Optimizing Debiased CTR and Uplift for Coupons Marketing: A Unified Causal Framework13 Feb 2026
- 2026Compute Only Once: UG-Separation for Efficient Large Recommendation Models11 Feb 2026
- 2026MDL: A Unified Multi-Distribution Learner in Large-scale Industrial Recommendation through Tokenization7 Feb 2026
12 newest of 49 All 49 (JSON)