APG: Adaptive Parameter Generation Network for Click-Through Rate Prediction
Not on the map. Why?
Abstract (arXiv)
In many web applications, deep learning-based CTR prediction models (deep CTR models for short) are widely adopted. Traditional deep CTR models learn patterns in a static manner, i.e., the network parameters are the same across all the instances. However, such a manner can hardly characterize each of the instances which may have different underlying distributions. It actually limits the representation power of deep CTR models, leading to sub-optimal results. In this paper, we propose an efficient, effective, and universal module, named as Adaptive Parameter Generation network (APG), which can dynamically generate parameters for deep CTR models on-the-fly based on different instances. Extensive experimental evaluation results show that APG can be applied to a variety of deep CTR models and significantly improve their performance. Meanwhile, APG can reduce the time cost by 38.7% and memory usage by 96.6% compared to a regular deep CTR model. We have deployed APG in the industrial sponsored search system and achieved 3% CTR gain and 1% RPM gain respectively.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 32 of its 45 references that are in the map. First posted on arXiv 30 Mar 2022.
Builds on
32 of 45 references.
References · 32
- 2016HyperNetworkscited by 1,003
- 2016Wide & Deep Learning for Recommender Systemscited by 745
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
- 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 673
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 658
- 2017Deep Interest Network for Click-Through Rate Predictioncited by 541
- 2016Cross-stitch Networks for Multi-task Learningcited by 466
- 2017Deep & Cross Network for Ad Click Predictionscited by 392
- 2018Measuring the Intrinsic Dimension of Objective Landscapescited by 364
- 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 319
- 2016Dynamic Filter Networkscited by 318
- 2021Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworkscited by 278
20 more
- 2019ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blockscited by 178
- 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 176
- 2015Conditional Computation in Neural Networks for faster modelscited by 166
- 2016Product-based Neural Networks for User Response Predictioncited by 145
- 2019Knowledge Graph Convolutional Networks for Recommender Systemscited by 121
- 2019MeLU: Meta-Learned User Preference Estimator for Cold-Start Recommendationcited by 119
- 2021Diverse Branch Block: Building a Convolution as an Inception-like Unitcited by 87
- 2019FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Predictioncited by 83
- 2021One Model to Serve All: Star Topology Adaptive Recommender for Multi-Domain CTR Predictioncited by 78
- 2018Contextual Parameter Generation for Universal Neural Machine Translationcited by 40
- 2019Neural Input Search for Large Scale Recommendation Modelscited by 39
- 2020Towards Automated Neural Interaction Discovery for Click-Through Rate Predictioncited by 37
- 2021Deep Learning for Click-Through Rate Estimationcited by 33
- 2014Exponentially Increasing the Capacity-to-Computation Ratio for Conditional Computation in Deep Learningcited by 24
- 2019IntentGC: a Scalable Graph Convolution Framework Fusing Heterogeneous Information for Recommendationcited by 19
- 2019S2DNAS:Transforming Static CNN Model for Dynamic Inference via Neural Architecture Searchcited by 14
- 2021Click-Through Rate Prediction with Multi-Modal Hypergraphscited by 12
- 2018Decouple Learning for Parameterized Image Operatorscited by 11
- 2021Adaptive Convolutions with Per-pixel Dynamic Filter Atomcited by 11
- 2021Binary Code based Hash Embedding for Web-scale Applicationscited by 11
Built on by
Citing papers per year: 2022: 4; 2023: 4; 2024: 2; 2025: 0; 2026: 2.
12 papers.
- 2022AdaSparse: Learning Adaptively Sparse Structures for Multi-Domain Click-Through Rate Predictioncited by 7
- 2022Higher-order Neural Additive Models: An Interpretable Machine Learning Model with Feature Interactionscited by 7
- 2024Hate Speech Detection with Generalizable Target-aware Fairnesscited by 7
- 2022BASM: A Bottom-up Adaptive Spatiotemporal Model for Online Food Ordering Servicecited by 5
- 2023Hybrid Contrastive Constraints for Multi-Scenario Ad Rankingcited by 4
- 2024GPRec: Bi-level User Modeling for Deep Recommenderscited by 3
- 2022DIGMN: Dynamic Intent Guided Meta Network for Differentiated User Engagement Forecasting in Online Professional Social Platformscited by 1
- 2023FAN: Fatigue-Aware Network for Click-Through Rate Prediction in E-commerce Recommendationcited by 1
- 2023DynInt: Dynamic Interaction Modeling for Large-scale Click-Through Rate Predictioncited by 0
- 2023DPAN: Dynamic Preference-based and Attribute-aware Network for Relevant Recommendationscited by 0
- 2026UME: A Unified Meta-Generalization Framework for Cross-Domain ETAcited by 0
- 2026PRIME: Mitigating Subgroup Optimization Competition in Shared CTR Top Networks with Plug-in Residual Input-Conditioned Mixture of Expertcited by 0
- 2026PRIME: Mitigating Subgroup Optimization Competition in Shared CTR Top Networks with Plug-in Residual Input-Conditioned Mixture of Expert31 Aug 2026
- 2026UME: A Unified Meta-Generalization Framework for Cross-Domain ETA31 May 2026
- 2024GPRec: Bi-level User Modeling for Deep Recommenders28 Oct 2024
- 2024Hate Speech Detection with Generalizable Target-aware Fairness28 May 2024
- 2023DPAN: Dynamic Preference-based and Attribute-aware Network for Relevant Recommendations21 Aug 2023
- 2023FAN: Fatigue-Aware Network for Click-Through Rate Prediction in E-commerce Recommendation10 Apr 2023
- 2023Hybrid Contrastive Constraints for Multi-Scenario Ad Ranking6 Feb 2023
- 2023DynInt: Dynamic Interaction Modeling for Large-scale Click-Through Rate Prediction3 Jan 2023
- 2022BASM: A Bottom-up Adaptive Spatiotemporal Model for Online Food Ordering Service22 Nov 2022
- 2022DIGMN: Dynamic Intent Guided Meta Network for Differentiated User Engagement Forecasting in Online Professional Social Platforms22 Oct 2022
- 2022Higher-order Neural Additive Models: An Interpretable Machine Learning Model with Feature Interactions30 Sep 2022
- 2022AdaSparse: Learning Adaptively Sparse Structures for Multi-Domain Click-Through Rate Prediction27 Jun 2022