Click-Through Rate Prediction in Online Advertising: A Literature Review
Not on the map. Why?
Abstract (arXiv)
Predicting the probability that a user will click on a specific advertisement has been a prevalent issue in online advertising, attracting much research attention in the past decades. As a hot research frontier driven by industrial needs, recent years have witnessed more and more novel learning models employed to improve advertising CTR prediction. Although extant research provides necessary details on algorithmic design for addressing a variety of specific problems in advertising CTR prediction, the methodological evolution and connections between modeling frameworks are precluded. However, to the best of our knowledge, there are few comprehensive surveys on this topic. We make a systematic literature review on state-of-the-art and latest CTR prediction research, with a special focus on modeling frameworks. Specifically, we give a classification of state-of-the-art CTR prediction models in the extant literature, within which basic modeling frameworks and their extensions, advantages and disadvantages, and performance assessment for CTR prediction are presented. Moreover, we summarize CTR prediction models with respect to the complexity and the order of feature interactions, and performance comparisons on various datasets. Furthermore, we identify current research trends, main challenges and potential future directions worthy of further explorations. This review is expected to provide fundamental knowledge and efficient entry points for IS and marketing scholars who want to engage in this area.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 57 of its 169 references that are in the map. First posted on arXiv 22 Feb 2022.
Builds on
57 of 169 references.
References · 57
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2016Wide & Deep Learning for Recommender Systemscited by 745
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
- 2017Deep Interest Network for Click-Through Rate Predictioncited by 541
- 2017Deep & Cross Network for Ad Click Predictionscited by 392
- 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 336
- 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 277
- 2015A Critical Review of Recurrent Neural Networks for Sequence Learningcited by 223
- 2017Neural Factorization Machines for Sparse Predictive Analyticscited by 183
- 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 176
- 2016Product-based Neural Networks for User Response Predictioncited by 145
- 2017Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networkscited by 126
38 more
- 2019Practice on Long Sequential User Behavior Modeling for Click-Through Rate Predictioncited by 118
- 2019FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Predictioncited by 83
- 2019Compositional Embeddings Using Complementary Partitions for Memory-Efficient Recommendation Systemscited by 68
- 2016Deep Learning over Multi-field Categorical Data: A Case Study on User Response Predictioncited by 67
- 2019Warm Up Cold-start Advertisements: Improving CTR Predictions via Learning to Learn ID Embeddingscited by 65
- 2018Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertisingcited by 59
- 2019Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Predictioncited by 54
- 2020AutoFIS: Automatic Feature Interaction Selection in Factorization Models for Click-Through Rate Predictioncited by 52
- 2021Learnable Embedding Sizes for Recommender Systemscited by 42
- 2019AutoCross: Automatic Feature Crossing for Tabular Data in Real-World Applicationscited by 39
- 2020Towards Automated Neural Interaction Discovery for Click-Through Rate Predictioncited by 37
- 2020An Embedding Learning Framework for Numerical Features in CTR Predictioncited by 37
- 2021Deep Learning for Click-Through Rate Estimationcited by 33
- 2016Deep CTR Prediction in Display Advertisingcited by 31
- 2021FM2: Field-matrixed Factorization Machines for Recommender Systemscited by 31
- 2019Feature Generation by Convolutional Neural Network for Click-Through Rate Predictioncited by 26
- 2018Deep reinforcement learning for search, recommendation, and online advertising: a surveycited by 23
- 2014Sequential Click Prediction for Sponsored Search with Recurrent Neural Networkscited by 21
- 2017Field-aware Factorization Machines in a Real-world Online Advertising Systemcited by 21
- 2019Field-aware Calibration: A Simple and Empirically Strong Method for Reliable Probabilistic Predictionscited by 19
- 2021Dual Graph enhanced Embedding Neural Network for CTR Predictioncited by 19
- 2020Ensemble Knowledge Distillation for CTR Predictioncited by 18
- 2019Deep Spatio-Temporal Neural Networks for Click-Through Rate Predictioncited by 17
- 2020Network On Network for Tabular Data Classification in Real-world Applicationscited by 17
- 2020Training Recommender Systems at Scale: Communication-Efficient Model and Data Parallelismcited by 15
- 2021User Response Prediction in Online Advertisingcited by 15
- 2020FIVES: Feature Interaction Via Edge Search for Large-Scale Tabular Datacited by 13
- 2021Learning Graph Meta Embeddings for Cold-Start Ads in Click-Through Rate Predictioncited by 13
- 2021GraphFM: Graph Factorization Machines for Feature Interaction Modelingcited by 13
- 2021ScaleFreeCTR: MixCache-based Distributed Training System for CTR Models with Huge Embedding Tablecited by 12
- 2019Operation-aware Neural Networks for User Response Predictioncited by 10
- 2017PBODL : Parallel Bayesian Online Deep Learning for Click-Through Rate Prediction in Tencent Advertising Systemcited by 9
- 2019Representation Learning-Assisted Click-Through Rate Predictioncited by 9
- 2021Deep Position-wise Interaction Network for CTR Predictioncited by 8
- 2016A Communication-Efficient Parallel Algorithm for Decision Treecited by 7
- 2020AutoRec: An Automated Recommender Systemcited by 6
- 2019Click-Through Rate Prediction with the User Memory Networkcited by 5
- 2020AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender Systemcited by 5
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2022: 3; 2023: 9; 2024: 7; 2025: 8; 2026: 4.
31 papers.
Sort:
- 2024Ads Recommendation in a Collapsed and Entangled Worldcited by 13
- 2022DHEN: A Deep and Hierarchical Ensemble Network for Large-Scale Click-Through Rate Predictioncited by 12
- 2022DeepGen: Diverse Search Ad Generation and Real-Time Customizationcited by 10
- 2023Causality-based CTR Prediction using Graph Neural Networkscited by 9
- 2023UniPredict: Large Language Models are Universal Tabular Classifierscited by 9
- 2025Be.FM: Open Foundation Models for Human Behaviorcited by 6
- 2023TCE: A Test-Based Approach to Measuring Calibration Errorcited by 5
- 2022Keyword Targeting Optimization in Sponsored Search Advertising: Combining Selection and Matchingcited by 4
- 2024AdTEC: A Unified Benchmark for Evaluating Text Quality in Search Engine Advertisingcited by 4
- 2025General Information Metrics for Improving AI Model Training Efficiencycited by 4
- 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Predictioncited by 4
- 2025Contrastive Learning from Exploratory Actions: Leveraging Natural Interactions for Preference Elicitationcited by 3
19 more
- 2023Keyword Decisions in Sponsored Search Advertising: A Literature Review and Research Agendacited by 1
- 2023Pairwise Ranking Losses of Click-Through Rates Prediction for Welfare Maximization in Ad Auctionscited by 1
- 2023Transferable Adversarial Robustness for Categorical Data via Universal Robust Embeddingscited by 1
- 2023Impression-Aware Recommender Systemscited by 1
- 2024Beyond KAN: Introducing KarSein for Adaptive High-Order Feature Interaction Modeling in CTR Predictioncited by 1
- 2024Adaptive Learning on User Segmentation: Universal to Specific Representation via Bipartite Neural Interactioncited by 1
- 2024Learning Multi-Branch Cooperation for Enhanced Click-Through Rate Prediction at Taobaocited by 1
- 2025Dataset-Agnostic Recommender Systemscited by 1
- 2023Beyond Rankings: Exploring the Impact of SERP Features on Organic Click-through Ratescited by 0
- 2023EMOFM: Ensemble MLP mOdel with Feature-based Mixers for Click-Through Rate Predictioncited by 0
- 2024GCOF: Self-iterative Text Generation for Copywriting Using Large Language Modelcited by 0
- 2024NeSHFS: Neighborhood Search with Heuristic-based Feature Selection for Click-Through Rate Predictioncited by 0
- 2025CTR Prediction on Alibaba's Taobao Advertising Dataset Using Traditional and Deep Learning Modelscited by 0
- 2025Conversion rate prediction in online advertising: modeling techniques, performance evaluation and future directionscited by 0
- 2025Toward a benchmark for CTR prediction in online advertising: datasets, evaluation protocols and perspectivescited by 0
- 2026Competition-Aware CPC Forecasting with Near-Market Coveragecited by 0
- 2026Generative Long-term User Interest Modeling for Click-Through Rate Predictioncited by 0
- 2026BehaviorBench: Benchmarking Foundation Models for Behavioral Science Taskscited by 0
- 2026DMRL: Document-Mediated Reinforcement Learning for Skill Optimization in Advertising Recommendationcited by 0
- 2026DMRL: Document-Mediated Reinforcement Learning for Skill Optimization in Advertising Recommendation2 Sep 2026
- 2026BehaviorBench: Benchmarking Foundation Models for Behavioral Science Tasks23 Jun 2026
- 2026Generative Long-term User Interest Modeling for Click-Through Rate Prediction15 May 2026
- 2026Competition-Aware CPC Forecasting with Near-Market Coverage13 Mar 2026
- 2025Toward a benchmark for CTR prediction in online advertising: datasets, evaluation protocols and perspectives1 Dec 2025
- 2025Conversion rate prediction in online advertising: modeling techniques, performance evaluation and future directions1 Dec 2025
- 2025CTR Prediction on Alibaba's Taobao Advertising Dataset Using Traditional and Deep Learning Models26 Nov 2025
- 2025Be.FM: Open Foundation Models for Human Behavior29 May 2025
- 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Prediction20 May 2025
- 2025Dataset-Agnostic Recommender Systems13 Jan 2025
- 2025General Information Metrics for Improving AI Model Training Efficiency2 Jan 2025
- 2025Contrastive Learning from Exploratory Actions: Leveraging Natural Interactions for Preference Elicitation2 Jan 2025
19 more
- 2024Learning Multi-Branch Cooperation for Enhanced Click-Through Rate Prediction at Taobao20 Nov 2024
- 2024Adaptive Learning on User Segmentation: Universal to Specific Representation via Bipartite Neural Interaction23 Sep 2024
- 2024NeSHFS: Neighborhood Search with Heuristic-based Feature Selection for Click-Through Rate Prediction13 Sep 2024
- 2024Beyond KAN: Introducing KarSein for Adaptive High-Order Feature Interaction Modeling in CTR Prediction16 Aug 2024
- 2024AdTEC: A Unified Benchmark for Evaluating Text Quality in Search Engine Advertising12 Aug 2024
- 2024Ads Recommendation in a Collapsed and Entangled World22 Feb 2024
- 2024GCOF: Self-iterative Text Generation for Copywriting Using Large Language Model21 Feb 2024
- 2023EMOFM: Ensemble MLP mOdel with Feature-based Mixers for Click-Through Rate Prediction6 Oct 2023
- 2023UniPredict: Large Language Models are Universal Tabular Classifiers5 Oct 2023
- 2023Impression-Aware Recommender Systems15 Aug 2023
- 2023TCE: A Test-Based Approach to Measuring Calibration Error25 Jun 2023
- 2023Transferable Adversarial Robustness for Categorical Data via Universal Robust Embeddings6 Jun 2023
- 2023Pairwise Ranking Losses of Click-Through Rates Prediction for Welfare Maximization in Ad Auctions1 Jun 2023
- 2023Beyond Rankings: Exploring the Impact of SERP Features on Organic Click-through Rates31 May 2023
- 2023Keyword Decisions in Sponsored Search Advertising: A Literature Review and Research Agenda24 Feb 2023
- 2023Causality-based CTR Prediction using Graph Neural Networks30 Jan 2023
- 2022Keyword Targeting Optimization in Sponsored Search Advertising: Combining Selection and Matching19 Oct 2022
- 2022DeepGen: Diverse Search Ad Generation and Real-Time Customization6 Aug 2022
- 2022DHEN: A Deep and Hierarchical Ensemble Network for Large-Scale Click-Through Rate Prediction11 Mar 2022
- 2024Ads Recommendation in a Collapsed and Entangled Worldcited by 13
- 2022DHEN: A Deep and Hierarchical Ensemble Network for Large-Scale Click-Through Rate Predictioncited by 12
- 2022DeepGen: Diverse Search Ad Generation and Real-Time Customizationcited by 10
- 2023Causality-based CTR Prediction using Graph Neural Networkscited by 9
- 2023UniPredict: Large Language Models are Universal Tabular Classifierscited by 9
- 2025Be.FM: Open Foundation Models for Human Behaviorcited by 6
- 2023TCE: A Test-Based Approach to Measuring Calibration Errorcited by 5
- 2022Keyword Targeting Optimization in Sponsored Search Advertising: Combining Selection and Matchingcited by 4
- 2024AdTEC: A Unified Benchmark for Evaluating Text Quality in Search Engine Advertisingcited by 4
- 2025General Information Metrics for Improving AI Model Training Efficiencycited by 4
- 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Predictioncited by 4
- 2025Contrastive Learning from Exploratory Actions: Leveraging Natural Interactions for Preference Elicitationcited by 3
12 most cited of 31 All 31 (JSON)
- 2026DMRL: Document-Mediated Reinforcement Learning for Skill Optimization in Advertising Recommendation2 Sep 2026
- 2026BehaviorBench: Benchmarking Foundation Models for Behavioral Science Tasks23 Jun 2026
- 2026Generative Long-term User Interest Modeling for Click-Through Rate Prediction15 May 2026
- 2026Competition-Aware CPC Forecasting with Near-Market Coverage13 Mar 2026
- 2025Toward a benchmark for CTR prediction in online advertising: datasets, evaluation protocols and perspectives1 Dec 2025
- 2025Conversion rate prediction in online advertising: modeling techniques, performance evaluation and future directions1 Dec 2025
- 2025CTR Prediction on Alibaba's Taobao Advertising Dataset Using Traditional and Deep Learning Models26 Nov 2025
- 2025Be.FM: Open Foundation Models for Human Behavior29 May 2025
- 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Prediction20 May 2025
- 2025Dataset-Agnostic Recommender Systems13 Jan 2025
- 2025General Information Metrics for Improving AI Model Training Efficiency2 Jan 2025
- 2025Contrastive Learning from Exploratory Actions: Leveraging Natural Interactions for Preference Elicitation2 Jan 2025
12 newest of 31 All 31 (JSON)