mlsanityData to 7 Oct 2026

Click-Through Rate Prediction in Online Advertising: A Literature Review

arXiv 2202.10462 ↗First posted 22 Feb 2022cs.IR cs.AI cs.LGcited by 31

Not on the map. Why?

Abstract (arXiv)

Predicting the probability that a user will click on a specific advertisement has been a prevalent issue in online advertising, attracting much research attention in the past decades. As a hot research frontier driven by industrial needs, recent years have witnessed more and more novel learning models employed to improve advertising CTR prediction. Although extant research provides necessary details on algorithmic design for addressing a variety of specific problems in advertising CTR prediction, the methodological evolution and connections between modeling frameworks are precluded. However, to the best of our knowledge, there are few comprehensive surveys on this topic. We make a systematic literature review on state-of-the-art and latest CTR prediction research, with a special focus on modeling frameworks. Specifically, we give a classification of state-of-the-art CTR prediction models in the extant literature, within which basic modeling frameworks and their extensions, advantages and disadvantages, and performance assessment for CTR prediction are presented. Moreover, we summarize CTR prediction models with respect to the complexity and the order of feature interactions, and performance comparisons on various datasets. Furthermore, we identify current research trends, main challenges and potential future directions worthy of further explorations. This review is expected to provide fundamental knowledge and efficient entry points for IS and marketing scholars who want to engage in this area.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 57 of its 169 references that are in the map. First posted on arXiv 22 Feb 2022.

Builds on

57 of 169 references.

References · 57

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  2. 2016Wide & Deep Learning for Recommender Systemscited by 745
  3. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
  4. 2017Deep Interest Network for Click-Through Rate Predictioncited by 541
  5. 2017Deep & Cross Network for Ad Click Predictionscited by 392
  6. 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 336
  7. 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 277
  8. 2015A Critical Review of Recurrent Neural Networks for Sequence Learningcited by 223
  9. 2017Neural Factorization Machines for Sparse Predictive Analyticscited by 183
  10. 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 176
  11. 2016Product-based Neural Networks for User Response Predictioncited by 145
  12. 2017Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networkscited by 126
38 more
  1. 2019Practice on Long Sequential User Behavior Modeling for Click-Through Rate Predictioncited by 118
  2. 2019FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Predictioncited by 83
  3. 2019Compositional Embeddings Using Complementary Partitions for Memory-Efficient Recommendation Systemscited by 68
  4. 2016Deep Learning over Multi-field Categorical Data: A Case Study on User Response Predictioncited by 67
  5. 2019Warm Up Cold-start Advertisements: Improving CTR Predictions via Learning to Learn ID Embeddingscited by 65
  6. 2018Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertisingcited by 59
  7. 2019Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Predictioncited by 54
  8. 2020AutoFIS: Automatic Feature Interaction Selection in Factorization Models for Click-Through Rate Predictioncited by 52
  9. 2021Learnable Embedding Sizes for Recommender Systemscited by 42
  10. 2019AutoCross: Automatic Feature Crossing for Tabular Data in Real-World Applicationscited by 39
  11. 2020Towards Automated Neural Interaction Discovery for Click-Through Rate Predictioncited by 37
  12. 2020An Embedding Learning Framework for Numerical Features in CTR Predictioncited by 37
  13. 2021Deep Learning for Click-Through Rate Estimationcited by 33
  14. 2016Deep CTR Prediction in Display Advertisingcited by 31
  15. 2021FM2: Field-matrixed Factorization Machines for Recommender Systemscited by 31
  16. 2019Feature Generation by Convolutional Neural Network for Click-Through Rate Predictioncited by 26
  17. 2018Deep reinforcement learning for search, recommendation, and online advertising: a surveycited by 23
  18. 2014Sequential Click Prediction for Sponsored Search with Recurrent Neural Networkscited by 21
  19. 2017Field-aware Factorization Machines in a Real-world Online Advertising Systemcited by 21
  20. 2019Field-aware Calibration: A Simple and Empirically Strong Method for Reliable Probabilistic Predictionscited by 19
  21. 2021Dual Graph enhanced Embedding Neural Network for CTR Predictioncited by 19
  22. 2020Ensemble Knowledge Distillation for CTR Predictioncited by 18
  23. 2019Deep Spatio-Temporal Neural Networks for Click-Through Rate Predictioncited by 17
  24. 2020Network On Network for Tabular Data Classification in Real-world Applicationscited by 17
  25. 2020Training Recommender Systems at Scale: Communication-Efficient Model and Data Parallelismcited by 15
  26. 2021User Response Prediction in Online Advertisingcited by 15
  27. 2020FIVES: Feature Interaction Via Edge Search for Large-Scale Tabular Datacited by 13
  28. 2021Learning Graph Meta Embeddings for Cold-Start Ads in Click-Through Rate Predictioncited by 13
  29. 2021GraphFM: Graph Factorization Machines for Feature Interaction Modelingcited by 13
  30. 2021ScaleFreeCTR: MixCache-based Distributed Training System for CTR Models with Huge Embedding Tablecited by 12
  31. 2019Operation-aware Neural Networks for User Response Predictioncited by 10
  32. 2017PBODL : Parallel Bayesian Online Deep Learning for Click-Through Rate Prediction in Tencent Advertising Systemcited by 9
  33. 2019Representation Learning-Assisted Click-Through Rate Predictioncited by 9
  34. 2021Deep Position-wise Interaction Network for CTR Predictioncited by 8
  35. 2016A Communication-Efficient Parallel Algorithm for Decision Treecited by 7
  36. 2020AutoRec: An Automated Recommender Systemcited by 6
  37. 2019Click-Through Rate Prediction with the User Memory Networkcited by 5
  38. 2020AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender Systemcited by 5

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 9; 2024: 7; 2025: 8; 2026: 4.

31 papers.

Sort:

  1. 2024Ads Recommendation in a Collapsed and Entangled Worldcited by 13
  2. 2022DHEN: A Deep and Hierarchical Ensemble Network for Large-Scale Click-Through Rate Predictioncited by 12
  3. 2022DeepGen: Diverse Search Ad Generation and Real-Time Customizationcited by 10
  4. 2023Causality-based CTR Prediction using Graph Neural Networkscited by 9
  5. 2023UniPredict: Large Language Models are Universal Tabular Classifierscited by 9
  6. 2025Be.FM: Open Foundation Models for Human Behaviorcited by 6
  7. 2023TCE: A Test-Based Approach to Measuring Calibration Errorcited by 5
  8. 2022Keyword Targeting Optimization in Sponsored Search Advertising: Combining Selection and Matchingcited by 4
  9. 2024AdTEC: A Unified Benchmark for Evaluating Text Quality in Search Engine Advertisingcited by 4
  10. 2025General Information Metrics for Improving AI Model Training Efficiencycited by 4
  11. 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Predictioncited by 4
  12. 2025Contrastive Learning from Exploratory Actions: Leveraging Natural Interactions for Preference Elicitationcited by 3
19 more
  1. 2023Keyword Decisions in Sponsored Search Advertising: A Literature Review and Research Agendacited by 1
  2. 2023Pairwise Ranking Losses of Click-Through Rates Prediction for Welfare Maximization in Ad Auctionscited by 1
  3. 2023Transferable Adversarial Robustness for Categorical Data via Universal Robust Embeddingscited by 1
  4. 2023Impression-Aware Recommender Systemscited by 1
  5. 2024Beyond KAN: Introducing KarSein for Adaptive High-Order Feature Interaction Modeling in CTR Predictioncited by 1
  6. 2024Adaptive Learning on User Segmentation: Universal to Specific Representation via Bipartite Neural Interactioncited by 1
  7. 2024Learning Multi-Branch Cooperation for Enhanced Click-Through Rate Prediction at Taobaocited by 1
  8. 2025Dataset-Agnostic Recommender Systemscited by 1
  9. 2023Beyond Rankings: Exploring the Impact of SERP Features on Organic Click-through Ratescited by 0
  10. 2023EMOFM: Ensemble MLP mOdel with Feature-based Mixers for Click-Through Rate Predictioncited by 0
  11. 2024GCOF: Self-iterative Text Generation for Copywriting Using Large Language Modelcited by 0
  12. 2024NeSHFS: Neighborhood Search with Heuristic-based Feature Selection for Click-Through Rate Predictioncited by 0
  13. 2025CTR Prediction on Alibaba's Taobao Advertising Dataset Using Traditional and Deep Learning Modelscited by 0
  14. 2025Conversion rate prediction in online advertising: modeling techniques, performance evaluation and future directionscited by 0
  15. 2025Toward a benchmark for CTR prediction in online advertising: datasets, evaluation protocols and perspectivescited by 0
  16. 2026Competition-Aware CPC Forecasting with Near-Market Coveragecited by 0
  17. 2026Generative Long-term User Interest Modeling for Click-Through Rate Predictioncited by 0
  18. 2026BehaviorBench: Benchmarking Foundation Models for Behavioral Science Taskscited by 0
  19. 2026DMRL: Document-Mediated Reinforcement Learning for Skill Optimization in Advertising Recommendationcited by 0