User Response Prediction in Online Advertising
Not on the map. Why?
Abstract (arXiv)
Online advertising, as the vast market, has gained significant attention in various platforms ranging from search engines, third-party websites, social media, and mobile apps. The prosperity of online campaigns is a challenge in online marketing and is usually evaluated by user response through different metrics, such as clicks on advertisement (ad) creatives, subscriptions to products, purchases of items, or explicit user feedback through online surveys. Recent years have witnessed a significant increase in the number of studies using computational approaches, including machine learning methods, for user response prediction. However, existing literature mainly focuses on algorithmic-driven designs to solve specific challenges, and no comprehensive review exists to answer many important questions. What are the parties involved in the online digital advertising eco-systems? What type of data are available for user response prediction? How to predict user response in a reliable and/or transparent way? In this survey, we provide a comprehensive review of user response prediction in online advertising and related recommender applications. Our essential goal is to provide a thorough understanding of online advertising platforms, stakeholders, data availability, and typical ways of user response prediction. We propose a taxonomy to categorize state-of-the-art user response prediction methods, primarily focus on the current progress of machine learning methods used in different online platforms. In addition, we also review applications of user response prediction, benchmark datasets, and open-source codes in the field.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 99 of its 205 references that are in the map. First posted on arXiv 7 Jan 2021.
Builds on
99 of 205 references.
References · 99
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2017Neural Collaborative Filteringcited by 1,111
- 2016Wide & Deep Learning for Recommender Systemscited by 747
- 2019Heterogeneous Graph Attention Networkcited by 734
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
- 2019Neural Graph Collaborative Filteringcited by 661
- 2017Deep Interest Network for Click-Through Rate Predictioncited by 544
- 2017Deep & Cross Network for Ad Click Predictionscited by 393
- 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 338
38 more
- 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
- 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
- 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
- 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 278
- 2017Neural Factorization Machines for Sparse Predictive Analyticscited by 183
- 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 177
- 2018Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Ratecited by 173
- 2016Product-based Neural Networks for User Response Predictioncited by 145
- 2018RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systemscited by 138
- 2018DKN: Deep Knowledge-Aware Network for News Recommendationcited by 137
- 2017Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networkscited by 126
- 2019Practice on Long Sequential User Behavior Modeling for Click-Through Rate Predictioncited by 118
- 2019MLPerf Training Benchmarkcited by 115
- 2019Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systemscited by 107
- 2018Billion-scale Commodity Embedding for E-commerce Recommendation in Alibabacited by 105
- 2016Entity Embeddings of Categorical Variablescited by 87
- 2019FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Predictioncited by 83
- 2019Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendationcited by 71
- 2016Deep Learning over Multi-field Categorical Data: A Case Study on User Response Predictioncited by 67
- 2019Warm Up Cold-start Advertisements: Improving CTR Predictions via Learning to Learn ID Embeddingscited by 66
- 2019Deep Session Interest Network for Click-Through Rate Predictioncited by 64
- 2020Distributed Hierarchical GPU Parameter Server for Massive Scale Deep Learning Ads Systemscited by 60
- 2018Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertisingcited by 59
- 2019Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Predictioncited by 54
- 2020AutoFIS: Automatic Feature Interaction Selection in Factorization Models for Click-Through Rate Predictioncited by 52
- 2019On the Difficulty of Evaluating Baselines: A Study on Recommender Systemscited by 46
- 2016Higher-Order Factorization Machinescited by 45
- 2018Product-based Neural Networks for User Response Prediction over Multi-field Categorical Datacited by 44
- 2020User Behavior Retrieval for Click-Through Rate Predictioncited by 44
- 2016Display Advertising with Real-Time Bidding (RTB) and Behavioural Targetingcited by 42
- 2020How to Retrain Recommender System? A Sequential Meta-Learning Methodcited by 42
- 2019Lifelong Sequential Modeling with Personalized Memorization for User Response Predictioncited by 41
- 2020Towards Automated Neural Interaction Discovery for Click-Through Rate Predictioncited by 37
- 2016Deep CTR Prediction in Display Advertisingcited by 31
- 2017Rocket Launching: A Universal and Efficient Framework for Training Well-performing Light Netcited by 27
- 2020Jointly Learning to Recommend and Advertisecited by 27
- 2019Feature Generation by Convolutional Neural Network for Click-Through Rate Predictioncited by 26
- 2019Addressing Delayed Feedback for Continuous Training with Neural Networks in CTR predictioncited by 25
50 most cited of 99 All 99 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 4; 2024: 1; 2025: 4; 2026: 2.
15 papers.
Sort:
By area:
- 2022Knowledge Graph Contrastive Learning for Recommendationcited by 70
- 2022Click-Through Rate Prediction in Online Advertising: A Literature Reviewcited by 31
- 2023Knowledge Enhancement for Contrastive Multi-Behavior Recommendationcited by 16
- 2022A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacousticcited by 7
- 2025KERAG_R: Knowledge-Enhanced Retrieval-Augmented Generation for Recommendationcited by 3
- 2026Rank-Learner: Orthogonal Ranking of Treatment Effectscited by 3
- 2023A Scalable and Efficient Iterative Method for Copying Machine Learning Classifierscited by 1
- 2023Weighted Multi-Level Feature Factorization for App ads CTR and installation predictioncited by 1
- 2023Impression-Aware Recommender Systemscited by 1
- 2024Beyond KAN: Introducing KarSein for Adaptive High-Order Feature Interaction Modeling in CTR Predictioncited by 1
- 2025Optimizing Storage Overhead of User Behavior Log for ML-embedded Mobile Appscited by 1
- 2021Machines & Influence: An Information Systems Lenscited by 0
3 more
- 2025Conversion rate prediction in online advertising: modeling techniques, performance evaluation and future directionscited by 0
- 2025A Knowledge Graph and Deep Learning-Based Semantic Recommendation Database System for Advertisement Retrieval and Personalizationcited by 0
- 2026Decoding the Hook: A Multimodal LLM Framework for Analyzing the Hooking Period of Video Adscited by 0
- 2026Decoding the Hook: A Multimodal LLM Framework for Analyzing the Hooking Period of Video Ads25 Feb 2026
- 2026Rank-Learner: Orthogonal Ranking of Treatment Effects3 Feb 2026
- 2025A Knowledge Graph and Deep Learning-Based Semantic Recommendation Database System for Advertisement Retrieval and Personalization25 Dec 2025
- 2025Conversion rate prediction in online advertising: modeling techniques, performance evaluation and future directions1 Dec 2025
- 2025Optimizing Storage Overhead of User Behavior Log for ML-embedded Mobile Apps15 Oct 2025
- 2025KERAG_R: Knowledge-Enhanced Retrieval-Augmented Generation for Recommendation8 Jul 2025
- 2024Beyond KAN: Introducing KarSein for Adaptive High-Order Feature Interaction Modeling in CTR Prediction16 Aug 2024
- 2023Impression-Aware Recommender Systems15 Aug 2023
- 2023Weighted Multi-Level Feature Factorization for App ads CTR and installation prediction3 Aug 2023
- 2023A Scalable and Efficient Iterative Method for Copying Machine Learning Classifiers6 Feb 2023
- 2023Knowledge Enhancement for Contrastive Multi-Behavior Recommendation13 Jan 2023
- 2022Knowledge Graph Contrastive Learning for Recommendation2 May 2022
- 2022Knowledge Graph Contrastive Learning for Recommendationcited by 70
- 2022Click-Through Rate Prediction in Online Advertising: A Literature Reviewcited by 31
- 2023Knowledge Enhancement for Contrastive Multi-Behavior Recommendationcited by 16
- 2022A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacousticcited by 7
- 2026Rank-Learner: Orthogonal Ranking of Treatment Effectscited by 3
- 2023A Scalable and Efficient Iterative Method for Copying Machine Learning Classifierscited by 1
- 2023Weighted Multi-Level Feature Factorization for App ads CTR and installation predictioncited by 1
- 2023Impression-Aware Recommender Systemscited by 1
- 2024Beyond KAN: Introducing KarSein for Adaptive High-Order Feature Interaction Modeling in CTR Predictioncited by 1
- 2025Optimizing Storage Overhead of User Behavior Log for ML-embedded Mobile Appscited by 1
- 2021Machines & Influence: An Information Systems Lenscited by 0
- 2025Conversion rate prediction in online advertising: modeling techniques, performance evaluation and future directionscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Decoding the Hook: A Multimodal LLM Framework for Analyzing the Hooking Period of Video Ads25 Feb 2026
- 2026Rank-Learner: Orthogonal Ranking of Treatment Effects3 Feb 2026
- 2025A Knowledge Graph and Deep Learning-Based Semantic Recommendation Database System for Advertisement Retrieval and Personalization25 Dec 2025
- 2025Conversion rate prediction in online advertising: modeling techniques, performance evaluation and future directions1 Dec 2025
- 2025Optimizing Storage Overhead of User Behavior Log for ML-embedded Mobile Apps15 Oct 2025
- 2024Beyond KAN: Introducing KarSein for Adaptive High-Order Feature Interaction Modeling in CTR Prediction16 Aug 2024
- 2023Impression-Aware Recommender Systems15 Aug 2023
- 2023Weighted Multi-Level Feature Factorization for App ads CTR and installation prediction3 Aug 2023
- 2023A Scalable and Efficient Iterative Method for Copying Machine Learning Classifiers6 Feb 2023
- 2023Knowledge Enhancement for Contrastive Multi-Behavior Recommendation13 Jan 2023
- 2022Knowledge Graph Contrastive Learning for Recommendation2 May 2022
- 2022A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacoustic13 Apr 2022
12 newest of 14 All 14 (JSON)