A Nonparametric Delayed Feedback Model for Conversion Rate Prediction
Not on the map. Why?
Abstract (arXiv)
Predicting conversion rates (CVRs) in display advertising (e.g., predicting the proportion of users who purchase an item (i.e., a conversion) after its corresponding ad is clicked) is important when measuring the effects of ads shown to users and to understanding the interests of the users. There is generally a time delay (i.e., so-called it delayed feedback) between the ad click and conversion. Owing to the delayed feedback, samples that are converted after an observation period may be treated as negative. To overcome this drawback, CVR prediction assuming that the time delay follows an exponential distribution has been proposed. In practice, however, there is no guarantee that the delay is generated from the exponential distribution, and the best distribution with which to represent the delay depends on the data. In this paper, we propose a nonparametric delayed feedback model for CVR prediction that represents the distribution of the time delay without assuming a parametric distribution, such as an exponential or Weibull distribution. Because the distribution of the time delay is modeled depending on the content of an ad and the features of a user, various shapes of the distribution can be represented potentially. In experiments, we show that the proposed model can capture the distribution for the time delay on a synthetic dataset, even when the distribution is complicated. Moreover, on a real dataset, we show that the proposed model outperforms the existing method that assumes an exponential distribution for the time delay in terms of conversion rate prediction.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 1; 2024: 3; 2025: 3; 2026: 6.
19 papers.
Sort:
- 2021Real Negatives Matter: Continuous Training with Real Negatives for Delayed Feedback Modelingcited by 20
- 2022Asymptotically Unbiased Estimation for Delayed Feedback Modeling via Label Correctioncited by 15
- 2024A Short Survey on Importance Weighting for Machine Learningcited by 15
- 2022Generalized Delayed Feedback Model with Post-Click Information in Recommender Systemscited by 8
- 2021Follow the Prophet: Accurate Online Conversion Rate Prediction in the Face of Delayed Feedbackcited by 5
- 2021Handling many conversions per click in modeling delayed feedbackcited by 4
- 2024Ensure Timeliness and Accuracy: A Novel Sliding Window Data Stream Paradigm for Live Streaming Recommendationcited by 4
- 2024Biased Dueling Bandits with Stochastic Delayed Feedbackcited by 3
- 2026Delayed Feedback Modeling for Post-Click Gross Merchandise Volume Prediction: Benchmark, Insights and Approachescited by 2
- 2025Personalized Interpolation: Achieving Efficient Conversion Estimation with Flexible Optimization Windowscited by 1
- 2025Delayed Feedback Modeling with Influence Functionscited by 1
- 2022Multi-Head Online Learning for Delayed Feedback Modelingcited by 0
7 more
- 2023Freshness or Accuracy, Why Not Both? Addressing Delayed Feedback via Dynamic Graph Neural Networkscited by 0
- 2025Learning Concave Bid Shading Strategies in Online Auctions via Measure-valued Proximal Optimizationcited by 0
- 2026Learning to Allocate Resources with Censored Feedbackcited by 0
- 2026Linear Convergence in Games with Delayed Feedback via Extra Predictioncited by 0
- 2026Follow the TRACE: Exploiting Post-Click Trajectories for Online Delayed Conversion Rate Predictioncited by 0
- 2026TWICE: Two-Clock, Two-Window Learning for Long-Horizon Conversion Prediction in Online Advertisingcited by 0
- 2026Multi-Objective Ranking for Live-Streaming: Balancing Fresh and Delayed Signals with Segment-Aware Targetingcited by 0
- 2026Multi-Objective Ranking for Live-Streaming: Balancing Fresh and Delayed Signals with Segment-Aware Targeting5 Aug 2026
- 2026TWICE: Two-Clock, Two-Window Learning for Long-Horizon Conversion Prediction in Online Advertising28 Jul 2026
- 2026Follow the TRACE: Exploiting Post-Click Trajectories for Online Delayed Conversion Rate Prediction25 Apr 2026
- 2026Linear Convergence in Games with Delayed Feedback via Extra Prediction19 Feb 2026
- 2026Learning to Allocate Resources with Censored Feedback6 Feb 2026
- 2026Delayed Feedback Modeling for Post-Click Gross Merchandise Volume Prediction: Benchmark, Insights and Approaches28 Jan 2026
- 2025Learning Concave Bid Shading Strategies in Online Auctions via Measure-valued Proximal Optimization12 Sep 2025
- 2025Delayed Feedback Modeling with Influence Functions1 Feb 2025
- 2025Personalized Interpolation: Achieving Efficient Conversion Estimation with Flexible Optimization Windows23 Jan 2025
- 2024Biased Dueling Bandits with Stochastic Delayed Feedback26 Aug 2024
- 2024A Short Survey on Importance Weighting for Machine Learning15 Mar 2024
- 2024Ensure Timeliness and Accuracy: A Novel Sliding Window Data Stream Paradigm for Live Streaming Recommendation22 Feb 2024
7 more
- 2023Freshness or Accuracy, Why Not Both? Addressing Delayed Feedback via Dynamic Graph Neural Networks15 Aug 2023
- 2022Generalized Delayed Feedback Model with Post-Click Information in Recommender Systems1 Jun 2022
- 2022Multi-Head Online Learning for Delayed Feedback Modeling24 May 2022
- 2022Asymptotically Unbiased Estimation for Delayed Feedback Modeling via Label Correction14 Feb 2022
- 2021Follow the Prophet: Accurate Online Conversion Rate Prediction in the Face of Delayed Feedback13 Aug 2021
- 2021Real Negatives Matter: Continuous Training with Real Negatives for Delayed Feedback Modeling29 Apr 2021
- 2021Handling many conversions per click in modeling delayed feedback6 Jan 2021
- 2021Real Negatives Matter: Continuous Training with Real Negatives for Delayed Feedback Modelingcited by 20
- 2022Asymptotically Unbiased Estimation for Delayed Feedback Modeling via Label Correctioncited by 15
- 2024A Short Survey on Importance Weighting for Machine Learningcited by 15
- 2022Generalized Delayed Feedback Model with Post-Click Information in Recommender Systemscited by 8
- 2021Follow the Prophet: Accurate Online Conversion Rate Prediction in the Face of Delayed Feedbackcited by 5
- 2021Handling many conversions per click in modeling delayed feedbackcited by 4
- 2024Ensure Timeliness and Accuracy: A Novel Sliding Window Data Stream Paradigm for Live Streaming Recommendationcited by 4
- 2024Biased Dueling Bandits with Stochastic Delayed Feedbackcited by 3
- 2026Delayed Feedback Modeling for Post-Click Gross Merchandise Volume Prediction: Benchmark, Insights and Approachescited by 2
- 2025Personalized Interpolation: Achieving Efficient Conversion Estimation with Flexible Optimization Windowscited by 1
- 2025Delayed Feedback Modeling with Influence Functionscited by 1
- 2022Multi-Head Online Learning for Delayed Feedback Modelingcited by 0
12 most cited of 19 All 19 (JSON)
- 2026Multi-Objective Ranking for Live-Streaming: Balancing Fresh and Delayed Signals with Segment-Aware Targeting5 Aug 2026
- 2026TWICE: Two-Clock, Two-Window Learning for Long-Horizon Conversion Prediction in Online Advertising28 Jul 2026
- 2026Follow the TRACE: Exploiting Post-Click Trajectories for Online Delayed Conversion Rate Prediction25 Apr 2026
- 2026Linear Convergence in Games with Delayed Feedback via Extra Prediction19 Feb 2026
- 2026Learning to Allocate Resources with Censored Feedback6 Feb 2026
- 2026Delayed Feedback Modeling for Post-Click Gross Merchandise Volume Prediction: Benchmark, Insights and Approaches28 Jan 2026
- 2025Learning Concave Bid Shading Strategies in Online Auctions via Measure-valued Proximal Optimization12 Sep 2025
- 2025Delayed Feedback Modeling with Influence Functions1 Feb 2025
- 2025Personalized Interpolation: Achieving Efficient Conversion Estimation with Flexible Optimization Windows23 Jan 2025
- 2024Biased Dueling Bandits with Stochastic Delayed Feedback26 Aug 2024
- 2024A Short Survey on Importance Weighting for Machine Learning15 Mar 2024
- 2024Ensure Timeliness and Accuracy: A Novel Sliding Window Data Stream Paradigm for Live Streaming Recommendation22 Feb 2024
12 newest of 19 All 19 (JSON)