mlsanityData to 14 Oct 2026

Uncertainty Modeling for Multi-Objective RTA Interception with Distillation Acceleration

arXiv 2511.05582 ↗First posted 5 Nov 2025cs.LG cs.GTcited by 0

Not on the map. Why?

Abstract (arXiv)

Real-Time Auction (RTA) interception decides which incoming advertising requests reach downstream systems, and therefore controls the quality of the data those systems learn from. At JD.com, off-site advertising produces on the order of hundreds of billions of requests per day, and the RTA channel alone serves up to hundreds of millions of requests per minute. Filtering low-quality and fraudulent traffic at this scale requires estimating each request's value with calibrated confidence, which we treat as an uncertainty modeling problem. Two obstacles stand in the way. First, advertising labels are severely imbalanced: deals are rare, and we show both analytically and empirically that standard weight-based uncertainty degrades under such sparsity, collapsing onto predicted probability and adding no signal. Second, methods such as SWAG and Bayesian neural networks require multiple stochastic forward passes per request, making full-traffic scoring prohibitively expensive. We address both problems with UMDA, a multi-objective framework that shares uncertainty across funnel-correlated objectives, using the reliable uncertainty of a balanced metric to compensate for the degenerate uncertainty of sparse ones. We then distill the multi-pass teacher into a single-pass student that reproduces both aleatoric and epistemic uncertainty at roughly one-tenth of the inference cost. On JD e-commerce dataset and the public Criteo dataset, UMDA supplies more effective samples to downstream tasks, and the distilled student preserves this capability. In production, it scores the full traffic in a near-line pipeline that feeds an hourly blacklist for online interception; a seven-day A/B test on 5% of live traffic cuts the click fraud rate by 3.59% and raises CVR by 4.01% at a matched interception ratio while leaving converted users essentially unchanged, and the model has since been deployed to full traffic.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 32 references that are in the map. First posted on arXiv 5 Nov 2025.

Builds on

19 of 32 references.

References · 19

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  3. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
  4. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
  5. 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 732
  6. 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 560
  7. 2018End-to-End Multi-Task Learning with Attentioncited by 534
  8. 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
  9. 2018Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Ratecited by 173
  10. 2020Embedding-based Retrieval in Facebook Searchcited by 156
  11. 2018Billion-scale Commodity Embedding for E-commerce Recommendation in Alibabacited by 105
  12. 2021Embedding-based Product Retrieval in Taobao Searchcited by 51
7 more
  1. 2021Modeling the Sequential Dependence among Audience Multi-step Conversions with Multi-task Learning in Targeted Display Advertisingcited by 39
  2. 2022MetaBalance: Improving Multi-Task Recommendations via Adapting Gradient Magnitudes of Auxiliary Taskscited by 34
  3. 2022Uncertainty-Aware Learning Against Label Noise on Imbalanced Datasetscited by 28
  4. 2021AutoMTL: A Programming Framework for Automating Efficient Multi-Task Learningcited by 17
  5. 2022UKD: Debiasing Conversion Rate Estimation via Uncertainty-regularized Knowledge Distillationcited by 14
  6. 2021Mixture of Virtual-Kernel Experts for Multi-Objective User Profile Modelingcited by 5
  7. 2025Efficient Multi-Task Learning via Generalist Recommendercited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Auto-bidding in real-time auctions via Oracle Imitation Learning (OIL)
  2. 2025RTBAgent: A LLM-based Agent System for Real-Time Bidding
  3. 2026AHBid: An Adaptable Hierarchical Bidding Framework for Cross-Channel Advertising
  4. 2020Optimal Bidding Strategy without Exploration in Real-time Bidding
  5. 2024AIGB: Generative Auto-bidding via Conditional Diffusion Modeling
  6. 2026HOBA: Hierarchical On-Policy Bidding Agents for Adaptive Online Advertising
  7. 2025Lightweight Auto-bidding based on Traffic Prediction in Live Advertising
  8. 2026DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation