PIT-SUN: A Deployable Empirical Marginal Transform Framework with Expectation-Consistent Recovery for Regression in Recommender Systems
Not on the map. Why?
Abstract (arXiv)
Estimating original-space conditional expectations is central to value-driven recommender systems, including dwell time, GMV, and LTV forecasting. Standard MSE is expectation-consistent in principle, but its gradients become unstable on heavy-tailed, zero-inflated, and multimodal targets, causing mean collapse and tail shrinkage. Target transformation alleviates this scale conflict, yet any useful nonlinear marginal transform loses expectation consistency under direct inversion. This is not an implementation oversight: a direct inverse-transform estimator is universally expectation-consistent only when the inverse transform is affine, which cannot simultaneously provide bounded tail compression. Existing conditionally linear recovery methods restore expectation consistency, but still leave open which coordinate, inverse lookup, recovery base, and deployment monitor should be selected for sparse complex marginals. We propose Probability-Integral-TranSformed Unbiased recovery (PIT-SUN), a deployable empirical marginal recovery framework. PIT-SUN uses one empirical marginal table to define a bounded normal-score coordinate, its inverse-quantile lookup, a variance-controlled recovery base, and drift monitoring, then applies multiplicative SUN recovery to estimate the original-space expectation instead of directly inverting transformed predictions. Experiments on synthetic distributions, public benchmarks, large-scale industrial datasets, and online deployment show robust improvements in point accuracy, calibration, and ranking quality with lightweight deployment overhead.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 28 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
12 of 28 references.
References · 12
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2022Deconfounding Duration Bias in Watch-time Prediction for Video Recommendationcited by 37
- 2023Tree based Progressive Regression Model for Watch-Time Prediction in Short-video Recommendationcited by 18
- 2022Billion-user Customer Lifetime Value Prediction: An Industrial-scale Solution from Kuaishoucited by 17
- 2024CREAD: A Classification-Restoration Framework with Error Adaptive Discretization for Watch Time Prediction in Video Recommender Systemscited by 14
- 2024Generative Regression Based Watch Time Prediction for Short-Video Recommendationcited by 13
- 2024OptDist: Learning Optimal Distribution for Customer Lifetime Value Predictioncited by 8
- 2024Conditional Quantile Estimation for Uncertain Watch Time in Short-Video Recommendationcited by 6
- 2025AlignPxtr: Aligning Predicted Behavior Distributions for Bias-Free Video Recommendationscited by 4
- 2025TranSUN: A Preemptive Paradigm to Eradicate Retransformation Bias Intrinsically from Regression Models in Recommender Systemscited by 4
- 2025Relative Advantage Debiasing for Watch-Time Prediction in Short-Video Recommendationcited by 4
- 2026CC-OR-Net: A Unified Framework for LTV Prediction through Structural Decouplingcited by 1
Built on by
Not cited yet.