Generative Regression Based Watch Time Prediction for Short-Video Recommendation
Not on the map. Why?
Abstract (arXiv)
Watch time prediction (WTP) has emerged as a pivotal task in short video recommendation systems, designed to quantify user engagement through continuous interaction modeling. Predicting users' watch times on videos often encounters fundamental challenges, including wide value ranges and imbalanced data distributions, which can lead to significant estimation bias when directly applying regression techniques. Recent studies have attempted to address these issues by converting the continuous watch time estimation into an ordinal regression task. While these methods demonstrate partial effectiveness, they exhibit notable limitations: (1) the discretization process frequently relies on bucket partitioning, inherently reducing prediction flexibility and accuracy and (2) the interdependencies among different partition intervals remain underutilized, missing opportunities for effective error correction. Inspired by language modeling paradigms, we propose a novel Generative Regression (GR) framework that reformulates WTP as a sequence generation task. Our approach employs textitstructural discretization to enable nearly lossless value reconstruction while maintaining prediction fidelity. Through carefully designed vocabulary construction and label encoding schemes, each watch time is bijectively mapped to a token sequence. To mitigate the training-inference discrepancy caused by teacher-forcing, we introduce a textitcurriculum learning with embedding mixup strategy that gradually transitions from guided to free-generation modes. We evaluate our method against state-of-the-art approaches on two public datasets and one industrial dataset. We also perform online A/B testing on the Kuaishou App to confirm the real-world effectiveness. The results conclusively show that GR outperforms existing techniques significantly.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 24 of its 59 references that are in the map. First posted on arXiv 28 Dec 2024.
Builds on
24 of 59 references.
References · 24
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2018Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Ratecited by 173
- 2022KuaiRec: A Fully-observed Dataset and Insights for Evaluating Recommender Systemscited by 96
- 2022KuaiRand: An Unbiased Sequential Recommendation Dataset with Randomly Exposed Videoscited by 72
12 more
- 2022Deconfounding Duration Bias in Watch-time Prediction for Video Recommendationcited by 37
- 2022Real-time Short Video Recommendation on Mobile Devicescited by 21
- 2021Concept-Aware Denoising Graph Neural Network for Micro-Video Recommendationcited by 18
- 2023Tree based Progressive Regression Model for Watch-Time Prediction in Short-video Recommendationcited by 18
- 2022Billion-user Customer Lifetime Value Prediction: An Industrial-scale Solution from Kuaishoucited by 17
- 2024CREAD: A Classification-Restoration Framework with Error Adaptive Discretization for Watch Time Prediction in Video Recommender Systemscited by 14
- 2022DVR: Micro-Video Recommendation Optimizing Watch-Time-Gain under Duration Biascited by 13
- 2020TeaForN: Teacher-Forcing with N-gramscited by 9
- 2024Counteracting Duration Bias in Video Recommendation via Counterfactual Watch Timecited by 8
- 2024OptDist: Learning Optimal Distribution for Customer Lifetime Value Predictioncited by 8
- 2023Leveraging Watch-time Feedback for Short-Video Recommendations: A Causal Labeling Frameworkcited by 6
- 2024SWaT: Statistical Modeling of Video Watch Time through User Behavior Analysiscited by 5
Built on by
Citing papers per year: 2025: 3; 2026: 10.
13 papers.
Sort:
By area:
- 2025HSSBench: Benchmarking Humanities and Social Sciences Ability for Multimodal Large Language Modelscited by 17
- 2025Fine-Grained Zero-Shot Object Detectioncited by 8
- 2026RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformercited by 3
- 2026RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systemscited by 3
- 2026RL-ScanIQA: Reinforcement-Learned Scanpaths for Blind 360degImage Quality Assessmentcited by 2
- 2025Generative Bid Shading in Real-Time Bidding Advertisingcited by 1
- 2026RQ-Reg: A Residual-Quantization-Based Framework for Continuous Value Prediction in Recommender Systemscited by 1
- 2026DiffoR: A Unified Continuous Generative Framework for Universal Ordinal Regressioncited by 1
- 2026Hierarchical Exponential-Gaussian Mixtures for Watch-Time Distribution Predictioncited by 1
- 2026Learnable Instance Attention Filtering for Adaptive Detector Distillationcited by 0
- 2026FlowTime: Towards Continuous Generative Watch Time Prediction via Flow-based Personalized Priorscited by 0
- 2026PIT-SUN: A Deployable Empirical Marginal Transform Framework with Expectation-Consistent Recovery for Regression in Recommender Systemscited by 0
- 2026Hierarchical Exponential-Gaussian Mixtures for Watch-Time Distribution Prediction24 Aug 2026
- 2026Generative Optimization for Incentivized Advertising with Global Level Constraints5 Aug 2026
- 2026RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems31 Jul 2026
- 2026PIT-SUN: A Deployable Empirical Marginal Transform Framework with Expectation-Consistent Recovery for Regression in Recommender Systems9 Jul 2026
- 2026FlowTime: Towards Continuous Generative Watch Time Prediction via Flow-based Personalized Priors31 May 2026
- 2026DiffoR: A Unified Continuous Generative Framework for Universal Ordinal Regression29 May 2026
- 2026Learnable Instance Attention Filtering for Adaptive Detector Distillation27 Mar 2026
- 2026RL-ScanIQA: Reinforcement-Learned Scanpaths for Blind 360degImage Quality Assessment15 Mar 2026
- 2026RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformer15 Mar 2026
- 2026RQ-Reg: A Residual-Quantization-Based Framework for Continuous Value Prediction in Recommender Systems26 Feb 2026
- 2025Generative Bid Shading in Real-Time Bidding Advertising6 Aug 2025
- 2025Fine-Grained Zero-Shot Object Detection14 Jul 2025
- 2025Fine-Grained Zero-Shot Object Detectioncited by 8
- 2026RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformercited by 3
- 2026RL-ScanIQA: Reinforcement-Learned Scanpaths for Blind 360degImage Quality Assessmentcited by 2
- 2025Generative Bid Shading in Real-Time Bidding Advertisingcited by 1
- 2026RQ-Reg: A Residual-Quantization-Based Framework for Continuous Value Prediction in Recommender Systemscited by 1
- 2026DiffoR: A Unified Continuous Generative Framework for Universal Ordinal Regressioncited by 1
- 2026Hierarchical Exponential-Gaussian Mixtures for Watch-Time Distribution Predictioncited by 1
- 2026FlowTime: Towards Continuous Generative Watch Time Prediction via Flow-based Personalized Priorscited by 0
- 2026PIT-SUN: A Deployable Empirical Marginal Transform Framework with Expectation-Consistent Recovery for Regression in Recommender Systemscited by 0
- 2026Generative Optimization for Incentivized Advertising with Global Level Constraintscited by 0
- 2026Hierarchical Exponential-Gaussian Mixtures for Watch-Time Distribution Prediction24 Aug 2026
- 2026Generative Optimization for Incentivized Advertising with Global Level Constraints5 Aug 2026
- 2026PIT-SUN: A Deployable Empirical Marginal Transform Framework with Expectation-Consistent Recovery for Regression in Recommender Systems9 Jul 2026
- 2026FlowTime: Towards Continuous Generative Watch Time Prediction via Flow-based Personalized Priors31 May 2026
- 2026DiffoR: A Unified Continuous Generative Framework for Universal Ordinal Regression29 May 2026
- 2026RL-ScanIQA: Reinforcement-Learned Scanpaths for Blind 360degImage Quality Assessment15 Mar 2026
- 2026RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformer15 Mar 2026
- 2026RQ-Reg: A Residual-Quantization-Based Framework for Continuous Value Prediction in Recommender Systems26 Feb 2026
- 2025Generative Bid Shading in Real-Time Bidding Advertising6 Aug 2025
- 2025Fine-Grained Zero-Shot Object Detection14 Jul 2025