Action-Aware Generative Sequence Modeling for Short Video Recommendation
Not on the map. Why?
Abstract (arXiv)
With the rapid development of the Internet, users have increasingly higher expectations for the recommendation accuracy of online content consumption platforms. However, short videos often contain diverse segments, and users may not hold the same attitude toward all of them. Traditional binary-classification recommendation models, which treat a video as a single holistic entity, face limitations in accurately capturing such nuanced preferences. Considering that user consumption is a temporal process, this paper demonstrates that the timing of user actions can represent diverse intentions through statistical analysis and examination of action patterns. Based on this insight, we propose a novel modeling paradigm: Action-Aware Generative Sequence Network (A2Gen), which refines user actions along the temporal dimension and chains them into sequences for unified processing and prediction. First, we introduce the Context-aware Attention Module (CAM) to model action sequences enriched with item-specific contextual features. Building upon this, we develop the Hierarchical Sequence Encoder (HSE) to learn temporal action patterns from users' historical actions. Finally, through leveraging CAM, we design a module for action sequence generation: the Action-seq Autoregressive Generator (AAG). Extensive offline experiments on the Kuaishou's dataset and the Tmall public dataset demonstrate the superiority of our proposed model. Furthermore, through large-scale online A/B testing deployed on Kuaishou's platform, our model achieves significant improvements over baseline methods in multi-task prediction by leveraging sequential information. Specifically, it yields increases of 0.34% in user watch time, 8.1% in interaction rate, and 0.162% in overall user retention (LifeTime-7), leading to successful deployment across all traffic, serving over 400 million users every day.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 45 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
26 of 45 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2023Large Language Modelscited by 774
- 2017Deep Interest Network for Click-Through Rate Predictioncited by 541
- 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 336
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
- 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
- 2017Deep Learning based Recommender System: A Survey and New Perspectivescited by 136
- 2019Behavior Sequence Transformer for E-commerce Recommendation in Alibabacited by 128
- 2023Diffusion Recommender Modelcited by 87
- 2021One Model to Serve All: Star Topology Adaptive Recommender for Multi-Domain CTR Predictioncited by 78
- 2023Generative Recommendation: Towards Next-generation Recommender Paradigmcited by 69
- 2019Deep Session Interest Network for Click-Through Rate Predictioncited by 64
14 more
- 2023Collaborative Large Language Model for Recommender Systemscited by 63
- 2023PEPNet: Parameter and Embedding Personalized Network for Infusing with Personalized Prior Informationcited by 60
- 2024A Review of Modern Recommender Systems Using Generative Models (Gen-RecSys)cited by 58
- 2022MetaBalance: Improving Multi-Task Recommendations via Adapting Gradient Magnitudes of Auxiliary Taskscited by 34
- 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Frameworkcited by 32
- 2022AdaTask: A Task-aware Adaptive Learning Rate Approach to Multi-task Learningcited by 31
- 2023Multi-Task Deep Recommender Systems: A Surveycited by 29
- 2024Integrating Large Language Models into Recommendation via Mutual Augmentation and Adaptive Aggregationcited by 26
- 2024A Survey on Diffusion Models for Recommender Systemscited by 20
- 2023STEM: Unleashing the Power of Embeddings for Multi-task Recommendationcited by 19
- 2024HoME: Hierarchy of Multi-Gate Experts for Multi-Task Learning at Kuaishoucited by 16
- 2014Large Scale Purchase Prediction with Historical User Actions on B2C Online Retail Platformcited by 6
- 2024ADSNet: Cross-Domain LTV Prediction with an Adaptive Siamese Network in Advertisingcited by 4
- 2024Scene-wise Adaptive Network for Dynamic Cold-start Scenes Optimization in CTR Predictioncited by 4
Built on by
Not cited yet.