# Real-time Short Video Recommendation on Mobile Devices

arXiv: https://arxiv.org/abs/2208.09577 · HTML: https://mlsanity.com/paper/2208.09577/

## Key facts

- Cited by 21 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Aug 2022.

## Built on by (most cited first, 21 of 21)

- [Non-autoregressive Generative Models for Reranking Recommendation](https://mlsanity.com/paper/2402.06871/) (2024)
- [Two-Stage Constrained Actor-Critic for Short Video Recommendation](https://mlsanity.com/paper/2302.01680/) (2023)
- [Reinforcing User Retention in a Billion Scale Short Video Recommender System](https://mlsanity.com/paper/2302.01724/) (2023)
- [Generative Regression Based Watch Time Prediction for Short-Video Recommendation](https://mlsanity.com/paper/2412.20211/) (2024)
- [PIER: Permutation-Level Interest-Based End-to-End Re-ranking Framework in E-commerce](https://mlsanity.com/paper/2302.03487/) (2023)
- [GReF: A Unified Generative Framework for Efficient Reranking via Ordered Multi-token Prediction](https://mlsanity.com/paper/2510.25220/) (2025)
- [ESMC: Entire Space Multi-Task Model for Post-Click Conversion Rate via Parameter Constraint](https://mlsanity.com/paper/2307.09193/) (2023)
- [Efficient Personalized Reranking with Semi-Autoregressive Generation and Online Knowledge Distillation](https://mlsanity.com/paper/2603.07107/) (2026)
- [Advancing Re-Ranking with Multimodal Fusion and Target-Oriented Auxiliary Tasks in E-Commerce Search](https://mlsanity.com/paper/2408.05751/) (2024)
- [On-device Content-based Recommendation with Single-shot Embedding Pruning: A Cooperative Game Perspective](https://mlsanity.com/paper/2411.13052/) (2024)
- [Collaborative Learning of On-Device Small Model and Cloud-Based Large Model: Advances and Future Directions](https://mlsanity.com/paper/2504.15300/) (2025)
- [Describe What You See with Multimodal Large Language Models to Enhance Video Recommendations](https://mlsanity.com/paper/2508.09789/) (2025)
- [Mobile Supply: The Last Piece of Jigsaw of Recommender System](https://mlsanity.com/paper/2308.03855/) (2023)
- [Impression-Aware Recommender Systems](https://mlsanity.com/paper/2308.07857/) (2023)
- [Long-term User Engagement Optimization through Model-agnostic Downstream Rewards Learning](https://mlsanity.com/paper/2607.14192/) (2026)
- [DiTMoS: Delving into Diverse Tiny-Model Selection on Microcontrollers](https://mlsanity.com/paper/2403.09035/) (2024)
- [CHORD: Customizing Hybrid-precision On-device Model for Sequential Recommendation with Device-cloud Collaboration](https://mlsanity.com/paper/2510.03038/) (2025)
- [Compressed Video Aggregator: Content-driven Module for Efficient Micro-Video Recommendation](https://mlsanity.com/paper/2605.08810/) (2026)
- [DeGRe: Dense-supervised Generative Reranking for Recommendation](https://mlsanity.com/paper/2605.25749/) (2026)
- [FlowTime: Towards Continuous Generative Watch Time Prediction via Flow-based Personalized Priors](https://mlsanity.com/paper/2606.01352/) (2026)
- [Denoising Implicit Feedback for Cold-start Recommendation](https://mlsanity.com/paper/2606.19658/) (2026)

## Abstract (arXiv)

Short video applications have attracted billions of users in recent years, fulfilling their various needs with diverse content. Users usually watch short videos on many topics on mobile devices in a short period of time, and give explicit or implicit feedback very quickly to the short videos they watch. The recommender system needs to perceive users' preferences in real-time in order to satisfy their changing interests. Traditionally, recommender systems deployed at server side return a ranked list of videos for each request from client. Thus it cannot adjust the recommendation results according to the user's real-time feedback before the next request. Due to client-server transmitting latency, it is also unable to make immediate use of users' real-time feedback. However, as users continue to watch videos and feedback, the changing context leads the ranking of the server-side recommendation system inaccurate. In this paper, we propose to deploy a short video recommendation framework on mobile devices to solve these problems. Specifically, we design and deploy a tiny on-device ranking model to enable real-time re-ranking of server-side recommendation results. We improve its prediction accuracy by exploiting users' real-time feedback of watched videos and client-specific real-time features. With more accurate predictions, we further consider interactions among candidate videos, and propose a context-aware re-ranking method based on adaptive beam search. The framework has been deployed on Kuaishou, a billion-user scale short video application, and improved effective view, like and follow by 1.28%, 8.22% and 13.6% respectively.
