# Research on Short-Video Platform User Decision-Making via Multimodal Temporal Modeling and Reinforcement Learning

arXiv: https://arxiv.org/abs/2509.12269 · HTML: https://mlsanity.com/paper/2509.12269/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Placed in Deep RL algorithms and representations, one of 15 directions in Deep reinforcement learning methods.
- Builds on 38 of its 112 references that are in the map.
- First posted on arXiv 13 Sep 2025.

## Placed in

- Deep reinforcement learning methods / [Deep RL algorithms and representations](https://mlsanity.com/deeprl/deep-rl-algorithms-and-representations/)

## Builds on (most cited first, 30 of 38)

- [YouTube-8M: A Large-Scale Video Classification Benchmark](https://mlsanity.com/paper/1609.08675/) (2016)
- [Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks](https://mlsanity.com/paper/2110.03655/) (2021)
- [Transformer-based Multimodal Information Fusion for Facial Expression Analysis](https://mlsanity.com/paper/2203.12367/) (2022)
- [Multimodal Engagement Analysis from Facial Videos in the Classroom](https://mlsanity.com/paper/2101.04215/) (2021)
- [Deep Learning-based Anomaly Detection and Log Analysis for Computer Networks](https://mlsanity.com/paper/2407.05639/) (2024)
- [Automatic News Generation and Fact-Checking System Based on Language Processing](https://mlsanity.com/paper/2405.10492/) (2024)
- [Theoretical Analysis of Meta Reinforcement Learning: Generalization Bounds and Convergence Guarantees](https://mlsanity.com/paper/2405.13290/) (2024)
- [Multi-Behavior Sequential Recommendation with Temporal Graph Transformer](https://mlsanity.com/paper/2206.02687/) (2022)
- [Image anomaly detection and prediction scheme based on SSA optimized ResNet50-BiGRU model](https://mlsanity.com/paper/2406.13987/) (2024)
- [Enhancing Visual Question Answering through Ranking-Based Hybrid Training and Multimodal Fusion](https://mlsanity.com/paper/2408.07303/) (2024)
- [The Design of Autonomous UAV Prototypes for Inspecting Tunnel Construction Environment](https://mlsanity.com/paper/2408.07286/) (2024)
- [User Retention-oriented Recommendation with Decision Transformer](https://mlsanity.com/paper/2303.06347/) (2023)
- [Trajectory Prediction Meets Large Language Models: A Survey](https://mlsanity.com/paper/2506.03408/) (2025)
- [Cross-border Commodity Pricing Strategy Optimization via Mixed Neural Network for Time Series Analysis](https://mlsanity.com/paper/2408.12115/) (2024)
- [Weibo-COV: A Large-Scale COVID-19 Social Media Dataset from Weibo](https://mlsanity.com/paper/2005.09174/) (2020)
- [Deep Analysis of Time Series Data for Smart Grid Startup Strategies: A Transformer-LSTM-PSO Model Approach](https://mlsanity.com/paper/2408.12129/) (2024)
- [Recording Brain Activity While Listening to Music Using Wearable EEG Devices Combined with Bidirectional Long Short-Term Memory Networks](https://mlsanity.com/paper/2408.12124/) (2024)
- [EITNet: An IoT-Enhanced Framework for Real-Time Basketball Action Recognition](https://mlsanity.com/paper/2410.09954/) (2024)
- [Real-time Monitoring of Lower Limb Movement Resistance Based on Deep Learning](https://mlsanity.com/paper/2410.19769/) (2024)
- [LTPNet Integration of Deep Learning and Environmental Decision Support Systems for Renewable Energy Demand Forecasting](https://mlsanity.com/paper/2410.15286/) (2024)
- [Real-time Monitoring and Analysis of Track and Field Athletes Based on Edge Computing and Deep Reinforcement Learning Algorithm](https://mlsanity.com/paper/2411.06720/) (2024)
- [IoT-Based 3D Pose Estimation and Motion Optimization for Athletes: Application of C3D and OpenPose](https://mlsanity.com/paper/2411.12676/) (2024)
- [TRIZ Method for Urban Building Energy Optimization: GWO-SARIMA-LSTM Forecasting model](https://mlsanity.com/paper/2410.15283/) (2024)
- [GTA-Net: An IoT-Integrated 3D Human Pose Estimation System for Real-Time Adolescent Sports Posture Correction](https://mlsanity.com/paper/2411.06725/) (2024)
- [Optimized CNNs for Rapid 3D Point Cloud Object Recognition](https://mlsanity.com/paper/2412.02855/) (2024)
- [Electronic Health Records-Based Data-Driven Diabetes Knowledge Unveiling and Risk Prognosis](https://mlsanity.com/paper/2412.03961/) (2024)
- [Temporal-Aware Evaluation and Learning for Temporal Graph Neural Networks](https://mlsanity.com/paper/2412.07273/) (2024)
- [PLoc: A New Evaluation Criterion Based on Physical Location for Autonomous Driving Datasets](https://mlsanity.com/paper/2403.19893/) (2024)
- [Unsupervised Search for Ethnic Minorities' Medical Segmentation Training Set](https://mlsanity.com/paper/2501.02442/) (2025)
- [Intelligent logistics management robot path planning algorithm integrating transformer and GCN network](https://mlsanity.com/paper/2501.02749/) (2025)

## Abstract (arXiv)

This paper proposes the MT-DQN model, which integrates a Transformer, Temporal Graph Neural Network (TGNN), and Deep Q-Network (DQN) to address the challenges of predicting user behavior and optimizing recommendation strategies in short-video environments. Experiments demonstrated that MT-DQN consistently outperforms traditional concatenated models, such as Concat-Modal, achieving an average F1-score improvement of 10.97% and an average NDCG@5 improvement of 8.3%. Compared to the classic reinforcement learning model Vanilla-DQN, MT-DQN reduces MSE by 34.8% and MAE by 26.5%. Nonetheless, we also recognize challenges in deploying MT-DQN in real-world scenarios, such as its computational cost and latency sensitivity during online inference, which will be addressed through future architectural optimization.