A Systematic Post-Train Framework for Video Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
While large-scale video diffusion models have demonstrated impressive capabilities in generating high-resolution and semantically rich content, a significant gap remains between their pretraining performance and real-world deployment requirements due to critical issues such as prompt sensitivity, temporal inconsistency, and prohibitive inference costs. To bridge this gap, we propose a comprehensive post-training framework that systematically aligns pretrained models with user intentions through four synergistic stages: we first employ Supervised Fine-Tuning (SFT) to transform the base model into a stable instruction-following policy, followed by a Reinforcement Learning from Human Feedback (RLHF) stage that utilizes a novel Group Relative Policy Optimization (GRPO) method tailored for video diffusion to enhance perceptual quality and temporal coherence; subsequently, we integrate Prompt Enhancement via a specialized language model to refine user inputs, and finally address system efficiency through Inference Optimization. Together, these components provide a systematic approach to improving visual quality, temporal coherence, and instruction following, while preserving the controllability learned during pretraining. The result is a practical blueprint for building scalable post-training pipelines that are stable, adaptable, and effective in real-world deployment. Extensive experiments demonstrate that this unified pipeline effectively mitigates common artifacts and significantly improves controllability and visual aesthetics while adhering to strict sampling cost constraints.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 47 of its 51 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
47 of 51 references.
Closest ancestors · 5
Same direction, newest first
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models10 Jun
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
- 2025Improving Video Generation with Human Feedback23 Jan
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
Other references · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
30 more
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2016Professor Forcing: A New Algorithm for Training Recurrent Networkscited by 214
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 194
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 168
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 148
- 2025Seedream 3.0 Technical Reportcited by 146
- 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Modelscited by 93
- 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 88
- 2025RewardDance: Reward Scaling in Visual Generationcited by 63
- 2025Kling-Omni Technical Reportcited by 60
- 2025Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Modelcited by 59
- 2025BranchGRPO: Stable and Efficient GRPO with Structured Branching in Diffusion Modelscited by 59
- 2025Advantage Weighted Matching: Aligning RL with Pretraining in Diffusion Modelscited by 59
- 2025Coefficients-Preserving Sampling for Reinforcement Learning with Flow Matchingcited by 55
- 2025RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learningcited by 22
- 2026Astrolabe: Steering Forward-Process Reinforcement Learning for Distilled Autoregressive Video Modelscited by 15
- 2026E-GRPO: High Entropy Steps Drive Effective Reinforcement Learning for Flow Modelscited by 14
- 2026OmniForcing: Unleashing Real-time Joint Audio-Visual Generationcited by 12
- 2026PromptRL: Prompt Matters in RL for Flow-Based Image Generationcited by 11
- 2023NeuroPrompts: An Adaptive Framework to Optimize Prompts for Text-to-Image Generationcited by 10
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligencecited by 13
- 2026Do Joint Audio-Video Generation Models Understand Physics?cited by 8
- 2026Video Models Can Reason with Verifiable Rewardscited by 8
- 2026MobileWan: Closing the Quality Gap for Mobile Video Diffusioncited by 3
- 2026Scaling Reinforcement Learning for Diffusion Models via Velocity Matchingcited by 1
- 2026Scaling Reinforcement Learning for Diffusion Models via Velocity Matching24 Aug 2026
- 2026Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence8 Jul 2026
- 2026MobileWan: Closing the Quality Gap for Mobile Video Diffusion7 Jul 2026
- 2026Video Models Can Reason with Verifiable Rewards14 May 2026
- 2026Do Joint Audio-Video Generation Models Understand Physics?8 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Temporal In-Context Fine-Tuning with Temporal Reasoning for Versatile Control of Video Diffusion Models
- 2023InstructVideo: Instructing Video Diffusion Models with Human Feedback
- 2024ExVideo: Extending Video Diffusion Models via Parameter-Efficient Post-Tuning
- 2025GigaVideo-1: Advancing Video Generation via Automatic Feedback with 4 GPU-Hours Fine-Tuning
- 2025Frame Guidance: Training-Free Guidance for Frame-Level Control in Video Diffusion Models
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
- 2026Temporal Concentration from Rollout Errors: Implicit Preference Optimization for Text-to-Video Diffusion
- 2025Taming Camera-Controlled Video Generation with Verifiable Geometry Reward