mlsanityData to 7 Oct 2026

A Systematic Post-Train Framework for Video Generation

arXiv 2604.25427 ↗First posted 28 Apr 2026cs.CVcited by 5

On the map: Diffusion models → Video generation

Abstract (arXiv)

While large-scale video diffusion models have demonstrated impressive capabilities in generating high-resolution and semantically rich content, a significant gap remains between their pretraining performance and real-world deployment requirements due to critical issues such as prompt sensitivity, temporal inconsistency, and prohibitive inference costs. To bridge this gap, we propose a comprehensive post-training framework that systematically aligns pretrained models with user intentions through four synergistic stages: we first employ Supervised Fine-Tuning (SFT) to transform the base model into a stable instruction-following policy, followed by a Reinforcement Learning from Human Feedback (RLHF) stage that utilizes a novel Group Relative Policy Optimization (GRPO) method tailored for video diffusion to enhance perceptual quality and temporal coherence; subsequently, we integrate Prompt Enhancement via a specialized language model to refine user inputs, and finally address system efficiency through Inference Optimization. Together, these components provide a systematic approach to improving visual quality, temporal coherence, and instruction following, while preserving the controllability learned during pretraining. The result is a practical blueprint for building scalable post-training pipelines that are stable, adaptable, and effective in real-world deployment. Extensive experiments demonstrate that this unified pipeline effectively mitigates common artifacts and significantly improves controllability and visual aesthetics while adhering to strict sampling cost constraints.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 47 of its 51 references that are in the map. First posted on arXiv 28 Apr 2026.

Builds on

47 of 51 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb
  2. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models10 Jun
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
  4. 2025Improving Video Generation with Human Feedback23 Jan
  5. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec

Other references · 42

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2022Flow Matching for Generative Modelingcited by 5,426
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  8. 2025Qwen3-VL Technical Reportcited by 2,534
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  10. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  11. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  12. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
30 more
  1. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  2. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  3. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  4. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  5. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
  6. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
  7. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
  8. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  9. 2016Professor Forcing: A New Algorithm for Training Recurrent Networkscited by 214
  10. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
  11. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
  12. 2025Unified Reward Model for Multimodal Understanding and Generationcited by 194
  13. 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
  14. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 168
  15. 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 148
  16. 2025Seedream 3.0 Technical Reportcited by 146
  17. 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Modelscited by 93
  18. 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 88
  19. 2025RewardDance: Reward Scaling in Visual Generationcited by 63
  20. 2025Kling-Omni Technical Reportcited by 60
  21. 2025Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Modelcited by 59
  22. 2025BranchGRPO: Stable and Efficient GRPO with Structured Branching in Diffusion Modelscited by 59
  23. 2025Advantage Weighted Matching: Aligning RL with Pretraining in Diffusion Modelscited by 59
  24. 2025Coefficients-Preserving Sampling for Reinforcement Learning with Flow Matchingcited by 55
  25. 2025RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learningcited by 22
  26. 2026Astrolabe: Steering Forward-Process Reinforcement Learning for Distilled Autoregressive Video Modelscited by 15
  27. 2026E-GRPO: High Entropy Steps Drive Effective Reinforcement Learning for Flow Modelscited by 14
  28. 2026OmniForcing: Unleashing Real-time Joint Audio-Visual Generationcited by 12
  29. 2026PromptRL: Prompt Matters in RL for Flow-Based Image Generationcited by 11
  30. 2023NeuroPrompts: An Adaptive Framework to Optimize Prompts for Text-to-Image Generationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Temporal In-Context Fine-Tuning with Temporal Reasoning for Versatile Control of Video Diffusion Models
  2. 2023InstructVideo: Instructing Video Diffusion Models with Human Feedback
  3. 2024ExVideo: Extending Video Diffusion Models via Parameter-Efficient Post-Tuning
  4. 2025GigaVideo-1: Advancing Video Generation via Automatic Feedback with 4 GPU-Hours Fine-Tuning
  5. 2025Frame Guidance: Training-Free Guidance for Frame-Level Control in Video Diffusion Models
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
  7. 2026Temporal Concentration from Rollout Errors: Implicit Preference Optimization for Text-to-Video Diffusion
  8. 2025Taming Camera-Controlled Video Generation with Verifiable Geometry Reward