mlsanityData to 14 Oct 2026

HPSD: Hybrid-Policy Self-Distillation for Text-Image-to-Video Diffusion Models

arXiv 2608.13205 ↗First posted 13 Aug 2026cs.CVcited by 1

On the map: Diffusion models → Video generation

Abstract (arXiv)

Text-Image-to-Video (TI2V) models are an emerging unified architecture, where a single model simultaneously supports text-to-video (T2V) and image-to-video (I2V) generation. Given a high-quality first frame or a detailed textual prompt, TI2V models unlock substantially better visual quality than their T2V mode, raising a natural question: can the capability elicited by such privileged conditions be internalized into the model's own base generation ability? A common approach toward this goal is model self-distillation. However, the most straightforward solution, supervised fine-tuning, follows an off-policy strategy: its supervision is confined to teacher-generated endpoints from a fixed offline distribution rather than student-visited states, lacking precise correction tailored to the evolving policy. Recent on-policy distillation methods instead suffer from condition-state mismatch, where supervision is steered toward the given first frame instead of the student's actual content, misleading the correction. To achieve self-distillation that absorbs the teacher's privileged prior while retaining precise policy correction, in this work, we propose Hybrid-Policy Self-Distillation (HPSD), a novel self-distillation framework where a single TI2V model acts as both teacher and student under different conditions: the teacher operates in TI2V mode with a high-quality first frame and an enhanced prompt, while the student runs in the base T2V mode with only the vanilla prompt. Specifically, the student inherits off-policy teacher trajectory points as anchors, locally refines them toward its own policy, and finally receives velocity-level supervision on these self-generated roll-outs. Extensive experiments demonstrate that HPSD significantly improves T2V performance while also delivering notable TI2V gains, effectively strengthening the model's base generation ability.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 56 of its 60 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

56 of 60 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators9 Jul
  2. 2025Improving Video Generation with Human Feedback23 Jan
  3. 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
  4. 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  7. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models7 Nov
  8. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul

Other references · 47

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2022Flow Matching for Generative Modelingcited by 5,702
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  12. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
35 more
  1. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
  2. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  3. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  4. 2023Adversarial Diffusion Distillationcited by 759
  5. 2022On Distillation of Guided Diffusion Modelscited by 725
  6. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  7. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  8. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  9. 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 455
  10. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
  11. 2026Self-Distillation Enables Continual Learningcited by 247
  12. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
  13. 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
  14. 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
  15. 2026A Survey of On-Policy Distillation for Large Language Modelscited by 163
  16. 2025HunyuanVideo 1.5 Technical Reportcited by 160
  17. 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 156
  18. 2026Self-Distilled RLVRcited by 131
  19. 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Thinkcited by 102
  20. 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 92
  21. 2026Self-Distillation Zero: Self-Revision Turns Binary Rewards into Dense Supervisioncited by 68
  22. 2025Learning Few-Step Diffusion Models by Trajectory Distribution Matchingcited by 57
  23. 2025No Other Representation Component Is Needed: Diffusion Transformers Can Provide Representation Guidance by Themselvescited by 56
  24. 2026Stable On-Policy Distillation through Adaptive Target Reformulationcited by 53
  25. 2024TinyFusion: Diffusion Transformers Learned Shallowcited by 45
  26. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 43
  27. 2026DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Modelscited by 40
  28. 2025Light-A-Video: Training-free Video Relighting via Progressive Light Fusioncited by 39
  29. 2026Flow-OPD: On-Policy Distillation for Flow Matching Modelscited by 34
  30. 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 30
  31. 2024STIV: Scalable Text and Image Conditioned Video Generationcited by 25
  32. 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Modelscited by 22
  33. 2026Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligencecited by 15
  34. 2026DanceOPD: On-Policy Generative Field Distillationcited by 14
  35. 2024ByTheWay: Boost Your Text-to-Video Generation Model to Higher Quality in a Training-free Waycited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Static to Dynamic: On-Policy Distillation from Image to Video Diffusion Models
  2. 2026STEP-OPD: Rethinking Output Targets and Internal Dynamics in On-Policy Distillation for Diffusion Models
  3. 2025V.I.P. : Iterative Online Preference Distillation for Efficient Video Diffusion Models
  4. 2026Simplifying and Improving On-Policy Distillation for Few-Step Diffusion
  5. 2026Visual Contrastive Self-Distillation
  6. 2026Image-to-Video Diffusion: From Foundations to Open Frontiers
  7. 2025Refining Few-Step Text-to-Multiview Diffusion via Reinforcement Learning
  8. 2024TI2V-Zero: Zero-Shot Image Conditioning for Text-to-Video Diffusion Models