mlsanityData to 14 Oct 2026

When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generators

arXiv 2506.19348 ↗First posted 24 Jun 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Training-free motion customization imposes motion patterns from reference videos onto video generators through test-time computation. Most existing methods target full diffusion models, requiring many denoising steps and high computational cost. With the rise of efficient distilled models, a natural question arises: can test-time motion customization be applied directly to distilled generators with their accelerated sampling and efficiency gains? However, our analysis reveals that existing training-free techniques fail on distilled models. Distillation fundamentally alters the denoising dynamics that prior test-time guidance relies on, and the large denoising steps of distilled generators discard the dense intermediate states that score guidance requires, rendering existing motion control strategies incompatible with fast generation. To address this limitation, we propose MotionEcho, a novel training-free test-time distillation framework that enables motion customization for distilled video generators. The key idea is to correct the student model's sampling trajectory with restricted usage of a high-quality diffusion teacher at inference time. Teacher supervises the student's denoising by re-noising the student's endpoint onto its dense trajectory to form a motion-aligned clean endpoint, then interpolating it with the student's, while an adaptive scheduling mechanism determines when and how much teacher guidance is needed. As a result, MotionEcho restores generative trajectories for distilled video generators via lightweight, adaptive test-time teacher guidance, enabling accurate motion control without compromising generation efficiency. Extensive experiments on multiple distilled video generation models demonstrate that our method significantly improves motion fidelity and visual quality while retaining the efficiency advantages of distilled generation.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 56 of its 71 references that are in the map. First posted on arXiv 24 Jun 2025.

Builds on

56 of 71 references.

References · 56

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 2022Classifier-Free Diffusion Guidancecited by 5,847
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
38 more
  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  2. 2022Video Diffusion Modelscited by 2,305
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  4. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  5. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  6. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
  7. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  9. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  10. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  11. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  12. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  13. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  14. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  15. 2023CoTracker: It is Better to Track Togethercited by 522
  16. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
  17. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
  18. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
  19. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
  20. 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
  21. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180
  22. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
  23. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  24. 2024TFG: Unified Training-Free Guidance for Diffusion Modelscited by 107
  25. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 105
  26. 2023VideoLCM: Video Latent Consistency Modelcited by 92
  27. 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 87
  28. 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Modelscited by 86
  29. 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 67
  30. 2025Learning Few-Step Diffusion Models by Trajectory Distribution Matchingcited by 57
  31. 2024FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Modelscited by 56
  32. 2023CVPR 2023 Text Guided Video Editing Competitioncited by 55
  33. 2024T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Designcited by 54
  34. 2023Control-A-Video: Controllable Text-to-Video Diffusion Models with Motion Prior and Reward Feedback Learningcited by 48
  35. 2024AnimateDiff-Lightning: Cross-Model Diffusion Distillationcited by 47
  36. 2024AnimateLCM: Computation-Efficient Personalized Style Video Generation without Personalized Video Datacited by 42
  37. 2024Video Motion Transfer with Diffusion Transformerscited by 39
  38. 2024IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generationcited by 33

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
  2. 2025Time-to-Move: Training-Free Motion Controlled Video Generation via Dual-Clock Denoising
  3. 2026Pathwise Test-Time Correction for Autoregressive Long Video Generation
  4. 2026Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweening
  5. 2026Dynamic-in-Few-Step: Unifying Dynamic Computation and Few-Step Distillation for Efficient Video Generation
  6. 2026From Static to Dynamic: On-Policy Distillation from Image to Video Diffusion Models
  7. 2026TACD: Distilling Efficient Text-to-Motion Models via Terminal Amplification Control
  8. 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling