When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generators
Not on the map. Why?
Abstract (arXiv)
Training-free motion customization imposes motion patterns from reference videos onto video generators through test-time computation. Most existing methods target full diffusion models, requiring many denoising steps and high computational cost. With the rise of efficient distilled models, a natural question arises: can test-time motion customization be applied directly to distilled generators with their accelerated sampling and efficiency gains? However, our analysis reveals that existing training-free techniques fail on distilled models. Distillation fundamentally alters the denoising dynamics that prior test-time guidance relies on, and the large denoising steps of distilled generators discard the dense intermediate states that score guidance requires, rendering existing motion control strategies incompatible with fast generation. To address this limitation, we propose MotionEcho, a novel training-free test-time distillation framework that enables motion customization for distilled video generators. The key idea is to correct the student model's sampling trajectory with restricted usage of a high-quality diffusion teacher at inference time. Teacher supervises the student's denoising by re-noising the student's endpoint onto its dense trajectory to form a motion-aligned clean endpoint, then interpolating it with the student's, while an adaptive scheduling mechanism determines when and how much teacher guidance is needed. As a result, MotionEcho restores generative trajectories for distilled video generators via lightweight, adaptive test-time teacher guidance, enabling accurate motion control without compromising generation efficiency. Extensive experiments on multiple distilled video generation models demonstrate that our method significantly improves motion fidelity and visual quality while retaining the efficiency advantages of distilled generation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 56 of its 71 references that are in the map. First posted on arXiv 24 Jun 2025.
Builds on
56 of 71 references.
References · 56
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
38 more
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022Video Diffusion Modelscited by 2,305
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
- 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180
- 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
- 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
- 2024TFG: Unified Training-Free Guidance for Diffusion Modelscited by 107
- 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 105
- 2023VideoLCM: Video Latent Consistency Modelcited by 92
- 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 87
- 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Modelscited by 86
- 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 67
- 2025Learning Few-Step Diffusion Models by Trajectory Distribution Matchingcited by 57
- 2024FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Modelscited by 56
- 2023CVPR 2023 Text Guided Video Editing Competitioncited by 55
- 2024T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Designcited by 54
- 2023Control-A-Video: Controllable Text-to-Video Diffusion Models with Motion Prior and Reward Feedback Learningcited by 48
- 2024AnimateDiff-Lightning: Cross-Model Diffusion Distillationcited by 47
- 2024AnimateLCM: Computation-Efficient Personalized Style Video Generation without Personalized Video Datacited by 42
- 2024Video Motion Transfer with Diffusion Transformerscited by 39
- 2024IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generationcited by 33
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
- 2025Time-to-Move: Training-Free Motion Controlled Video Generation via Dual-Clock Denoising
- 2026Pathwise Test-Time Correction for Autoregressive Long Video Generation
- 2026Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweening
- 2026Dynamic-in-Few-Step: Unifying Dynamic Computation and Few-Step Distillation for Efficient Video Generation
- 2026From Static to Dynamic: On-Policy Distillation from Image to Video Diffusion Models
- 2026TACD: Distilling Efficient Text-to-Motion Models via Terminal Amplification Control
- 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling