Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweening
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent progress in image-to-video (I2V) diffusion models has significantly advanced the field of generative inbetweening, which aims to generate semantically plausible frames between two keyframes. In particular, inference-time sampling strategies, which leverage the generative priors of large-scale pre-trained I2V models without additional training, have become increasingly popular. However, existing inference-time sampling, either fusing forward and backward paths in parallel or alternating them sequentially, often suffers from temporal discontinuities and undesirable visual artifacts due to the misalignment between the two generated paths. This is because each path follows the motion prior induced by its own conditioning frame. In this work, we propose Motion Prior Distillation (MPD), a simple yet effective inference-time distillation technique that suppresses bidirectional mismatch by distilling the motion residual of the forward path into the backward path. Our method can deliberately avoid denoising the end-conditioned path which causes the ambiguity of the path, and yield more temporally coherent inbetweening results with the forward motion prior. We not only perform quantitative evaluations on standard benchmarks, but also conduct extensive user studies to demonstrate the effectiveness of our approach in practical scenarios.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 41 of its 49 references that are in the map. First posted on arXiv 13 Feb 2026.
Builds on
41 of 49 references.
Closest ancestors · 13
Same direction, newest first
- 2024ViBiDSampler: Enhancing Video Interpolation Using Bidirectional Diffusion Sampler8 Oct
- 2024VideoGuide: Improving Video Diffusion Models without Training Through a Teacher's Guide6 Oct
- 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation27 Aug
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Video Interpolation with Diffusion Models1 Apr
- 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Models16 Mar
- 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct
- 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation19 May
1 more
- 2022Video Diffusion Models7 Apr
Other references · 28
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 211
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2022Generative Modelling With Inverse Heat Dissipationcited by 164
- 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
- 2022FILM: Frame Interpolation for Large Motioncited by 149
- 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Modelscited by 138
16 more
- 2021Video Frame Interpolation Transformercited by 122
- 2020BMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolationcited by 117
- 2018MEMC-Net: Motion Estimation and Motion Compensation Driven Neural Network for Video Interpolation and Enhancementcited by 111
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 107
- 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
- 2024Framer: Interactive Frame Interpolationcited by 24
- 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generationcited by 23
- 2024Explorative Inbetweening of Time and Spacecited by 21
- 2024Importance-Based Token Merging for Efficient Image and Video Generationcited by 20
- 2024Frame Interpolation with Consecutive Brownian Bridge Diffusioncited by 19
- 2024Beta Sampling is All You Need: Efficient Image Generation Strategy for Diffusion Models using Stepwise Spectral Analysiscited by 19
- 2025Motion-Aware Generative Frame Interpolationcited by 13
- 2025Video Color Grading via Look-Up Table Generationcited by 9
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 8
- 2022Flow Guidance Deformable Compensation Network for Video Frame Interpolationcited by 4
- 2024Inference-Time Diffusion Model Distillationcited by 4
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Rebalancing Reference Frame Dominance to Improve Motion in Image-to-Video Modelscited by 2
- 2026Can Video Diffusion Models Predict Past Frames? Bidirectional Cycle Consistency for Reversible Interpolationcited by 1
- 2026TriMotion: Modality-Agnostic Camera Control for Video Generationcited by 1
- 2026Bridging Online and Offline Handwriting via Differentiable Physical Renderingcited by 0
- 2026Multiple Hypothesis Flow Estimation for Video Frame Interpolation under Matching Ambiguitycited by 0
- 2026Multiple Hypothesis Flow Estimation for Video Frame Interpolation under Matching Ambiguity7 Aug 2026
- 2026Bridging Online and Offline Handwriting via Differentiable Physical Rendering4 Aug 2026
- 2026TriMotion: Modality-Agnostic Camera Control for Video Generation18 Jun 2026
- 2026Rebalancing Reference Frame Dominance to Improve Motion in Image-to-Video Models19 May 2026
- 2026Can Video Diffusion Models Predict Past Frames? Bidirectional Cycle Consistency for Reversible Interpolation2 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
- 2025When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generators
- 2024Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillation
- 2026Transition Matching Distillation for Fast Video Generation
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation
- 2026Parallel Decoding Distillation for Fast Image and Video Generation
- 2026Causal Motion Diffusion Models for Autoregressive Motion Generation
- 2026Generative Motion In-betweening by Diffusion over Continuous Implicit Representations