mlsanityData to 14 Oct 2026

EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolation

arXiv 2503.15831 ↗First posted 20 Mar 2025cs.CVcited by 19

On the map: Diffusion models → Video generation

Abstract (arXiv)

Handling complex or nonlinear motion patterns has long posed challenges for video frame interpolation. Although recent advances in diffusion-based methods offer improvements over traditional optical flow-based approaches, they still struggle to generate sharp, temporally consistent frames in scenarios with large motion. To address this limitation, we introduce EDEN, an Enhanced Diffusion for high-quality large-motion vidEo frame iNterpolation. Our approach first utilizes a transformer-based tokenizer to produce refined latent representations of the intermediate frames for diffusion models. We then enhance the diffusion transformer with temporal attention across the process and incorporate a start-end frame difference embedding to guide the generation of dynamic motion. Extensive experiments demonstrate that EDEN achieves state-of-the-art results across popular benchmarks, including nearly a 10% LPIPS reduction on DAVIS and SNU-FILM, and an 8% improvement on DAIN-HD.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 62 of its 68 references that are in the map. First posted on arXiv 20 Mar 2025.

Builds on

62 of 68 references.

Closest ancestors · 10

Same direction, newest first

  1. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animation26 Nov
  2. 2024MotionFollower: Editing Video Motion via Lightweight Score-Guided Diffusion30 May
  3. 2024Motion-aware Latent Diffusion Models for Video Frame Interpolation21 Apr
  4. 2024Video Interpolation with Diffusion Models1 Apr
  5. 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
  6. 2023MotionEditor: Editing Video Motion via Content-Aware Diffusion30 Nov
  7. 2023MagDiff: Multi-Alignment Diffusion for High-Fidelity Video Generation and Editing29 Nov
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  9. 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Models16 Mar
  10. 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation19 May

Other references · 52

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2023Visual Instruction Tuningcited by 7,869
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  10. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
38 more
  1. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  2. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  3. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  4. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  5. 2017Video Enhancement with Task-Oriented Flowcited by 619
  6. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  7. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  8. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
  9. 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 302
  10. 2022Novel View Synthesis with Diffusion Modelscited by 300
  11. 2020Softmax Splatting for Video Frame Interpolationcited by 279
  12. 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 279
  13. 2019Depth-Aware Video Frame Interpolationcited by 234
  14. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
  15. 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
  16. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
  17. 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
  18. 2022FILM: Frame Interpolation for Large Motioncited by 153
  19. 2018Video Compression through Image Interpolationcited by 143
  20. 2021XVFI: eXtreme Video Frame Interpolationcited by 126
  21. 2021Video Frame Interpolation Transformercited by 123
  22. 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 109
  23. 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
  24. 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 98
  25. 2021Deep Animation Video Interpolation in the Wildcited by 65
  26. 2023Denoising Diffusion Probabilistic Models for Robust Image Super-Resolution in the Wildcited by 46
  27. 2017Pixel Recursive Super Resolutioncited by 44
  28. 2018Learning to Synthesize Motion Blurcited by 37
  29. 2022FloLPIPS: A Bespoke Video Quality Metric for Frame Interpoationcited by 37
  30. 2021ST-MFNet: A Spatio-Temporal Multi-Flow Network for Frame Interpolationcited by 35
  31. 2022ResFormer: Scaling ViTs with Multi-Resolution Trainingcited by 34
  32. 2024Sparse Global Matching for Video Frame Interpolation with Large Motioncited by 28
  33. 2022Blur Interpolation Transformer for Real-World Motion from Blurcited by 25
  34. 2024ViTAR: Vision Transformer with Any Resolutioncited by 25
  35. 2023BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolationcited by 23
  36. 2024VFIMamba: Video Frame Interpolation with State Space Modelscited by 22
  37. 2024Frame Interpolation with Consecutive Brownian Bridge Diffusioncited by 19
  38. 2022Neighbor Correspondence Matching for Flow-based Video Frame Synthesiscited by 12

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 14.

19 papers.

Sort:

By area:

  1. 2025DynamiCtrl: Rethinking the Basic Structure and the Role of Text for High-quality Human Image Animationcited by 7
  2. 2025EF-VI: Enhancing End-Frame Injection for Video Inbetweeningcited by 4
  3. 2025Low-Bitrate Video Compression through Semantic-Conditioned Diffusioncited by 4
  4. 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformerscited by 4
  5. 2025SAGE: Structure-Aware Generative Video Transitions between Diverse Clipscited by 2
  6. 2026EcoVideo: Entropy-Orchestrated Video Generation Paradigm in Cloud-Edge Dynamicscited by 2
  7. 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolationcited by 2
  8. 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusioncited by 1
  9. 2026Consistency-Preserving Diverse Video Generationcited by 1
  10. 2026Imagine How To Change: Explicit Procedure Modeling for Change Captioningcited by 1
  11. 2026Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learningcited by 1
  12. 2026Unblur-SLAM: Dense Neural SLAM for Blurry Inputscited by 1
7 more
  1. 2026Can Video Diffusion Models Predict Past Frames? Bidirectional Cycle Consistency for Reversible Interpolationcited by 1
  2. 2025EVDI++: Event-based Video Deblurring and Interpolation via Self-Supervised Learningcited by 0
  3. 20263DTV: A Feedforward Interpolation Network for Real-Time View Synthesiscited by 0
  4. 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolutioncited by 0
  5. 2026MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolationcited by 0
  6. 2026Following Motion for Sequential Modeling in Video Frame Interpolationcited by 0
  7. 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Adapting Image-to-Video Diffusion Models for Large-Motion Frame Interpolation
  2. 2025TLB-VFI: Temporal-Aware Latent Brownian Bridge Diffusion for Video Frame Interpolation
  3. 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation
  4. 2025MiVID: Multi-Strategic Self-Supervision for Video Frame Interpolation using Diffusion Model
  5. 2026Efficient Video Diffusion Models: Advancements and Challenges
  6. 2025Hierarchical Flow Diffusion for Efficient Frame Interpolation
  7. 2026SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation
  8. 2026FC-VFI: Faithful and Consistent Video Frame Interpolation for High-FPS Slow Motion Video Generation