EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Handling complex or nonlinear motion patterns has long posed challenges for video frame interpolation. Although recent advances in diffusion-based methods offer improvements over traditional optical flow-based approaches, they still struggle to generate sharp, temporally consistent frames in scenarios with large motion. To address this limitation, we introduce EDEN, an Enhanced Diffusion for high-quality large-motion vidEo frame iNterpolation. Our approach first utilizes a transformer-based tokenizer to produce refined latent representations of the intermediate frames for diffusion models. We then enhance the diffusion transformer with temporal attention across the process and incorporate a start-end frame difference embedding to guide the generation of dynamic motion. Extensive experiments demonstrate that EDEN achieves state-of-the-art results across popular benchmarks, including nearly a 10% LPIPS reduction on DAVIS and SNU-FILM, and an 8% improvement on DAIN-HD.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 62 of its 68 references that are in the map. First posted on arXiv 20 Mar 2025.
Builds on
62 of 68 references.
Closest ancestors · 10
Same direction, newest first
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animation26 Nov
- 2024MotionFollower: Editing Video Motion via Lightweight Score-Guided Diffusion30 May
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolation21 Apr
- 2024Video Interpolation with Diffusion Models1 Apr
- 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
- 2023MotionEditor: Editing Video Motion via Content-Aware Diffusion30 Nov
- 2023MagDiff: Multi-Alignment Diffusion for High-Fidelity Video Generation and Editing29 Nov
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Models16 Mar
- 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation19 May
Other references · 52
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
38 more
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2017Video Enhancement with Task-Oriented Flowcited by 619
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
- 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 302
- 2022Novel View Synthesis with Diffusion Modelscited by 300
- 2020Softmax Splatting for Video Frame Interpolationcited by 279
- 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 279
- 2019Depth-Aware Video Frame Interpolationcited by 234
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
- 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
- 2022FILM: Frame Interpolation for Large Motioncited by 153
- 2018Video Compression through Image Interpolationcited by 143
- 2021XVFI: eXtreme Video Frame Interpolationcited by 126
- 2021Video Frame Interpolation Transformercited by 123
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 109
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 98
- 2021Deep Animation Video Interpolation in the Wildcited by 65
- 2023Denoising Diffusion Probabilistic Models for Robust Image Super-Resolution in the Wildcited by 46
- 2017Pixel Recursive Super Resolutioncited by 44
- 2018Learning to Synthesize Motion Blurcited by 37
- 2022FloLPIPS: A Bespoke Video Quality Metric for Frame Interpoationcited by 37
- 2021ST-MFNet: A Spatio-Temporal Multi-Flow Network for Frame Interpolationcited by 35
- 2022ResFormer: Scaling ViTs with Multi-Resolution Trainingcited by 34
- 2024Sparse Global Matching for Video Frame Interpolation with Large Motioncited by 28
- 2022Blur Interpolation Transformer for Real-World Motion from Blurcited by 25
- 2024ViTAR: Vision Transformer with Any Resolutioncited by 25
- 2023BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolationcited by 23
- 2024VFIMamba: Video Frame Interpolation with State Space Modelscited by 22
- 2024Frame Interpolation with Consecutive Brownian Bridge Diffusioncited by 19
- 2022Neighbor Correspondence Matching for Flow-based Video Frame Synthesiscited by 12
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 5; 2026: 14.
19 papers.
Sort:
By area:
- 2025DynamiCtrl: Rethinking the Basic Structure and the Role of Text for High-quality Human Image Animationcited by 7
- 2025EF-VI: Enhancing End-Frame Injection for Video Inbetweeningcited by 4
- 2025Low-Bitrate Video Compression through Semantic-Conditioned Diffusioncited by 4
- 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformerscited by 4
- 2025SAGE: Structure-Aware Generative Video Transitions between Diverse Clipscited by 2
- 2026EcoVideo: Entropy-Orchestrated Video Generation Paradigm in Cloud-Edge Dynamicscited by 2
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolationcited by 2
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusioncited by 1
- 2026Consistency-Preserving Diverse Video Generationcited by 1
- 2026Imagine How To Change: Explicit Procedure Modeling for Change Captioningcited by 1
- 2026Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learningcited by 1
- 2026Unblur-SLAM: Dense Neural SLAM for Blurry Inputscited by 1
7 more
- 2026Can Video Diffusion Models Predict Past Frames? Bidirectional Cycle Consistency for Reversible Interpolationcited by 1
- 2025EVDI++: Event-based Video Deblurring and Interpolation via Self-Supervised Learningcited by 0
- 20263DTV: A Feedforward Interpolation Network for Real-Time View Synthesiscited by 0
- 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolutioncited by 0
- 2026MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolationcited by 0
- 2026Following Motion for Sequential Modeling in Video Frame Interpolationcited by 0
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolationcited by 0
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolation20 Sep 2026
- 2026Following Motion for Sequential Modeling in Video Frame Interpolation24 Aug 2026
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation17 Jul 2026
- 2026EcoVideo: Entropy-Orchestrated Video Generation Paradigm in Cloud-Edge Dynamics29 Jun 2026
- 2026MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolation26 Jun 2026
- 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolution13 May 2026
- 20263DTV: A Feedforward Interpolation Network for Real-Time View Synthesis13 Apr 2026
- 2026Can Video Diffusion Models Predict Past Frames? Bidirectional Cycle Consistency for Reversible Interpolation2 Apr 2026
- 2026Unblur-SLAM: Dense Neural SLAM for Blurry Inputs26 Mar 2026
- 2026Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learning16 Mar 2026
- 2026Imagine How To Change: Explicit Procedure Modeling for Change Captioning6 Mar 2026
- 2026Consistency-Preserving Diverse Video Generation17 Feb 2026
7 more
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusion28 Jan 2026
- 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformers21 Jan 2026
- 2025Low-Bitrate Video Compression through Semantic-Conditioned Diffusion29 Nov 2025
- 2025SAGE: Structure-Aware Generative Video Transitions between Diverse Clips28 Oct 2025
- 2025EVDI++: Event-based Video Deblurring and Interpolation via Self-Supervised Learning10 Sep 2025
- 2025EF-VI: Enhancing End-Frame Injection for Video Inbetweening27 May 2025
- 2025DynamiCtrl: Rethinking the Basic Structure and the Role of Text for High-quality Human Image Animation27 Mar 2025
- 2025DynamiCtrl: Rethinking the Basic Structure and the Role of Text for High-quality Human Image Animationcited by 7
- 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformerscited by 4
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolationcited by 2
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusioncited by 1
- 2026Consistency-Preserving Diverse Video Generationcited by 1
- 2026Can Video Diffusion Models Predict Past Frames? Bidirectional Cycle Consistency for Reversible Interpolationcited by 1
- 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolutioncited by 0
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation17 Jul 2026
- 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolution13 May 2026
- 2026Can Video Diffusion Models Predict Past Frames? Bidirectional Cycle Consistency for Reversible Interpolation2 Apr 2026
- 2026Consistency-Preserving Diverse Video Generation17 Feb 2026
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusion28 Jan 2026
- 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformers21 Jan 2026
- 2025DynamiCtrl: Rethinking the Basic Structure and the Role of Text for High-quality Human Image Animation27 Mar 2025
- 2025EF-VI: Enhancing End-Frame Injection for Video Inbetweeningcited by 4
- 2025Low-Bitrate Video Compression through Semantic-Conditioned Diffusioncited by 4
- 2025SAGE: Structure-Aware Generative Video Transitions between Diverse Clipscited by 2
- 2026EcoVideo: Entropy-Orchestrated Video Generation Paradigm in Cloud-Edge Dynamicscited by 2
- 2026Imagine How To Change: Explicit Procedure Modeling for Change Captioningcited by 1
- 2026Unblur-SLAM: Dense Neural SLAM for Blurry Inputscited by 1
- 2025EVDI++: Event-based Video Deblurring and Interpolation via Self-Supervised Learningcited by 0
- 20263DTV: A Feedforward Interpolation Network for Real-Time View Synthesiscited by 0
- 2026MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolationcited by 0
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolationcited by 0
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolation20 Sep 2026
- 2026EcoVideo: Entropy-Orchestrated Video Generation Paradigm in Cloud-Edge Dynamics29 Jun 2026
- 2026MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolation26 Jun 2026
- 20263DTV: A Feedforward Interpolation Network for Real-Time View Synthesis13 Apr 2026
- 2026Unblur-SLAM: Dense Neural SLAM for Blurry Inputs26 Mar 2026
- 2026Imagine How To Change: Explicit Procedure Modeling for Change Captioning6 Mar 2026
- 2025Low-Bitrate Video Compression through Semantic-Conditioned Diffusion29 Nov 2025
- 2025SAGE: Structure-Aware Generative Video Transitions between Diverse Clips28 Oct 2025
- 2025EVDI++: Event-based Video Deblurring and Interpolation via Self-Supervised Learning10 Sep 2025
- 2025EF-VI: Enhancing End-Frame Injection for Video Inbetweening27 May 2025
Similar, not cited
Close in wording, no citation either way
- 2024Adapting Image-to-Video Diffusion Models for Large-Motion Frame Interpolation
- 2025TLB-VFI: Temporal-Aware Latent Brownian Bridge Diffusion for Video Frame Interpolation
- 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation
- 2025MiVID: Multi-Strategic Self-Supervision for Video Frame Interpolation using Diffusion Model
- 2026Efficient Video Diffusion Models: Advancements and Challenges
- 2025Hierarchical Flow Diffusion for Efficient Frame Interpolation
- 2026SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation
- 2026FC-VFI: Faithful and Consistent Video Frame Interpolation for High-FPS Slow Motion Video Generation