AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation
Not on the map. Why?
Abstract (arXiv)
Video Frame Interpolation (VFI) is a core low-level vision task that synthesizes intermediate frames between existing ones while ensuring spatial and temporal coherence. Over the past decades, VFI methodologies have evolved from classical motion compensation-based approach to a wide spectrum of deep learning-based approaches, including kernel-, flow-, hybrid-, phase-, GAN-, Transformer-, Mamba-, and most recently, diffusion-based models. We introduce AceVFI, a comprehensive and up-to-date review of the VFI field, covering over 250 representative papers. We systematically categorize VFI methods based on their core design principles and architectural characteristics. Further, we classify them into two major learning paradigms: Center-Time Frame Interpolation (CTFI) and Arbitrary-Time Frame Interpolation (ATFI). We analyze key challenges in VFI, including large motion, occlusion, lighting variation, and non-linear motion. In addition, we review standard datasets, loss functions, evaluation metrics. We also explore VFI applications in other domains and highlight future research directions. This survey aims to serve as a valuable reference for researchers and practitioners seeking a thorough understanding of the modern VFI landscape.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 178 of its 274 references that are in the map. First posted on arXiv 1 Jun 2025.
Builds on
178 of 274 references.
References · 178
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
38 more
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2017Deformable Convolutional Networkscited by 1,488
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2015Spatial Transformer Networkscited by 1,429
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
- 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
- 2017Video Enhancement with Task-Oriented Flowcited by 619
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 424
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
- 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
- 2015Deep multi-scale video prediction beyond mean square errorcited by 300
- 2020Softmax Splatting for Video Frame Interpolationcited by 279
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
- 2019Depth-Aware Video Frame Interpolationcited by 234
- 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 224
- 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 213
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
- 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
50 most cited of 178 All 178 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 6.
9 papers.
- 2026Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweeningcited by 6
- 2025SAGE: Structure-Aware Generative Video Transitions between Diverse Clipscited by 2
- 2026Anchoring and Rescaling Attention for Semantically Coherent Inbetweeningcited by 2
- 2025RocSync: Millisecond-Accurate Temporal Synchronization for Heterogeneous Camera Systemscited by 1
- 2025MiVID: Multi-Strategic Self-Supervision for Video Frame Interpolation using Diffusion Modelcited by 0
- 2026RetimeGS: Continuous-Time Reconstruction of 4D Gaussian Splattingcited by 0
- 2026UniRED: Unified RGB-D Video Frame Interpolation with Event Guidancecited by 0
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolationcited by 0
- 2026Revisiting Ground-Truth Synthesis from High-Speed Video: Exact Validity Conditions and an Audited Consumer Capture Corpuscited by 0
- 2026Revisiting Ground-Truth Synthesis from High-Speed Video: Exact Validity Conditions and an Audited Consumer Capture Corpus4 Oct 2026
- 2026Accurate Motion Estimation with B'ezier Control Point for Efficient Frame Interpolation20 Sep 2026
- 2026UniRED: Unified RGB-D Video Frame Interpolation with Event Guidance23 Jun 2026
- 2026Anchoring and Rescaling Attention for Semantically Coherent Inbetweening18 Mar 2026
- 2026RetimeGS: Continuous-Time Reconstruction of 4D Gaussian Splatting14 Mar 2026
- 2026Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweening13 Feb 2026
- 2025RocSync: Millisecond-Accurate Temporal Synchronization for Heterogeneous Camera Systems18 Nov 2025
- 2025MiVID: Multi-Strategic Self-Supervision for Video Frame Interpolation using Diffusion Model8 Nov 2025
- 2025SAGE: Structure-Aware Generative Video Transitions between Diverse Clips28 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformers
- 2026FC-VFI: Faithful and Consistent Video Frame Interpolation for High-FPS Slow Motion Video Generation
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation
- 2026SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation
- 2023ST-MFNet Mini: Knowledge Distillation-Driven Frame Interpolation
- 2025EventDiff: A Unified and Efficient Diffusion Model Framework for Event-based Video Frame Interpolation
- 2025TLB-VFI: Temporal-Aware Latent Brownian Bridge Diffusion for Video Frame Interpolation
- 2026Following Motion for Sequential Modeling in Video Frame Interpolation