mlsanityData to 14 Oct 2026

AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation

arXiv 2506.01061 ↗First posted 1 Jun 2025cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Video Frame Interpolation (VFI) is a core low-level vision task that synthesizes intermediate frames between existing ones while ensuring spatial and temporal coherence. Over the past decades, VFI methodologies have evolved from classical motion compensation-based approach to a wide spectrum of deep learning-based approaches, including kernel-, flow-, hybrid-, phase-, GAN-, Transformer-, Mamba-, and most recently, diffusion-based models. We introduce AceVFI, a comprehensive and up-to-date review of the VFI field, covering over 250 representative papers. We systematically categorize VFI methods based on their core design principles and architectural characteristics. Further, we classify them into two major learning paradigms: Center-Time Frame Interpolation (CTFI) and Arbitrary-Time Frame Interpolation (ATFI). We analyze key challenges in VFI, including large motion, occlusion, lighting variation, and non-linear motion. In addition, we review standard datasets, loss functions, evaluation metrics. We also explore VFI applications in other domains and highlight future research directions. This survey aims to serve as a valuable reference for researchers and practitioners seeking a thorough understanding of the modern VFI landscape.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 178 of its 274 references that are in the map. First posted on arXiv 1 Jun 2025.

Builds on

178 of 274 references.

References · 178

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2022Generative Adversarial Networkscited by 5,627
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  11. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  12. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
38 more
  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  2. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  4. 2017Improved Training of Wasserstein GANscited by 2,235
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  6. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  7. 2017Deformable Convolutional Networkscited by 1,488
  8. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
  9. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  10. 2015Spatial Transformer Networkscited by 1,429
  11. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  12. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  13. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
  14. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
  15. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  16. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  17. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
  18. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  19. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  20. 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
  21. 2017Video Enhancement with Task-Oriented Flowcited by 619
  22. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  23. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  24. 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 424
  25. 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
  26. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
  27. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
  28. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  29. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
  30. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
  31. 2015Deep multi-scale video prediction beyond mean square errorcited by 300
  32. 2020Softmax Splatting for Video Frame Interpolationcited by 279
  33. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
  34. 2019Depth-Aware Video Frame Interpolationcited by 234
  35. 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 224
  36. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 213
  37. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
  38. 2017Video Frame Synthesis using Deep Voxel Flowcited by 209

50 most cited of 178 All 178 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 6.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformers
  2. 2026FC-VFI: Faithful and Consistent Video Frame Interpolation for High-FPS Slow Motion Video Generation
  3. 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation
  4. 2026SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation
  5. 2023ST-MFNet Mini: Knowledge Distillation-Driven Frame Interpolation
  6. 2025EventDiff: A Unified and Efficient Diffusion Model Framework for Event-based Video Frame Interpolation
  7. 2025TLB-VFI: Temporal-Aware Latent Brownian Bridge Diffusion for Video Frame Interpolation
  8. 2026Following Motion for Sequential Modeling in Video Frame Interpolation