mlsanityData to 7 Oct 2026

Depth-Aware Video Frame Interpolation

arXiv 1904.00830 ↗First posted 1 Apr 2019cs.CVcited by 232

Not on the map. Why?

Abstract (arXiv)

Video frame interpolation aims to synthesize nonexistent frames in-between the original frames. While significant advances have been made from the recent deep convolutional neural networks, the quality of interpolation is often reduced due to large object motion or occlusion. In this work, we propose a video frame interpolation method which explicitly detects the occlusion by exploring the depth information. Specifically, we develop a depth-aware flow projection layer to synthesize intermediate flows that preferably sample closer objects than farther ones. In addition, we learn hierarchical features to gather contextual information from neighboring pixels. The proposed model then warps the input frames, depth maps, and contextual features based on the optical flow and local interpolation kernels for synthesizing the output frame. Our model is compact, efficient, and fully differentiable. Quantitative and qualitative results demonstrate that the proposed model performs favorably against state-of-the-art frame interpolation methods on a wide variety of datasets.

Key facts. Cited by 232 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Apr 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 47; 2022: 69; 2023: 41; 2024: 33; 2025: 26; 2026: 16.

232 papers.

Sort:

By area:

  1. 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 307
  2. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
  3. 2022VRT: A Video Restoration Transformercited by 219
  4. 2021Deep Contextual Video Compressioncited by 216
  5. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
  6. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
  7. 2021TimeLens: Event-based Video Frame Interpolationcited by 150
  8. 2022FILM: Frame Interpolation for Large Motioncited by 149
  9. 2021XVFI: eXtreme Video Frame Interpolationcited by 123
  10. 2021Video Frame Interpolation Transformercited by 122
  11. 2022Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusioncited by 110
  12. 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 107
38 more
  1. 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
  2. 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
  3. 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 97
  4. 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 88
  5. 2021Only Train Once: A One-Shot Neural Network Training And Pruning Frameworkcited by 70
  6. 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
  7. 2021Real-World Single Image Super-Resolution: A Brief Reviewcited by 65
  8. 2021Deep Animation Video Interpolation in the Wildcited by 65
  9. 2022Unifying Motion Deblurring and Frame Interpolation with Eventscited by 58
  10. 2021CDFI: Compression-Driven Network Design for Frame Interpolationcited by 55
  11. 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
  12. 2021Stochastic Image-to-Video Synthesis using cINNscited by 49
  13. 2021AdaPool: Exponential Adaptive Pooling for Information-Retaining Downsamplingcited by 47
  14. 2022RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-Resolutioncited by 44
  15. 2021iPOKE: Poking a Still Image for Controlled Stochastic Video Synthesiscited by 42
  16. 2022Many-to-many Splatting for Efficient Video Frame Interpolationcited by 42
  17. 2023Flow supervision for Deformable NeRFcited by 42
  18. 2023MGMAE: Motion Guided Masking for Video Masked Autoencodingcited by 40
  19. 2022A Unified Pyramid Recurrent Network for Video Frame Interpolationcited by 39
  20. 2021Understanding Object Dynamics for Interactive Image-to-Video Synthesiscited by 38
  21. 2022TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolationcited by 37
  22. 2021ST-MFNet: A Spatio-Temporal Multi-Flow Network for Frame Interpolationcited by 34
  23. 2022Disentangling Architecture and Training for Optical Flowcited by 32
  24. 2021Learning optical flow from still imagescited by 28
  25. 2022Optimizing Video Prediction via Video Frame Interpolationcited by 28
  26. 2023A Unified Framework for Event-based Frame Interpolation with Ad-hoc Deblurring in the Wildcited by 27
  27. 2024From Sora What We Can See: A Survey of Text-to-Video Generationcited by 26
  28. 2022Conditional Motion In-betweeningcited by 25
  29. 2021Video Frame Interpolation without Temporal Priorscited by 24
  30. 2024Framer: Interactive Frame Interpolationcited by 24
  31. 2025Event-Based Video Frame Interpolation With Cross-Modal Asymmetric Bidirectional Motion Fieldscited by 24
  32. 20233D Cinemagraphy from a Single Imagecited by 23
  33. 2023BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolationcited by 23
  34. 2024Perception-Oriented Video Frame Interpolation via Asymmetric Blendingcited by 23
  35. 2024Repurposing Pre-trained Video Diffusion Models for Event-based Video Interpolationcited by 23
  36. 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generationcited by 23
  37. 2021Temporally Consistent Video Colorization with Deep Feature Propagation and Self-regularization Learningcited by 22
  38. 2024VFIMamba: Video Frame Interpolation with State Space Modelscited by 22

50 most cited of 232 All 232 (JSON)