mlsanityData to 14 Oct 2026

Asymmetric Bilateral Motion Estimation for Video Frame Interpolation

arXiv 2108.06815 ↗First posted 15 Aug 2021cs.CVcited by 101

Not on the map. Why?

Abstract (arXiv)

We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to interpolate an anchor frame. Second, we estimate asymmetric bilateral motions fields from the anchor frame to the input frames. Third, we use the asymmetric fields to warp the input frames backward and reconstruct the intermediate frame. Last, to refine the intermediate frame, we develop a new synthesis network that generates a set of dynamic filters and a residual frame using local and global information. Experimental results show that the proposed algorithm achieves excellent performance on various datasets. The source codes and pretrained models are available at https://github.com/JunHeum/ABME.

Key facts. Cited by 101 papers in the map (data through 14 Oct 2026). Builds on 29 of its 45 references that are in the map. First posted on arXiv 15 Aug 2021.

Builds on

29 of 45 references.

References · 29

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
  3. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
  4. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
  5. 2017Video Enhancement with Task-Oriented Flowcited by 619
  6. 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 424
  7. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
  8. 2020Softmax Splatting for Video Frame Interpolationcited by 279
  9. 2019Depth-Aware Video Frame Interpolationcited by 234
  10. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 213
  11. 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
  12. 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
17 more
  1. 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
  2. 2017Video Frame Interpolation via Adaptive Convolutioncited by 158
  3. 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
  4. 2018DF-Net: Unsupervised Joint Learning of Depth and Flow using Cross-Task Consistencycited by 148
  5. 2016Learning-Based View Synthesis for Light Field Camerascited by 145
  6. 2019AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolationcited by 134
  7. 2021XVFI: eXtreme Video Frame Interpolationcited by 126
  8. 2020What Matters in Unsupervised Optical Flowcited by 124
  9. 2020Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimationcited by 120
  10. 2020BMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolationcited by 118
  11. 2020MaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Maskcited by 117
  12. 2018MEMC-Net: Motion Estimation and Motion Compensation Driven Neural Network for Video Interpolation and Enhancementcited by 112
  13. 2018PhaseNet for Video Frame Interpolationcited by 61
  14. 2017Residual Conv-Deconv Grid Network for Semantic Segmentationcited by 58
  15. 2019Unsupervised Video Interpolation Using Cycle Consistencycited by 44
  16. 2016Learning Image Matching by Simply Watching Videocited by 41
  17. 2019Unsupervised Deep Epipolar Flow for Stationary or Dynamic Scenescited by 29

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 7; 2022: 32; 2023: 19; 2024: 24; 2025: 13; 2026: 6.

101 papers.

Sort:

By area:

  1. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
  2. 2022FILM: Frame Interpolation for Large Motioncited by 153
  3. 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 109
  4. 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 98
  5. 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
  6. 2024Video Interpolation with Diffusion Modelscited by 68
  7. 2021Responsive Listening Head Generation: A Benchmark Dataset and Baselinecited by 67
  8. 2022Realistic Blur Synthesis for Learning Image Deblurringcited by 53
  9. 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolationcited by 44
  10. 2022Many-to-many Splatting for Efficient Video Frame Interpolationcited by 42
  11. 2022A Unified Pyramid Recurrent Network for Video Frame Interpolationcited by 39
  12. 2021ST-MFNet: A Spatio-Temporal Multi-Flow Network for Frame Interpolationcited by 35
38 more
  1. 2024TANGO: Co-Speech Gesture Video Reenactment with Hierarchical Audio Motion Embedding and Diffusion Interpolationcited by 32
  2. 2022Optimizing Video Prediction via Video Frame Interpolationcited by 28
  3. 2024Sparse Global Matching for Video Frame Interpolation with Large Motioncited by 28
  4. 2025Event-Based Video Frame Interpolation With Cross-Modal Asymmetric Bidirectional Motion Fieldscited by 25
  5. 2024Framer: Interactive Frame Interpolationcited by 24
  6. 2022Facial Video-based Remote Physiological Measurement via Self-supervised Learningcited by 23
  7. 2023BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolationcited by 23
  8. 2024Perception-Oriented Video Frame Interpolation via Asymmetric Blendingcited by 23
  9. 2024Repurposing Pre-trained Video Diffusion Models for Event-based Video Interpolationcited by 23
  10. 2021Improving the Perceptual Quality of 2D Animation Interpolationcited by 20
  11. 2022Splatting-based Synthesis for Video Frame Interpolationcited by 20
  12. 2024Frame Interpolation with Consecutive Brownian Bridge Diffusioncited by 19
  13. 2021DeMFI: Deep Joint Deblurring and Multi-Frame Interpolation with Flow-Guided Attentive Correlation and Recursive Boostingcited by 17
  14. 2022Enhanced Bi-directional Motion Estimation for Video Frame Interpolationcited by 17
  15. 2024Generalizable Implicit Motion Modeling for Video Frame Interpolationcited by 16
  16. 2024DreamMover: Leveraging the Prior of Diffusion Models for Image Interpolation with Large Motioncited by 16
  17. 20223D Moments from Near-Duplicate Photoscited by 15
  18. 2022Context-Aware Video Reconstruction for Rolling Shutter Camerascited by 15
  19. 2022A Perceptual Quality Metric for Video Frame Interpolationcited by 15
  20. 2022TTVFI: Learning Trajectory-Aware Transformer for Video Frame Interpolationcited by 14
  21. 2024Motion-aware Latent Diffusion Models for Video Frame Interpolationcited by 14
  22. 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motionscited by 13
  23. 2022Neighbor Correspondence Matching for Flow-based Video Frame Synthesiscited by 12
  24. 2022Learning Cross-Video Neural Representations for High-Quality Frame Interpolationcited by 11
  25. 2023SportsSloMo: A New Benchmark and Baselines for Human-centric Video Frame Interpolationcited by 11
  26. 2024LAVIB: A Large-scale Video Interpolation Benchmarkcited by 11
  27. 2024Disentangled Motion Modeling for Video Frame Interpolationcited by 11
  28. 2022Cross-Attention Transformer for Video Interpolationcited by 10
  29. 2025BF-STVSR: B-Splines and Fourier-Best Friends for High Fidelity Spatial-Temporal Video Super-Resolutioncited by 9
  30. 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 9
  31. 2021Optical Flow Reusing for High-Efficiency Space-Time Video Super Resolutioncited by 8
  32. 2021Incremental Cross-view Mutual Distillation for Self-supervised Medical CT Synthesiscited by 8
  33. 2023Video Frame Interpolation with Densely Queried Bilateral Correlationcited by 8
  34. 2023Scale-Adaptive Feature Aggregation for Efficient Space-Time Video Super-Resolutioncited by 8
  35. 2022JNMR: Joint Non-linear Motion Regression for Video Frame Interpolationcited by 7
  36. 2022BVI-VFI: A Video Quality Database for Video Frame Interpolationcited by 7
  37. 2022INR-V: A Continuous Representation Space for Video-based Generative Taskscited by 7
  38. 2024High-Resolution Frame Interpolation with Patch-based Cascaded Diffusioncited by 7

50 most cited of 101 All 101 (JSON)