mlsanityData to 14 Oct 2026

BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolation

arXiv 2304.02225 ↗First posted 5 Apr 2023cs.CVcited by 23

Not on the map. Why?

Abstract (arXiv)

A novel 4K video frame interpolator based on bilateral transformer (BiFormer) is proposed in this paper, which performs three steps: global motion estimation, local motion refinement, and frame synthesis. First, in global motion estimation, we predict symmetric bilateral motion fields at a coarse scale. To this end, we propose BiFormer, the first transformer-based bilateral motion estimator. Second, we refine the global motion fields efficiently using blockwise bilateral cost volumes (BBCVs). Third, we warp the input frames using the refined motion fields and blend them to synthesize an intermediate frame. Extensive experiments demonstrate that the proposed BiFormer algorithm achieves excellent interpolation performance on 4K datasets. The source codes are available at https://github.com/JunHeum/BiFormer.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 44 of its 54 references that are in the map. First posted on arXiv 5 Apr 2023.

Builds on

44 of 54 references.

References · 44

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  6. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  7. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
  8. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
  9. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
  10. 2017Video Enhancement with Task-Oriented Flowcited by 619
  11. 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
  12. 2019Stand-Alone Self-Attention in Vision Modelscited by 542
32 more
  1. 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 424
  2. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 327
  3. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
  4. 2020Softmax Splatting for Video Frame Interpolationcited by 279
  5. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
  6. 2019Depth-Aware Video Frame Interpolationcited by 234
  7. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 213
  8. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
  9. 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
  10. 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
  11. 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
  12. 2017Video Frame Interpolation via Adaptive Convolutioncited by 158
  13. 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
  14. 2022FILM: Frame Interpolation for Large Motioncited by 153
  15. 2018DF-Net: Unsupervised Joint Learning of Depth and Flow using Cross-Task Consistencycited by 148
  16. 2016Learning-Based View Synthesis for Light Field Camerascited by 145
  17. 2018Video Compression through Image Interpolationcited by 143
  18. 2019AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolationcited by 134
  19. 2021XVFI: eXtreme Video Frame Interpolationcited by 126
  20. 2020What Matters in Unsupervised Optical Flowcited by 124
  21. 2021Video Frame Interpolation Transformercited by 123
  22. 2020Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimationcited by 120
  23. 2020BMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolationcited by 118
  24. 2020MaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Maskcited by 117
  25. 2018MEMC-Net: Motion Estimation and Motion Compensation Driven Neural Network for Video Interpolation and Enhancementcited by 112
  26. 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
  27. 2021CDFI: Compression-Driven Network Design for Frame Interpolationcited by 56
  28. 2020BVI-DVC: A Training Database for Deep Video Compressioncited by 49
  29. 2019Unsupervised Video Interpolation Using Cycle Consistencycited by 44
  30. 2022Many-to-many Splatting for Efficient Video Frame Interpolationcited by 42
  31. 2016Learning Image Matching by Simply Watching Videocited by 41
  32. 2019Unsupervised Deep Epipolar Flow for Stationary or Dynamic Scenescited by 29

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 10; 2025: 7; 2026: 3.

23 papers.

Sort:

By area:

  1. 2024TANGO: Co-Speech Gesture Video Reenactment with Hierarchical Audio Motion Embedding and Diffusion Interpolationcited by 32
  2. 2024Sparse Global Matching for Video Frame Interpolation with Large Motioncited by 28
  3. 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolationcited by 19
  4. 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancementcited by 17
  5. 2024Data-Efficient Unsupervised Interpolation Without Any Intermediate Frame for 4D Medical Imagescited by 16
  6. 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motionscited by 13
  7. 2025Motion-Aware Generative Frame Interpolationcited by 13
  8. 2024Disentangled Motion Modeling for Video Frame Interpolationcited by 11
  9. 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 9
  10. 2024A Survey on Future Frame Synthesis: Bridging Deterministic and Generative Approachescited by 7
  11. 2025TLB-VFI: Temporal-Aware Latent Brownian Bridge Diffusion for Video Frame Interpolationcited by 7
  12. 2025FB-Diff: Fourier Basis-guided Diffusion for Temporal Interpolation of 4D Medical Imagingcited by 6
11 more
  1. 2024Benchmarking Video Frame Interpolationcited by 4
  2. 2024Dual-Camera Smooth Zoom on Mobile Phonescited by 4
  3. 2024CPT-Interp: Continuous sPatial and Temporal Motion Modeling for 4D Medical Image Interpolationcited by 3
  4. 2025One Step Closer: Creating the Future to Boost Monocular Semantic Scene Completioncited by 3
  5. 2023IDO-VFI: Identifying Dynamics via Optical Flow Guidance for Video Frame Interpolation with Eventscited by 2
  6. 2023Velocity Disambiguation for Video Frame Interpolationcited by 0
  7. 2023Restoration-Oriented Video Frame Interpolation with Region-Distinguishable Priors from SAMcited by 0
  8. 2024Med-PerSAM: One-Shot Visual Prompt Tuning for Personalized Segment Anything Model in Medical Domaincited by 0
  9. 2026LiveStre4m: Feed-Forward Live Streaming of Novel Views from Unposed Multi-View Videocited by 0
  10. 2026MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolationcited by 0
  11. 20264DHumanDiff: Direct Text-to-4DGS Generation for Consistent 360-Degree Dynamic Humanscited by 0