BMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolation
Not on the map. Why?
Abstract (arXiv)
Video interpolation increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames. We propose a novel deep-learning-based video interpolation algorithm based on bilateral motion estimation. First, we develop the bilateral motion network with the bilateral cost volume to estimate bilateral motions accurately. Then, we approximate bi-directional motions to predict a different kind of bilateral motions. We then warp the two input frames using the estimated bilateral motions. Next, we develop the dynamic filter generation network to yield dynamic blending filters. Finally, we combine the warped frames using the dynamic blending filters to generate intermediate frames. Experimental results show that the proposed algorithm outperforms the state-of-the-art video interpolation algorithms on several benchmark datasets.
Key facts. Cited by 117 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 48; 2023: 21; 2024: 19; 2025: 9; 2026: 5.
117 papers.
Sort:
By area:
- 2022VRT: A Video Restoration Transformercited by 219
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2021TimeLens: Event-based Video Frame Interpolationcited by 150
- 2022FILM: Frame Interpolation for Large Motioncited by 149
- 2021XVFI: eXtreme Video Frame Interpolationcited by 123
- 2021Video Frame Interpolation Transformercited by 122
- 2022Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusioncited by 110
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 107
- 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
- 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 97
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 88
- 2021CDFI: Compression-Driven Network Design for Frame Interpolationcited by 55
38 more
- 2021AdaPool: Exponential Adaptive Pooling for Information-Retaining Downsamplingcited by 47
- 2022RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-Resolutioncited by 44
- 2022Many-to-many Splatting for Efficient Video Frame Interpolationcited by 42
- 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolationcited by 42
- 2022A Unified Pyramid Recurrent Network for Video Frame Interpolationcited by 39
- 2022TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolationcited by 37
- 2021ST-MFNet: A Spatio-Temporal Multi-Flow Network for Frame Interpolationcited by 34
- 2024TANGO: Co-Speech Gesture Video Reenactment with Hierarchical Audio Motion Embedding and Diffusion Interpolationcited by 32
- 2022Optimizing Video Prediction via Video Frame Interpolationcited by 28
- 2024Sparse Global Matching for Video Frame Interpolation with Large Motioncited by 27
- 2024Framer: Interactive Frame Interpolationcited by 24
- 2025Event-Based Video Frame Interpolation With Cross-Modal Asymmetric Bidirectional Motion Fieldscited by 24
- 2023BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolationcited by 23
- 2024Perception-Oriented Video Frame Interpolation via Asymmetric Blendingcited by 23
- 2022Facial Video-based Remote Physiological Measurement via Self-supervised Learningcited by 22
- 2022Splatting-based Synthesis for Video Frame Interpolationcited by 20
- 2021Learning for Unconstrained Space-Time Video Super-Resolutioncited by 18
- 2022Video Interpolation by Event-driven Anisotropic Adjustment of Optical Flowcited by 18
- 2021DeMFI: Deep Joint Deblurring and Multi-Frame Interpolation with Flow-Guided Attentive Correlation and Recursive Boostingcited by 17
- 2022Exploring Motion Ambiguity and Alignment for High-Quality Video Frame Interpolationcited by 17
- 2022Enhanced Bi-directional Motion Estimation for Video Frame Interpolationcited by 17
- 2024AniClipart: Clipart Animation with Text-to-Video Priorscited by 17
- 2021Comparing Correspondences: Video Prediction with Correspondence-wise Lossescited by 16
- 2024Generalizable Implicit Motion Modeling for Video Frame Interpolationcited by 16
- 2021NTIRE 2021 Challenge on Video Super-Resolutioncited by 15
- 20223D Moments from Near-Duplicate Photoscited by 15
- 2022Context-Aware Video Reconstruction for Rolling Shutter Camerascited by 15
- 2022A Perceptual Quality Metric for Video Frame Interpolationcited by 15
- 2022TTVFI: Learning Trajectory-Aware Transformer for Video Frame Interpolationcited by 14
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolationcited by 14
- 2023NeuralPCI: Spatio-temporal Neural Field for 3D Point Cloud Multi-frame Non-linear Interpolationcited by 13
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motionscited by 13
- 2022Neighbor Correspondence Matching for Flow-based Video Frame Synthesiscited by 12
- 2022Learning Cross-Video Neural Representations for High-Quality Frame Interpolationcited by 11
- 2024Disentangled Motion Modeling for Video Frame Interpolationcited by 11
- 2022Cross-Attention Transformer for Video Interpolationcited by 10
- 2022Enhancing Deformable Convolution based Video Frame Interpolation with Coarse-to-fine 3D CNNcited by 9
- 2023Deep Geometrized Cartoon Line Inbetweeningcited by 9
50 most cited of 117 All 117 (JSON)
- 2026Following Motion for Sequential Modeling in Video Frame Interpolation24 Aug 2026
- 2026Multiple Hypothesis Flow Estimation for Video Frame Interpolation under Matching Ambiguity7 Aug 2026
- 2026TVRN: Invertible Neural Networks for Compression-Aware Temporal Video Rescaling15 May 2026
- 20263DTV: A Feedforward Interpolation Network for Real-Time View Synthesis13 Apr 2026
- 2026Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweening13 Feb 2026
- 2025MultiCOIN: Multi-Modal COntrollable Video INbetweening9 Oct 2025
- 2025Topology Aware Neural Interpolation of Scalar Fields25 Aug 2025
- 2025Semantic Frame Interpolation7 Jul 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025PS4PRO: Pixel-to-pixel Supervision for Photorealistic Rendering and Optimization28 May 2025
- 2025EventDiff: A Unified and Efficient Diffusion Model Framework for Event-based Video Frame Interpolation13 May 2025
- 2025TimeTracker: Event-based Continuous Point Tracking for Video Frame Interpolation with Non-linear Motion6 May 2025
38 more
- 2025Video Motion Graphs26 Mar 2025
- 2025Event-Based Video Frame Interpolation With Cross-Modal Asymmetric Bidirectional Motion Fields19 Feb 2025
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions16 Dec 2024
- 2024FastPCI: Motion-Structure Guided Fast Point Cloud Frame Interpolation25 Oct 2024
- 2024Framer: Interactive Frame Interpolation24 Oct 2024
- 2024High-Resolution Frame Interpolation with Patch-based Cascaded Diffusion15 Oct 2024
- 2024TANGO: Co-Speech Gesture Video Reenactment with Hierarchical Audio Motion Embedding and Diffusion Interpolation5 Oct 2024
- 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation27 Aug 2024
- 2024Generalizable Implicit Motion Modeling for Video Frame Interpolation11 Jul 2024
- 2024Disentangled Motion Modeling for Video Frame Interpolation25 Jun 2024
- 2024Video Frame Interpolation for Polarization via Swin-Transformer17 Jun 2024
- 2024Survey on Visual Signal Coding and Processing with Generative Models: Technologies, Standards and Optimization23 May 2024
- 2024Event-based Video Frame Interpolation with Edge Guided Motion Refinement28 Apr 2024
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolation21 Apr 2024
- 2024AniClipart: Clipart Animation with Text-to-Video Priors18 Apr 2024
- 2024LADDER: An Efficient Framework for Video Frame Interpolation17 Apr 2024
- 2024Sparse Global Matching for Video Frame Interpolation with Large Motion10 Apr 2024
- 2024Perception-Oriented Video Frame Interpolation via Asymmetric Blending10 Apr 2024
- 2024Benchmarking Video Frame Interpolation25 Mar 2024
- 2024Motion-Aware Video Frame Interpolation5 Feb 2024
- 2024Jump Cut Smoothing for Talking Heads9 Jan 2024
- 2023Restoration-Oriented Video Frame Interpolation with Region-Distinguishable Priors from SAM26 Dec 2023
- 2023A Multi-In-Single-Out Network for Video Frame Interpolation without Optical Flow20 Nov 2023
- 2023Velocity Disambiguation for Video Frame Interpolation14 Nov 2023
- 2023Video Frame Interpolation with Many-to-many Splatting and Spatial Selective Refinement29 Oct 2023
- 2023Deep Geometrized Cartoon Line Inbetweening28 Sep 2023
- 2023Dynamic Frame Interpolation in Wavelet Domain7 Sep 2023
- 2023Uncertainty-Guided Spatial Pruning Architecture for Efficient Frame Interpolation31 Jul 2023
- 2023Revisiting Event-based Video Frame Interpolation24 Jul 2023
- 2023Self-supervised Learning of Event-guided Video Frame Interpolation for Rolling Shutter Frames27 Jun 2023
- 2023Boost Video Frame Interpolation via Motion Adaptation24 Jun 2023
- 2023Neural Image Re-Exposure23 May 2023
- 2023IDO-VFI: Identifying Dynamics via Optical Flow Guidance for Video Frame Interpolation with Events17 May 2023
- 2023Video Frame Interpolation with Densely Queried Bilateral Correlation26 Apr 2023
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolation19 Apr 2023
- 2023BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolation5 Apr 2023
- 2023Implicit View-Time Interpolation of Stereo Videos using Multi-Plane Disparities and Non-Uniform Coordinates30 Mar 2023
- 2023NeuralPCI: Spatio-temporal Neural Field for 3D Point Cloud Multi-frame Non-linear Interpolation27 Mar 2023
50 newest of 117 All 117 (JSON)
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 88
- 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolationcited by 42
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolationcited by 14
- 2024High-Resolution Frame Interpolation with Patch-based Cascaded Diffusioncited by 7
- 2025Video Motion Graphscited by 5
- 2026Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweeningcited by 5
- 2025EventDiff: A Unified and Efficient Diffusion Model Framework for Event-based Video Frame Interpolationcited by 3
- 2026Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweening13 Feb 2026
- 2025EventDiff: A Unified and Efficient Diffusion Model Framework for Event-based Video Frame Interpolation13 May 2025
- 2025Video Motion Graphs26 Mar 2025
- 2024High-Resolution Frame Interpolation with Patch-based Cascaded Diffusion15 Oct 2024
- 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation27 Aug 2024
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolation21 Apr 2024
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Models16 Mar 2023
- 2022VRT: A Video Restoration Transformercited by 219
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2021TimeLens: Event-based Video Frame Interpolationcited by 150
- 2022FILM: Frame Interpolation for Large Motioncited by 149
- 2021XVFI: eXtreme Video Frame Interpolationcited by 123
- 2021Video Frame Interpolation Transformercited by 122
- 2022Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusioncited by 110
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 107
- 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
- 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 97
- 2021CDFI: Compression-Driven Network Design for Frame Interpolationcited by 55
- 2021AdaPool: Exponential Adaptive Pooling for Information-Retaining Downsamplingcited by 47
12 most cited of 109 All 109 (JSON)
- 2026Multiple Hypothesis Flow Estimation for Video Frame Interpolation under Matching Ambiguity7 Aug 2026
- 2026TVRN: Invertible Neural Networks for Compression-Aware Temporal Video Rescaling15 May 2026
- 20263DTV: A Feedforward Interpolation Network for Real-Time View Synthesis13 Apr 2026
- 2025MultiCOIN: Multi-Modal COntrollable Video INbetweening9 Oct 2025
- 2025Topology Aware Neural Interpolation of Scalar Fields25 Aug 2025
- 2025Semantic Frame Interpolation7 Jul 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025PS4PRO: Pixel-to-pixel Supervision for Photorealistic Rendering and Optimization28 May 2025
- 2025TimeTracker: Event-based Continuous Point Tracking for Video Frame Interpolation with Non-linear Motion6 May 2025
- 2025Event-Based Video Frame Interpolation With Cross-Modal Asymmetric Bidirectional Motion Fields19 Feb 2025
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions16 Dec 2024
- 2024FastPCI: Motion-Structure Guided Fast Point Cloud Frame Interpolation25 Oct 2024
12 newest of 109 All 109 (JSON)