# Neural Network based Inter bi-prediction Blending

arXiv: https://arxiv.org/abs/2202.03149 · HTML: https://mlsanity.com/paper/2202.03149/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 7 of its 13 references that are in the map.
- First posted on arXiv 26 Jan 2022.

## Builds on (most cited first, 7 of 7)

- [Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation](https://mlsanity.com/paper/1712.00080/) (2017)
- [Video Frame Interpolation via Adaptive Separable Convolution](https://mlsanity.com/paper/1708.01692/) (2017)
- [Video Frame Synthesis using Deep Voxel Flow](https://mlsanity.com/paper/1702.02463/) (2017)
- [BVI-DVC: A Training Database for Deep Video Compression](https://mlsanity.com/paper/2003.13552/) (2020)
- [A Convolutional Neural Network Approach for Post-Processing in HEVC Intra Coding](https://mlsanity.com/paper/1608.06690/) (2016)
- [Deep Frame Prediction for Video Coding](https://mlsanity.com/paper/1901.00062/) (2018)
- [Iterative training of neural networks for intra prediction](https://mlsanity.com/paper/2003.06812/) (2020)

## Abstract (arXiv)

This paper presents a learning-based method to improve bi-prediction in video coding. In conventional video coding solutions, the motion compensation of blocks from already decoded reference pictures stands out as the principal tool used to predict the current frame. Especially, the bi-prediction, in which a block is obtained by averaging two different motion-compensated prediction blocks, significantly improves the final temporal prediction accuracy. In this context, we introduce a simple neural network that further improves the blending operation. A complexity balance, both in terms of network size and encoder mode selection, is carried out. Extensive tests on top of the recently standardized VVC codec are performed and show a BD-rate improvement of -1.4% in random access configuration for a network size of fewer than 10k parameters. We also propose a simple CPU-based implementation and direct network quantization to assess the complexity/gains tradeoff in a conventional codec framework.