# Convolutional Neural Network-Based Block Up-sampling for Intra Frame Coding

arXiv: https://arxiv.org/abs/1702.06728 · HTML: https://mlsanity.com/paper/1702.06728/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Feb 2017.

## Built on by (most cited first, 10 of 10)

- [In-Loop Filtering via Trained Look-Up Tables](https://mlsanity.com/paper/2407.10926/) (2024)
- [Toward Scalable Image Feature Compression: A Content-Adaptive and Diffusion-Based Approach](https://mlsanity.com/paper/2410.06149/) (2024)
- [Perceptually-inspired super-resolution of compressed videos](https://mlsanity.com/paper/2106.08147/) (2021)
- [Universal Deoxidation of Semiconductor Substrates Assisted by Machine-Learning and Real-Time-Feedback-Control](https://mlsanity.com/paper/2312.01662/) (2023)
- [Deep Network for Image Compressed Sensing Coding Using Local Structural Sampling](https://mlsanity.com/paper/2402.19111/) (2024)
- [Joint Reference Frame Synthesis and Post Filter Enhancement for Versatile Video Coding](https://mlsanity.com/paper/2404.18058/) (2024)
- [In-Loop Filtering Using Learned Look-Up Tables for Video Coding](https://mlsanity.com/paper/2509.09494/) (2025)
- [DMVC: Multi-Camera Video Compression Network aimed at Improving Deep Learning Accuracy](https://mlsanity.com/paper/2410.18400/) (2024)
- [EPS: Efficient Patch Sampling for Video Overfitting in Deep Super-Resolution Model Training](https://mlsanity.com/paper/2411.16312/) (2024)
- [Joint Degradation-Aware Arbitrary-Scale Super-Resolution for Variable-Rate Extreme Image Compression](https://mlsanity.com/paper/2603.17408/) (2026)

## Abstract (arXiv)

Inspired by the recent advances of image super-resolution using convolutional neural network (CNN), we propose a CNN-based block up-sampling scheme for intra frame coding. A block can be down-sampled before being compressed by normal intra coding, and then up-sampled to its original resolution. Different from previous studies on down/up-sampling-based coding, the up-sampling methods in our scheme have been designed by training CNN instead of hand-crafted. We explore a new CNN structure for up-sampling, which features deconvolution of feature maps, multi-scale fusion, and residue learning, making the network both compact and efficient. We also design different networks for the up-sampling of luma and chroma components, respectively, where the chroma up-sampling CNN utilizes the luma information to boost its performance. In addition, we design a two-stage up-sampling process, the first stage being within the block-by-block coding loop, and the second stage being performed on the entire frame, so as to refine block boundaries. We also empirically study how to set the coding parameters of down-sampled blocks for pursuing the frame-level rate-distortion optimization. Our proposed scheme is implemented into the High Efficiency Video Coding (HEVC) reference software, and a comprehensive set of experiments have been performed to evaluate our methods. Experimental results show that our scheme achieves significant bits saving compared with HEVC anchor especially at low bit rates, leading to on average 5.5% BD-rate reduction on common test sequences and on average 9.0% BD-rate reduction on ultra high definition (UHD) test sequences.