# Optimal Transcoding Resolution Prediction for Efficient Per-Title Bitrate Ladder Estimation

arXiv: https://arxiv.org/abs/2401.04405 · HTML: https://mlsanity.com/paper/2401.04405/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 9 of its 25 references that are in the map.
- First posted on arXiv 9 Jan 2024.

## Builds on (most cited first, 9 of 9)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset](https://mlsanity.com/paper/1705.07750/) (2017)
- [Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling](https://mlsanity.com/paper/1412.3555/) (2014)
- [AdaPool: Exponential Adaptive Pooling for Information-Retaining Downsampling](https://mlsanity.com/paper/2111.00772/) (2021)
- [Efficient Bitrate Ladder Construction for Content-Optimized Adaptive Video Streaming](https://mlsanity.com/paper/2102.04550/) (2021)
- [VMAF-based Bitrate Ladder Estimation for Adaptive Streaming](https://mlsanity.com/paper/2103.07564/) (2021)
- [Convex Hull Prediction for Adaptive Video Streaming by Recurrent Learning](https://mlsanity.com/paper/2206.04877/) (2022)
- [Multi-Codec DASH Dataset](https://mlsanity.com/paper/1803.06874/) (2018)

## Abstract (arXiv)

Adaptive video streaming requires efficient bitrate ladder construction to meet heterogeneous network conditions and end-user demands. Per-title optimized encoding typically traverses numerous encoding parameters to search the Pareto-optimal operating points for each video. Recently, researchers have attempted to predict the content-optimized bitrate ladder for pre-encoding overhead reduction. However, existing methods commonly estimate the encoding parameters on the Pareto front and still require subsequent pre-encodings. In this paper, we propose to directly predict the optimal transcoding resolution at each preset bitrate for efficient bitrate ladder construction. We adopt a Temporal Attentive Gated Recurrent Network to capture spatial-temporal features and predict transcoding resolutions as a multi-task classification problem. We demonstrate that content-optimized bitrate ladders can thus be efficiently determined without any pre-encoding. Our method well approximates the ground-truth bitrate-resolution pairs with a slight Bjontegaard Delta rate loss of 1.21% and significantly outperforms the state-of-the-art fixed ladder.
