# IVCA: Inter-Relation-Aware Video Complexity Analyzer

arXiv: https://arxiv.org/abs/2407.00280 · HTML: https://mlsanity.com/paper/2407.00280/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 7 of its 19 references that are in the map.
- First posted on arXiv 29 Jun 2024.

## Builds on (most cited first, 7 of 7)

- [Grid Search, Random Search, Genetic Algorithm: A Big Comparison for NAS](https://mlsanity.com/paper/1912.06059/) (2019)
- [BVI-DVC: A Training Database for Deep Video Compression](https://mlsanity.com/paper/2003.13552/) (2020)
- [AdaPool: Exponential Adaptive Pooling for Information-Retaining Downsampling](https://mlsanity.com/paper/2111.00772/) (2021)
- [Object Segmentation-Assisted Inter Prediction for Versatile Video Coding](https://mlsanity.com/paper/2403.11694/) (2024)
- [An Efficient Four-Parameter Affine Motion Model for Video Coding](https://mlsanity.com/paper/1702.06297/) (2017)
- [Green Video Complexity Analysis for Efficient Encoding in Adaptive Video Streaming](https://mlsanity.com/paper/2304.12384/) (2023)
- [Video Quality Assessment with Texture Information Fusion for Streaming Applications](https://mlsanity.com/paper/2302.14465/) (2023)

## Abstract (arXiv)

To address the real-time analysis requirements of video streaming applications, we propose an innovative inter-relation-aware video complexity analyzer (IVCA) to enhance the existing video complexity analyzer (VCA). The IVCA overcomes the limitations of the VCA by incorporating inter-frame relations, focusing on inter motion and reference structure. To begin with, we improve the accuracy of temporal features by integrating feature-domain motion estimation into the IVCA framework, which allows for a more nuanced understanding of motion across frames. Furthermore, inspired by the hierarchical reference structures utilized in modern codecs, we introduce layer-aware weights that effectively adjust the contributions of frame complexity across different layers, ensuring a more balanced representation of video characteristics. In addition, we broaden the analysis of temporal features by considering reference frames rather than relying solely on the preceding frame, thereby enriching the contextual understanding of video content. Experimental results demonstrate a significant enhancement in complexity estimation accuracy achieved by the IVCA, coupled with a negligible increase in time complexity, indicating its potential for real-time applications in video streaming scenarios. This advancement not only improves video processing efficiency but also paves the way for more sophisticated analytical tools in video technology.
