FDIM: A Feature-distance-based Generic Video Quality Metric for Versatile Codecs
Not on the map. Why?
Abstract (arXiv)
Video technology is advancing toward Ultra High Definition (UHD) and High Dynamic Range (HDR), which intensifies the need for higher compression efficiency for these high-specification videos. Beyond advances in traditional codecs, neural video codecs (NVCs) have attracted significant research attention and have evolved rapidly over the past few years. The coding artifacts of NVCs often exhibit content-varying and generative characteristics, which differ from those of conventional codecs and are challenging for traditional video quality assessment (VQA) methods to capture. Therefore, VQA metrics are required to generalize across different codecs, content types, and dynamic ranges to better support video codec research and evaluation. In this paper, we propose FDIM, a feature-distance-based generic video quality metric for both traditional and neural video codecs across SDR and HDR formats. FDIM employs a hybrid architecture that integrates deep and hand-crafted features. The deep feature component learns multi-scale representations to capture distortions ranging from structural and textural fidelity degradation to high-level semantic deviations, while the hand-crafted feature component provides stable complementary cues to improve overall generalization. We trained FDIM on a large-scale subjective quality assessment dataset (DCVQA) consisting of over 16k video sequences encoded by traditional block-based hybrid video codecs and end-to-end perceptually optimized neural video codecs. Extensive experiments on ten SDR/HDR VQA datasets containing diverse, previously unseen codecs demonstrate that FDIM achieves strong generalization and high correlation with subjective assessment. The source code for FDIM and the DCVQA validation set will be released at https://github.com/MCL-ZJU/FDIM.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 66 references that are in the map. First posted on arXiv 27 Apr 2026.
Builds on
39 of 66 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2022Generative Adversarial Networkscited by 5,627
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2017Deformable Convolutional Networkscited by 1,488
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2017The Perception-Distortion Tradeoffcited by 587
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 332
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
- 2019Quality Assessment of In-the-Wild Videoscited by 164
27 more
- 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 153
- 2024Neural Video Compression with Feature Modulationcited by 123
- 2025Towards Practical Real-Time Neural Video Compressioncited by 80
- 2019dipIQ: Blind Image Quality Assessment by Learning-to-Rank Discriminable Image Pairscited by 73
- 2022Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Networkcited by 57
- 2020A Technical Overview of AV1cited by 47
- 2022DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessmentcited by 41
- 2023HDR-VDP-3: A multi-metric for predicting image differences, quality and contrast distortions in high dynamic range and regular contentcited by 41
- 2024ColorVideoVDP: A visual difference predictor for image, video and display distortionscited by 34
- 2022AlphaVC: High-Performance and Efficient Learned Video Compressioncited by 28
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2022CONVIQT: Contrastive Video Quality Estimatorcited by 19
- 2018SpatioTemporal Feature Integration and Model Fusion for Full Reference Video Quality Assessmentcited by 18
- 2021StarVQA: Space-Time Attention for Video Quality Assessmentcited by 15
- 2022RankDVQA: Deep VQA based on Ranking-inspired Hybrid Trainingcited by 14
- 2020Perceptual Video Quality Prediction Emphasizing Chroma Distortionscited by 10
- 2023One Transform To Compute Them All: Efficient Fusion-Based Full-Reference Video Quality Assessmentcited by 9
- 2018Towards Perceptually Optimized End-to-end Adaptive Video Streamingcited by 8
- 2021Enhancing VMAF through New Feature Integration and Model Combinationcited by 7
- 2023HIDRO-VQA: High Dynamic Range Oracle for Video Quality Assessmentcited by 7
- 2025CompressedVQA-HDR: Generalized Full-reference and No-reference Quality Assessment Models for Compressed High Dynamic Range Videoscited by 5
- 2023A FUNQUE Approach to the Quality Assessment of Compressed HDR Videoscited by 4
- 2021High Frame Rate Video Quality Assessment using VMAF and Entropic Differencescited by 3
- 2025Subjective Visual Quality Assessment for High-Fidelity Learning-Based Image Compressioncited by 3
- 2023Full Reference Video Quality Assessment for Machine Learning-Based Video Codecscited by 2
- 2025Evaluating Video Quality Metrics for Neural and Traditional Codecs using 4K/UHD-1 Videoscited by 2
- 2024Adapting Pretrained Networks for Image Quality Assessment on High Dynamic Range Displayscited by 1
Built on by
Not cited yet.