No-Reference Image Quality Assessment with Global-Local Progressive Integration and Semantic-Aligned Quality Transfer
Not on the map. Why?
Abstract (arXiv)
Accurate measurement of image quality without reference signals remains a fundamental challenge in low-level visual perception applications. In this paper, we propose a global-local progressive integration model that addresses this challenge through three key contributions: 1) We develop a dual-measurement framework that combines vision Transformer (ViT)-based global feature extractor and convolutional neural networks (CNNs)-based local feature extractor to comprehensively capture and quantify image distortion characteristics at different granularities. 2) We propose a progressive feature integration scheme that utilizes multi-scale kernel configurations to align global and local features, and progressively aggregates them via an interactive stack of channel-wise self-attention and spatial interaction modules for multi-grained quality-aware representations. 3) We introduce a semantic-aligned quality transfer method that extends the training data by automatically labeling the quality scores of diverse image content with subjective opinion scores. Experimental results demonstrate that our model yields 5.04% and 5.40% improvements in Spearman's rank-order correlation coefficient (SROCC) for cross-authentic and cross-synthetic dataset generalization tests, respectively. Furthermore, the proposed semantic-aligned quality transfer further yields 2.26% and 13.23% performance gains in evaluations on single-synthetic and cross-synthetic datasets.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 52 references that are in the map. First posted on arXiv 7 Aug 2024.
Builds on
19 of 52 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 566
- 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
- 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 224
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
- 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
7 more
- 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 150
- 2020Transformer for Image Quality Assessmentcited by 76
- 2023Data-Efficient Image Quality Assessment with Attention-Panel Decodercited by 49
- 2022MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusioncited by 10
- 2022REQA: Coarse-to-fine Assessment of Image Quality to Alleviate the Range Effectcited by 6
- 2023Blind Image Quality Assessment via Transformer Predicted Error Map and Perceptual Quality Tokencited by 5
- 2023Regression-free Blind Image Quality Assessment with Content-Distortion Consistencycited by 2
Built on by
Not cited yet.