mlsanityData to 7 Oct 2026

Scale Contrastive Learning with Selective Attentions for Blind Image Quality Assessment

arXiv 2411.09007 ↗First posted 13 Nov 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Human visual perception naturally evaluates image quality across multiple scales, a hierarchical process that existing blind image quality assessment (BIQA) algorithms struggle to replicate effectively. This limitation stems from a fundamental misunderstanding: current multi-scale approaches fail to recognize that quality perception varies dramatically between scales -- what appears degraded when viewed closely may look acceptable from a distance. This inconsistency not only creates misleading ``visual illusions'' during feature fusion but also introduces substantial redundant information that dilutes quality-critical features and leads to imprecise assessments. Our CSFIQA framework advances multi-scale BIQA via two key innovations: (1) a selective focus attention mechanism that mimics human visual attention by filtering out redundant cross-scale information that would otherwise mask subtle quality indicators, and (2) a scale contrastive learning strategy that explicitly learns to distinguish quality variations both across and within scales. By incorporating an adaptive noise sample matching mechanism, CSFIQA effectively identifies perceptual quality discrepancies in the same content viewed at different scales. Experiments demonstrate substantial improvements over state-of-the-art methods across seven datasets, achieving up to 8.8% SRCC improvement on challenging real-world distortions, confirming CSFIQA's superior alignment with human quality perception.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 13 Nov 2024.

Builds on

19 of 33 references.

References · 19

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  3. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  4. 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
  5. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  6. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
  7. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
  8. 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 224
  9. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
  10. 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
  11. 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
  12. 2020MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessmentcited by 144
7 more
  1. 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
  2. 2021Image Quality Assessment using Contrastive Learningcited by 95
  3. 2023Data-Efficient Image Quality Assessment with Attention-Panel Decodercited by 49
  4. 2023Frozen Transformers in Language Models Are Effective Visual Encoder Layerscited by 39
  5. 2022Perceptual Attacks of No-Reference Image Quality Models with Human-in-the-Loopcited by 30
  6. 2022Exploring and Evaluating Image Restoration Potential in Dynamic Scenescited by 8
  7. 2023Adaptive Feature Selection for No-Reference Image Quality Assessment by Mitigating Semantic Noise Sensitivitycited by 8

Built on by

Not cited yet.