mlsanityData to 7 Oct 2026

Bridging the Gap Between Saliency Prediction and Image Quality Assessment

arXiv 2405.04997 ↗First posted 8 May 2024cs.CV eess.IVcited by 1

Not on the map. Why?

Abstract (arXiv)

Over the past few years, deep neural models have made considerable advances in image quality assessment (IQA). However, the underlying reasons for their success remain unclear, owing to the complex nature of deep neural networks. IQA aims to describe how the human visual system (HVS) works and to create its efficient approximations. On the other hand, Saliency Prediction task aims to emulate HVS via determining areas of visual interest. Thus, we believe that saliency plays a crucial role in human perception. In this work, we conduct an empirical study that reveals the relation between IQA and Saliency Prediction tasks, demonstrating that the former incorporates knowledge of the latter. Moreover, we introduce a novel SACID dataset of saliency-aware compressed images and conduct a large-scale comparison of classic and neural-based IQA methods. All supplementary code and data will be available at the time of publication.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 55 references that are in the map. First posted on arXiv 8 May 2024.

Builds on

32 of 55 references.

References · 32

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  4. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  5. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  6. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  7. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  8. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  9. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  10. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  11. 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 467
  12. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
20 more
  1. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
  2. 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
  3. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
  4. 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
  5. 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
  6. 2018PieAPP: Perceptual Image-Error Assessment through Pairwise Preferencecited by 158
  7. 2019Sanity Checks for Saliency Metricscited by 119
  8. 2022A Consistent and Efficient Evaluation Strategy for Attribution Methodscited by 100
  9. 2020Use HiResCAM instead of Grad-CAM for faithful explanations of convolutional neural networkscited by 79
  10. 2022Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Networkcited by 57
  11. 2015CAT2000: A Large Scale Fixation Dataset for Boosting Saliency Researchcited by 52
  12. 2019Contextual Encoder-Decoder Network for Visual Saliency Predictioncited by 44
  13. 2021TranSalNet: Towards perceptually relevant visual saliency predictioncited by 44
  14. 2022Saliency Attack: Towards Imperceptible Black-box Adversarial Attackcited by 12
  15. 2021A survey on IQAcited by 6
  16. 2022HVS Revisited: A Comprehensive Video Quality Assessment Frameworkcited by 5
  17. 2019NormGrad: Finding the Pixels that Matter for Trainingcited by 4
  18. 2023Saliency-Aware Spatio-Temporal Artifact Detection for Compressed Video Quality Assessmentcited by 3
  19. 2023UGC Quality Assessment: Exploring the Impact of Saliency in Deep Feature-Based Quality Assessmentcited by 2
  20. 2023Half of an image is enough for quality assessmentcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.