mlsanityData to 7 Oct 2026

Image Quality Assessment: Unifying Structure and Texture Similarity

arXiv 2004.07728 ↗First posted 16 Apr 2020cs.CVcited by 792

Not on the map. Why?

Cited by 209 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Objective measures of image quality generally operate by comparing pixels of a "degraded" image to those of the original. Relative to human observers, these measures are overly sensitive to resampling of texture regions (e.g., replacing one patch of grass with another). Here, we develop the first full-reference image quality model with explicit tolerance to texture resampling. Using a convolutional neural network, we construct an injective and differentiable function that transforms images to multi-scale overcomplete representations. We demonstrate empirically that the spatial averages of the feature maps in this representation capture texture appearance, in that they provide a set of sufficient statistical constraints to synthesize a wide variety of texture patterns. We then describe an image quality method that combines correlations of these spatial averages ("texture similarity") with correlations of the feature maps ("structure similarity"). The parameters of the proposed measure are jointly optimized to match human ratings of image quality, while minimizing the reported distances between subimages cropped from the same texture images. Experiments show that the optimized method explains human perceptual scores, both on conventional image quality databases, as well as on texture databases. The measure also offers competitive performance on related tasks such as texture classification and retrieval. Finally, we show that our method is relatively insensitive to geometric transformations (e.g., translation and dilation), without use of any specialized training or data augmentation. Code is available at https://github.com/dingkeyan93/DISTS.

Key facts. Cited by 792 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 29; 2022: 63; 2023: 81; 2024: 156; 2025: 220; 2026: 243.

792 papers.

Sort:

By area:

  1. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  2. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
  3. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
  4. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
  5. 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
  6. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 251
  7. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 243
  8. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
  9. 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
  10. 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
  11. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  12. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
38 more
  1. 2023Dual Aggregation Transformer for Image Super-Resolutioncited by 124
  2. 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 123
  3. 2022Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolutioncited by 114
  4. 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
  5. 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
  6. 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 108
  7. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
  8. 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 98
  9. 2021Image Quality Assessment using Contrastive Learningcited by 95
  10. 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approachcited by 93
  11. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
  12. 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 90
  13. 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 87
  14. 2024TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolutioncited by 83
  15. 2023CoSeR: Bridging Image and Language for Cognitive Super-Resolutioncited by 66
  16. 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
  17. 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 64
  18. 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curationcited by 64
  19. 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restorationcited by 62
  20. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 62
  21. 2023Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolutioncited by 59
  22. 2022Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Networkcited by 57
  23. 2023EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolutioncited by 56
  24. 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Priorcited by 56
  25. 2024Towards Realistic Data Generation for Real-World Super-Resolutioncited by 56
  26. 2021Perceptual Image Quality Assessment with Transformerscited by 54
  27. 2024Adversarial Diffusion Compression for Real-World Image Super-Resolutioncited by 49
  28. 2025Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian Modelingcited by 47
  29. 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Trainingcited by 45
  30. 2022Shift-tolerant Perceptual Similarity Metriccited by 44
  31. 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessmentcited by 43
  32. 2022NTIRE 2022 Challenge on Perceptual Image Quality Assessmentcited by 41
  33. 2024XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolutioncited by 41
  34. 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 41
  35. 2025One Diffusion Step to Real-World Super-Resolution via Flow Trajectory Distillationcited by 40
  36. 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
  37. 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
  38. 2023DocDiff: Document Enhancement via Residual Diffusion Modelscited by 37

50 most cited of 792 All 792 (JSON)