An Unsupervised Information-Theoretic Perceptual Quality Metric
Not on the map. Why?
Abstract (arXiv)
Tractable models of human perception have proved to be challenging to build. Hand-designed models such as MS-SSIM remain popular predictors of human image quality judgements due to their simplicity and speed. Recent modern deep learning approaches can perform better, but they rely on supervised data which can be costly to gather: large sets of class labels such as ImageNet, image quality ratings, or both. We combine recent advances in information-theoretic objective functions with a computational architecture informed by the physiology of the human visual system and unsupervised training on pairs of video frames, yielding our Perceptual Information Metric (PIM). We show that PIM is competitive with supervised metrics on the recent and challenging BAPPS image quality assessment dataset and outperforms them in predicting the ranking of image compression methods in CLIC 2020. We also perform qualitative experiments using the ImageNet-C dataset, and establish that PIM is robust with respect to architectural details.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 9; 2023: 5; 2024: 6; 2025: 4.
28 papers.
Sort:
By area:
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 90
- 2022An Introduction to Neural Data Compressioncited by 78
- 2021DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimationcited by 48
- 2022Shift-tolerant Perceptual Similarity Metriccited by 44
- 2022A Perceptual Quality Metric for Video Frame Interpolationcited by 15
- 2024Multiscale Sliced Wasserstein Distances as Perceptual Color Difference Measurescited by 14
- 2024Good, Cheap, and Fast: Overfitted Image Compression with Wasserstein Distortioncited by 13
- 2021On the relation between statistical learning and perceptual distancescited by 12
- 2022DeepDC: Deep Distance Correlation as a Perceptual Image Quality Evaluatorcited by 10
- 2022Approaching Peak Ground Truthcited by 8
- 2023Attacking Perceptual Similarity Metricscited by 8
- 2025ChatVis: Large Language Model Agent for Generating Scientific Visualizationscited by 7
16 more
- 2022Identifying and Mitigating Flaws of Deep Perceptual Similarity Metricscited by 4
- 2022Video Coding Using Learned Latent GAN Compressioncited by 4
- 2021Human Imperceptible Attacks and Applications to Improve Fairnesscited by 3
- 2024A Taxonomy of Miscompressions: Preparing Image Forensics for Neural Compressioncited by 3
- 2022Content-Diverse Comparisons improve IQAcited by 2
- 2023The Unreasonable Effectiveness of Linear Prediction as a Perceptual Metriccited by 2
- 2024Assessing invariance to affine transformations in image quality metricscited by 2
- 2021Curiously Effective Features for Image Quality Predictioncited by 1
- 2023Image Statistics Predict the Sensitivity of Perceptual Quality Metricscited by 1
- 2023CPIPS: Learning to Preserve Perceptual Distances in End-to-End Image Compressioncited by 1
- 2025Quality assessment of 3D human animation: Subjective and objective evaluationcited by 1
- 2025Non-Aligned Reference Image Quality Assessment for Novel View Synthesiscited by 1
- 2022Steerable Pyramid Transform Enables Robust Left Ventricle Quantificationcited by 0
- 2024Exploring Compressed Image Representation as a Perceptual Proxy: A Studycited by 0
- 2024Evaluating Perceptual Distance Models by Fitting Binomial Distributions to Two-Alternative Forced Choice Datacited by 0
- 2025Structured Uncertainty Similarity Score (SUSS): Learning a Probabilistic, Interpretable, Perceptual Metric Between Imagescited by 0
- 2025Structured Uncertainty Similarity Score (SUSS): Learning a Probabilistic, Interpretable, Perceptual Metric Between Images3 Dec 2025
- 2025Non-Aligned Reference Image Quality Assessment for Novel View Synthesis11 Nov 2025
- 2025ChatVis: Large Language Model Agent for Generating Scientific Visualizations30 Jul 2025
- 2025Quality assessment of 3D human animation: Subjective and objective evaluation29 May 2025
- 2024Good, Cheap, and Fast: Overfitted Image Compression with Wasserstein Distortion30 Nov 2024
- 2024A Taxonomy of Miscompressions: Preparing Image Forensics for Neural Compression9 Sep 2024
- 2024Assessing invariance to affine transformations in image quality metrics25 Jul 2024
- 2024Multiscale Sliced Wasserstein Distances as Perceptual Color Difference Measures14 Jul 2024
- 2024Evaluating Perceptual Distance Models by Fitting Binomial Distributions to Two-Alternative Forced Choice Data15 Mar 2024
- 2024Exploring Compressed Image Representation as a Perceptual Proxy: A Study14 Jan 2024
- 2023The Unreasonable Effectiveness of Linear Prediction as a Perceptual Metric6 Oct 2023
- 2023CPIPS: Learning to Preserve Perceptual Distances in End-to-End Image Compression1 Oct 2023
16 more
- 2023Attacking Perceptual Similarity Metrics15 May 2023
- 2023Image Statistics Predict the Sensitivity of Perceptual Quality Metrics17 Mar 2023
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Models26 Jan 2023
- 2022Approaching Peak Ground Truth31 Dec 2022
- 2022Content-Diverse Comparisons improve IQA9 Nov 2022
- 2022DeepDC: Deep Distance Correlation as a Perceptual Image Quality Evaluator9 Nov 2022
- 2022A Perceptual Quality Metric for Video Frame Interpolation4 Oct 2022
- 2022Shift-tolerant Perceptual Similarity Metric27 Jul 2022
- 2022Video Coding Using Learned Latent GAN Compression9 Jul 2022
- 2022Identifying and Mitigating Flaws of Deep Perceptual Similarity Metrics6 Jul 2022
- 2022An Introduction to Neural Data Compression14 Feb 2022
- 2022Steerable Pyramid Transform Enables Robust Left Ventricle Quantification20 Jan 2022
- 2021Human Imperceptible Attacks and Applications to Improve Fairness30 Nov 2021
- 2021Curiously Effective Features for Image Quality Prediction10 Jun 2021
- 2021On the relation between statistical learning and perceptual distances8 Jun 2021
- 2021DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimation14 Jan 2021
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 90
- 2022An Introduction to Neural Data Compressioncited by 78
- 2021DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimationcited by 48
- 2022Shift-tolerant Perceptual Similarity Metriccited by 44
- 2022A Perceptual Quality Metric for Video Frame Interpolationcited by 15
- 2024Multiscale Sliced Wasserstein Distances as Perceptual Color Difference Measurescited by 14
- 2024Good, Cheap, and Fast: Overfitted Image Compression with Wasserstein Distortioncited by 13
- 2021On the relation between statistical learning and perceptual distancescited by 12
- 2022DeepDC: Deep Distance Correlation as a Perceptual Image Quality Evaluatorcited by 10
- 2022Approaching Peak Ground Truthcited by 8
- 2023Attacking Perceptual Similarity Metricscited by 8
- 2022Identifying and Mitigating Flaws of Deep Perceptual Similarity Metricscited by 4
12 most cited of 27 All 27 (JSON)
- 2025Structured Uncertainty Similarity Score (SUSS): Learning a Probabilistic, Interpretable, Perceptual Metric Between Images3 Dec 2025
- 2025Non-Aligned Reference Image Quality Assessment for Novel View Synthesis11 Nov 2025
- 2025Quality assessment of 3D human animation: Subjective and objective evaluation29 May 2025
- 2024Good, Cheap, and Fast: Overfitted Image Compression with Wasserstein Distortion30 Nov 2024
- 2024A Taxonomy of Miscompressions: Preparing Image Forensics for Neural Compression9 Sep 2024
- 2024Assessing invariance to affine transformations in image quality metrics25 Jul 2024
- 2024Multiscale Sliced Wasserstein Distances as Perceptual Color Difference Measures14 Jul 2024
- 2024Evaluating Perceptual Distance Models by Fitting Binomial Distributions to Two-Alternative Forced Choice Data15 Mar 2024
- 2024Exploring Compressed Image Representation as a Perceptual Proxy: A Study14 Jan 2024
- 2023The Unreasonable Effectiveness of Linear Prediction as a Perceptual Metric6 Oct 2023
- 2023CPIPS: Learning to Preserve Perceptual Distances in End-to-End Image Compression1 Oct 2023
- 2023Attacking Perceptual Similarity Metrics15 May 2023
12 newest of 27 All 27 (JSON)