A Study and Comparison of Human and Deep Learning Recognition Performance Under Visual Distortions
Not on the map. Why?
Abstract (arXiv)
Deep neural networks (DNNs) achieve excellent performance on standard classification tasks. However, under image quality distortions such as blur and noise, classification accuracy becomes poor. In this work, we compare the performance of DNNs with human subjects on distorted images. We show that, although DNNs perform better than or on par with humans on good quality images, DNN performance is still much lower than human performance on distorted images. We additionally find that there is little correlation in errors between DNNs and human subjects. This could be an indication that the internal representation of images are different between DNNs and the human visual system. These comparisons with human performance could be used to guide future development of more robust DNNs.
Key facts. Cited by 107 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 23; 2023: 26; 2024: 12; 2025: 9; 2026: 5.
107 papers.
Sort:
By area:
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Partial success in closing the gap between human and machine visioncited by 185
- 20223D Common Corruptions and Data Augmentationcited by 120
- 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 98
- 2022Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervisioncited by 80
- 2022Human alignment of neural network representationscited by 74
- 2021On the effectiveness of adversarial training against common corruptionscited by 71
- 2023On the Design Fundamentals of Diffusion Models: A Surveycited by 59
- 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
- 2021If your data distribution shifts, use self-learningcited by 36
- 2022Enhancing Diffusion-Based Image Synthesis with Robust Classifier Guidancecited by 33
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
38 more
- 2023MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognitioncited by 26
- 2021Robustness via Cross-Domain Ensemblescited by 23
- 2022Do Perceptually Aligned Gradients Imply Adversarial Robustness?cited by 15
- 2023Self-attention in Vision Transformers Performs Perceptual Grouping, Not Attentioncited by 15
- 2023Neural Architecture Design and Robustness: A Datasetcited by 15
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responsescited by 15
- 2022Progress and limitations of deep networks to recognize objects in unusual posescited by 13
- 2021Comparing object recognition in humans and deep convolutional neural networks -- An eye tracking studycited by 12
- 2021Anti-aliasing Deep Image Classifiers using Novel Depth Adaptive Blurring and Activation Functioncited by 11
- 2021DeepAdversaries: Examining the Robustness of Deep Learning Models for Galaxy Morphology Classificationcited by 10
- 2023Rapid Network Adaptation: Learning to Adapt Neural Networks Using Test-Time Feedbackcited by 10
- 2021Rethinking Natural Adversarial Examples for Classification Modelscited by 9
- 2021Benchmarks for Corruption Invariant Person Re-identificationcited by 9
- 2024MomentumSMoE: Integrating Momentum into Sparse Mixture of Expertscited by 9
- 2021Closer Look at the Uncertainty Estimation in Semantic Segmentation under Distributional Shiftcited by 8
- 2021Failure Modes of Domain Generalization Algorithmscited by 8
- 2022Test-time Batch Normalizationcited by 8
- 2023DeepAstroUDA: Semi-Supervised Universal Domain Adaptation for Cross-Survey Galaxy Morphology Classification and Anomaly Detectioncited by 8
- 2024Imperceptible Protection against Style Imitation from Diffusion Modelscited by 8
- 2021Inverse Problems Leveraging Pre-trained Contrastive Representationscited by 7
- 2022A Survey on Infrared Image and Video Setscited by 7
- 2022A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challengescited by 7
- 2022Adversarial Framework with Certified Robustness for Time-Series Domain via Statistical Featurescited by 7
- 2022Runtime Monitoring for Out-of-Distribution Detection in Object Detection Neural Networkscited by 7
- 2021Contemplating real-world object classificationcited by 6
- 2022Pyramid Frequency Network with Spatial Attention Residual Refinement Module for Monocular Depth Estimationcited by 6
- 2023Generalizable Lightweight Proxy for Robust NAS against Diverse Perturbationscited by 6
- 2023Instilling Inductive Biases with Subnetworkscited by 6
- 2021CheXternal: Generalization of Deep Learning Models for Chest X-ray Interpretation to Photos of Chest X-rays and External Clinical Settingscited by 5
- 2021Combining Different V1 Brain Model Variants to Improve Robustness to Image Corruptions in CNNscited by 5
- 2022Does lossy image compression affect racial bias within face recognition?cited by 5
- 2022Data Models for Dataset Drift Controls in Machine Learning With Optical Imagescited by 5
- 2023Class-Conditioned Transformation for Enhanced Robust Image Classificationcited by 5
- 2023Training on Foveated Images Improves Robustness to Adversarial Attackscited by 5
- 2021Towards Corruption-Agnostic Robust Domain Adaptationcited by 4
- 2023Investigating the Corruption Robustness of Image Classifiers with Random Lp-norm Corruptionscited by 4
- 2023Cycle Consistency-based Uncertainty Quantification of Neural Networks in Inverse Imaging Problemscited by 4
- 2024Algorithmic Ways of Seeing: Using Object Detection to Facilitate Art Explorationcited by 4
50 most cited of 107 All 107 (JSON)
- 2026Evolution of Accuracy and Visual-Cognitive Errors in a Decade of Vision-Language AI Models10 Jul 2026
- 2026Vulnerability of Natural Language Classifiers to Evolutionary Generated Adversarial Text25 Jun 2026
- 2026Distilling Vision Transformers for Distortion-Robust Representation Learning24 Apr 2026
- 2026ClipTTT: CLIP-Guided Test-Time Training Helps LVLMs See Better27 Mar 2026
- 2026Do Machines Fail Like Humans? A Human-Centred Out-of-Distribution Spectrum for Mapping Error Alignment8 Mar 2026
- 2025Improving Artifact Robustness for CT Deep Learning Models Without Labeled Artifact Images via Domain Adaptation8 Oct 2025
- 2025Assessing Foundation Models for Mold Colony Detection with Limited Training Data1 Oct 2025
- 2025Quantization Robustness to Input Degradations for Object Detection27 Aug 2025
- 2025Deep Recurrence for Dynamical Segmentation Models14 Jul 2025
- 2025SNAP: A Benchmark for Testing the Effects of Capture Conditions on Fundamental Vision Tasks21 May 2025
- 2025Disruptive Transformation of Artworks in Master-Disciple Relationships: The Case of Ukiyo-e Artworks13 May 2025
- 2025Robusto-1 Dataset: Comparing Humans and VLMs on real out-of-distribution Autonomous Driving VQA from Peru10 Mar 2025
38 more
- 2025From Fog to Failure: The Unintended Consequences of Dehazing on Object Detection in Clear Images4 Feb 2025
- 2025Disentangling Safe and Unsafe Corruptions via Anisotropy and Locality30 Jan 2025
- 2024MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts18 Oct 2024
- 2024Classification-Denoising Networks4 Oct 2024
- 2024Perceptual Piercing: Human Visual Cue-based Object Detection in Low Visibility Conditions2 Oct 2024
- 2024Collaboratively Learning Federated Models from Noisy Decentralized Data3 Sep 2024
- 2024Improved Few-Shot Image Classification Through Multiple-Choice Questions23 Jul 2024
- 2024Towards Robust Training Datasets for Machine Learning with Ontologies: A Case Study for Emergency Road Vehicle Detection21 Jun 2024
- 2024A Comprehensive Survey of Foundation Models in Medicine15 Jun 2024
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responses7 Jun 2024
- 2024TEL'M: Test and Evaluation of Language Models16 Apr 2024
- 2024Imperceptible Protection against Style Imitation from Diffusion Models28 Mar 2024
- 2024Algorithmic Ways of Seeing: Using Object Detection to Facilitate Art Exploration28 Mar 2024
- 2024Comparing supervised learning dynamics: Deep neural networks match human data efficiency but show a generalisation lag14 Feb 2024
- 2023Towards Improving Robustness Against Common Corruptions using Mixture of Class Specific Experts16 Nov 2023
- 2023Towards Improving Robustness Against Common Corruptions in Object Detectors Using Adversarial Contrastive Learning14 Nov 2023
- 2023Improving Robustness via Tilted Exponential Layer: A Communication-Theoretic Perspective2 Nov 2023
- 2023Dynamic Batch Norm Statistics Update for Natural Robustness31 Oct 2023
- 2023From the Pursuit of Universal AGI Architecture to Systematic Approach to Heterogenous AGI: Addressing Alignment, Energy, & AGI Grand Challenges23 Oct 2023
- 2023Enhancing the machine vision performance with multi-spectral light sources20 Oct 2023
- 2023Instilling Inductive Biases with Subnetworks17 Oct 2023
- 2023Matching the Neuronal Representations of V1 is Necessary to Improve Robustness in CNNs with V1-like Front-ends16 Oct 2023
- 2023Seeking Next Layer Neurons' Attention for Error-Backpropagation-Like Training in a Multi-Agent Network Framework15 Oct 2023
- 2023Rapid Network Adaptation: Learning to Adapt Neural Networks Using Test-Time Feedback27 Sep 2023
- 2023What's color got to do with it? Face recognition in grayscale11 Sep 2023
- 2023Expecting The Unexpected: Towards Broad Out-Of-Distribution Detection22 Aug 2023
- 2023Training on Foveated Images Improves Robustness to Adversarial Attacks1 Aug 2023
- 2023Residual Feature Pyramid Network for Enhancement of Vascular Patterns29 Jun 2023
- 2023Group-based Robustness: A General Framework for Customized Robustness in the Real World29 Jun 2023
- 2023Modularity Trumps Invariance for Compositional Robustness15 Jun 2023
- 2023Neural Architecture Design and Robustness: A Dataset11 Jun 2023
- 2023Generalizable Lightweight Proxy for Robust NAS against Diverse Perturbations8 Jun 2023
- 2023On the Design Fundamentals of Diffusion Models: A Survey7 Jun 2023
- 2023Cycle Consistency-based Uncertainty Quantification of Neural Networks in Inverse Imaging Problems22 May 2023
- 2023Noise robust neural network architecture16 May 2023
- 2023MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognition12 May 2023
- 2023Investigating the Corruption Robustness of Image Classifiers with Random Lp-norm Corruptions9 May 2023
- 2023Class-Conditioned Transformation for Enhanced Robust Image Classification27 Mar 2023
50 newest of 107 All 107 (JSON)
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Partial success in closing the gap between human and machine visioncited by 185
- 20223D Common Corruptions and Data Augmentationcited by 120
- 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 98
- 2022Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervisioncited by 80
- 2022Human alignment of neural network representationscited by 74
- 2021On the effectiveness of adversarial training against common corruptionscited by 71
- 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
- 2021If your data distribution shifts, use self-learningcited by 36
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
- 2023MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognitioncited by 26
- 2021Robustness via Cross-Domain Ensemblescited by 23
- 2022Do Perceptually Aligned Gradients Imply Adversarial Robustness?cited by 15
12 most cited of 99 All 99 (JSON)
- 2026Vulnerability of Natural Language Classifiers to Evolutionary Generated Adversarial Text25 Jun 2026
- 2026Distilling Vision Transformers for Distortion-Robust Representation Learning24 Apr 2026
- 2026Do Machines Fail Like Humans? A Human-Centred Out-of-Distribution Spectrum for Mapping Error Alignment8 Mar 2026
- 2025Improving Artifact Robustness for CT Deep Learning Models Without Labeled Artifact Images via Domain Adaptation8 Oct 2025
- 2025Assessing Foundation Models for Mold Colony Detection with Limited Training Data1 Oct 2025
- 2025Quantization Robustness to Input Degradations for Object Detection27 Aug 2025
- 2025Deep Recurrence for Dynamical Segmentation Models14 Jul 2025
- 2025SNAP: A Benchmark for Testing the Effects of Capture Conditions on Fundamental Vision Tasks21 May 2025
- 2025Disruptive Transformation of Artworks in Master-Disciple Relationships: The Case of Ukiyo-e Artworks13 May 2025
- 2025From Fog to Failure: The Unintended Consequences of Dehazing on Object Detection in Clear Images4 Feb 2025
- 2025Disentangling Safe and Unsafe Corruptions via Anisotropy and Locality30 Jan 2025
- 2024Classification-Denoising Networks4 Oct 2024
12 newest of 99 All 99 (JSON)