Benchmarking the Robustness of Deep Neural Networks to Common Corruptions in Digital Pathology
Not on the map. Why?
Abstract (arXiv)
When designing a diagnostic model for a clinical application, it is crucial to guarantee the robustness of the model with respect to a wide range of image corruptions. Herein, an easy-to-use benchmark is established to evaluate how deep neural networks perform on corrupted pathology images. Specifically, corrupted images are generated by injecting nine types of common corruptions into validation images. Besides, two classification and one ranking metrics are designed to evaluate the prediction and confidence performance under corruption. Evaluated on two resulting benchmark datasets, we find that (1) a variety of deep neural network models suffer from a significant accuracy decrease (double the error on clean images) and the unreliable confidence estimation on corrupted images; (2) A low correlation between the validation and test errors while replacing the validation set with our benchmark can increase the correlation. Our codes are available on https://github.com/superjamessyx/robustness_benchmark.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 22 of its 34 references that are in the map. First posted on arXiv 30 Jun 2022.
Builds on
22 of 34 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2013Intriguing properties of neural networkscited by 5,114
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
10 more
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,194
- 2018Rotation Equivariant CNNs for Digital Pathologycited by 420
- 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 332
- 2018Why do deep convolutional networks generalize so poorly to small image transformations?cited by 198
- 2021Are Transformers More Robust Than CNNs?cited by 187
- 2016Understanding How Image Quality Affects Deep Neural Networkscited by 118
- 2019Benchmarking the Robustness of Semantic Segmentation Modelscited by 111
- 2021When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarkscited by 41
- 2021Learning domain-agnostic visual representation for computational pathology using medically-irrelevant style transfer augmentationcited by 26
- 2021Benchmarks for Corruption Invariant Person Re-identificationcited by 9
Built on by
Citing papers per year: 2023: 9; 2024: 10; 2025: 4; 2026: 3.
26 papers.
Sort:
By area:
- 2023Attention-Challenging Multiple Instance Learning for Whole Slide Image Classificationcited by 61
- 2023Task-specific Fine-tuning via Variational Information Bottleneck for Weakly-supervised Pathology Whole Slide Image Classificationcited by 54
- 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathologycited by 43
- 2023Domain Generalization in Computational Pathology: Survey and Guidelinescited by 29
- 2024MedMNIST-C: Comprehensive benchmark and improved classifier robustness by simulating realistic image corruptionscited by 17
- 2024A Unified Framework for Microscopy Defocus Deblur with Multi-Pyramid Transformer and Contrastive Learningcited by 13
- 2024Rethinking Transformer for Long Contextual Histopathology Whole Slide Image Analysiscited by 12
- 2024AEM: Attention Entropy Maximization for Multiple Instance Learning based Whole Slide Image Classificationcited by 10
- 2024Are We Ready for Out-of-Distribution Detection in Digital Pathology?cited by 8
- 2024From Correlation to Causation: Max-Pooling-Based Multi-Instance Learning Leads to More Robust Whole Slide Image Classificationcited by 7
- 2023Artifact Restoration in Histology Images with Diffusion Probabilistic Modelscited by 6
- 2023Assessing and Enhancing Robustness of Deep Learning Models with Corruption Emulation in Digital Pathologycited by 6
14 more
- 2024Benchmarking PathCLIP for Pathology Image Analysiscited by 6
- 2023Understanding Silent Failures in Medical Image Classificationcited by 5
- 2025Medical Image Classification with KAN-Integrated Transformers and Dilated Neighborhood Attentioncited by 5
- 2023Feasibility of Universal Anomaly Detection without Knowing the Abnormality in Medical Imagescited by 3
- 2023Long-MIL: Scaling Long Contextual Multiple Instance Learning for Histopathology Whole Slide Image Analysiscited by 3
- 2026Patch-to-Global: Random Patch Diffusion for Globally Consistent Megapixel Artifact Inpainting in Whole Slide Imagescited by 1
- 2023Artifact-Robust Graph-Based Learning in Digital Pathologycited by 0
- 2024Adversary-Robust Graph-Based Learning of WSIscited by 0
- 2024Hallucination Detection in Virtually-Stained Histology: A Latent Space Baselinecited by 0
- 2025Domain Adaptation via Feature Refinementcited by 0
- 2025Joint Deblurring and 3D Reconstruction for Macrophotographycited by 0
- 2025Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimizationcited by 0
- 2026MedQ-Deg: A Multidimensional Benchmark for Evaluating MLLMs Across Medical Image Quality Degradationscited by 0
- 2026Discontinuous Galerkin Neural Operator for Pathology Defocus Deblurringcited by 0
- 2026Patch-to-Global: Random Patch Diffusion for Globally Consistent Megapixel Artifact Inpainting in Whole Slide Images21 Sep 2026
- 2026Discontinuous Galerkin Neural Operator for Pathology Defocus Deblurring22 May 2026
- 2026MedQ-Deg: A Multidimensional Benchmark for Evaluating MLLMs Across Medical Image Quality Degradations8 Mar 2026
- 2025Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimization2 Dec 2025
- 2025Joint Deblurring and 3D Reconstruction for Macrophotography2 Oct 2025
- 2025Domain Adaptation via Feature Refinement22 Aug 2025
- 2025Medical Image Classification with KAN-Integrated Transformers and Dilated Neighborhood Attention19 Feb 2025
- 2024Hallucination Detection in Virtually-Stained Histology: A Latent Space Baseline22 Nov 2024
- 2024Rethinking Transformer for Long Contextual Histopathology Whole Slide Image Analysis18 Oct 2024
- 2024From Correlation to Causation: Max-Pooling-Based Multi-Instance Learning Leads to More Robust Whole Slide Image Classification18 Aug 2024
- 2024Are We Ready for Out-of-Distribution Detection in Digital Pathology?18 Jul 2024
- 2024MedMNIST-C: Comprehensive benchmark and improved classifier robustness by simulating realistic image corruptions25 Jun 2024
14 more
- 2024AEM: Attention Entropy Maximization for Multiple Instance Learning based Whole Slide Image Classification18 Jun 2024
- 2024Adversary-Robust Graph-Based Learning of WSIs21 Mar 2024
- 2024A Unified Framework for Microscopy Defocus Deblur with Multi-Pyramid Transformer and Contrastive Learning5 Mar 2024
- 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathology29 Jan 2024
- 2024Benchmarking PathCLIP for Pathology Image Analysis5 Jan 2024
- 2023Long-MIL: Scaling Long Contextual Multiple Instance Learning for Histopathology Whole Slide Image Analysis21 Nov 2023
- 2023Attention-Challenging Multiple Instance Learning for Whole Slide Image Classification13 Nov 2023
- 2023Assessing and Enhancing Robustness of Deep Learning Models with Corruption Emulation in Digital Pathology31 Oct 2023
- 2023Domain Generalization in Computational Pathology: Survey and Guidelines30 Oct 2023
- 2023Artifact-Robust Graph-Based Learning in Digital Pathology27 Oct 2023
- 2023Understanding Silent Failures in Medical Image Classification27 Jul 2023
- 2023Artifact Restoration in Histology Images with Diffusion Probabilistic Models26 Jul 2023
- 2023Feasibility of Universal Anomaly Detection without Knowing the Abnormality in Medical Images3 Jul 2023
- 2023Task-specific Fine-tuning via Variational Information Bottleneck for Weakly-supervised Pathology Whole Slide Image Classification15 Mar 2023
- 2023Attention-Challenging Multiple Instance Learning for Whole Slide Image Classificationcited by 61
- 2023Task-specific Fine-tuning via Variational Information Bottleneck for Weakly-supervised Pathology Whole Slide Image Classificationcited by 54
- 2023Domain Generalization in Computational Pathology: Survey and Guidelinescited by 29
- 2024MedMNIST-C: Comprehensive benchmark and improved classifier robustness by simulating realistic image corruptionscited by 17
- 2024A Unified Framework for Microscopy Defocus Deblur with Multi-Pyramid Transformer and Contrastive Learningcited by 13
- 2024Rethinking Transformer for Long Contextual Histopathology Whole Slide Image Analysiscited by 12
- 2024AEM: Attention Entropy Maximization for Multiple Instance Learning based Whole Slide Image Classificationcited by 10
- 2024Are We Ready for Out-of-Distribution Detection in Digital Pathology?cited by 8
- 2024From Correlation to Causation: Max-Pooling-Based Multi-Instance Learning Leads to More Robust Whole Slide Image Classificationcited by 7
- 2023Assessing and Enhancing Robustness of Deep Learning Models with Corruption Emulation in Digital Pathologycited by 6
- 2024Benchmarking PathCLIP for Pathology Image Analysiscited by 6
- 2023Understanding Silent Failures in Medical Image Classificationcited by 5
12 most cited of 22 All 22 (JSON)
- 2026Patch-to-Global: Random Patch Diffusion for Globally Consistent Megapixel Artifact Inpainting in Whole Slide Images21 Sep 2026
- 2026Discontinuous Galerkin Neural Operator for Pathology Defocus Deblurring22 May 2026
- 2025Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimization2 Dec 2025
- 2025Joint Deblurring and 3D Reconstruction for Macrophotography2 Oct 2025
- 2025Domain Adaptation via Feature Refinement22 Aug 2025
- 2024Hallucination Detection in Virtually-Stained Histology: A Latent Space Baseline22 Nov 2024
- 2024Rethinking Transformer for Long Contextual Histopathology Whole Slide Image Analysis18 Oct 2024
- 2024From Correlation to Causation: Max-Pooling-Based Multi-Instance Learning Leads to More Robust Whole Slide Image Classification18 Aug 2024
- 2024Are We Ready for Out-of-Distribution Detection in Digital Pathology?18 Jul 2024
- 2024MedMNIST-C: Comprehensive benchmark and improved classifier robustness by simulating realistic image corruptions25 Jun 2024
- 2024AEM: Attention Entropy Maximization for Multiple Instance Learning based Whole Slide Image Classification18 Jun 2024
- 2024Adversary-Robust Graph-Based Learning of WSIs21 Mar 2024
12 newest of 22 All 22 (JSON)