PathoWAve: A Deep Learning-based Weight Averaging Method for Improving Domain Generalization in Histopathology Images
Not on the map. Why?
Abstract (arXiv)
Recent advancements in deep learning (DL) have significantly advanced medical image analysis. In the field of medical image processing, particularly in histopathology image analysis, the variation in staining protocols and differences in scanners present significant domain shift challenges, undermine the generalization capabilities of models to the data from unseen domains, prompting the need for effective domain generalization (DG) strategies to improve the consistency and reliability of automated cancer detection tools in diagnostic decision-making. In this paper, we introduce Pathology Weight Averaging (PathoWAve), a multi-source DG strategy for addressing domain shift phenomenon of DL models in histopathology image analysis. Integrating specific weight averaging technique with parallel training trajectories and a strategically combination of regular augmentations with histopathology-specific data augmentation methods, PathoWAve enables a comprehensive exploration and precise convergence within the loss landscape. This method significantly enhanced generalization capabilities of DL models across new, unseen histopathology domains. To the best of our knowledge, PathoWAve is the first proposed weight averaging method for DG in histopathology image analysis. Our quantitative results on Camelyon17 WILDS dataset demonstrate PathoWAve's superiority over previous proposed methods to tackle the domain shift phenomenon in histopathology image processing. Our code is available at urlhttps://github.com/ParastooSotoudeh/PathoWAve.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 27 references that are in the map. First posted on arXiv 21 Jun 2024.
Builds on
27 of 27 references.
References · 27
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2019Invariant Risk Minimizationcited by 1,832
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
- 2021Domain Generalization: A Surveycited by 760
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
- 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
- 2019Lookahead Optimizer: k steps forward, 1 step backcited by 333
- 2020Learning to Generate Novel Domains for Domain Generalizationcited by 296
15 more
- 2021The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networkscited by 285
- 2021Gradient Matching for Domain Generalizationcited by 258
- 2019Adversarial Domain Adaptation with Domain Mixupcited by 250
- 2021Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalizationcited by 220
- 2022Improving Out-of-Distribution Robustness via Selective Augmentationcited by 202
- 2021SelfReg: Self-supervised Contrastive Regularization for Domain Generalizationcited by 189
- 2019Domain Generalization Using a Mixture of Multiple Latent Domainscited by 170
- 2018Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networkscited by 57
- 2021Learning domain-agnostic visual representation for computational pathology using medically-irrelevant style transfer augmentationcited by 26
- 2022Test-time image-to-image translation ensembling improves out-of-distribution generalization in histopathologycited by 13
- 2023TFS-ViT: Token-Level Feature Stylization for Domain Generalizationcited by 10
- 2023EPVT: Environment-aware Prompt Vision Transformer for Domain Generalization in Skin Lesion Recognitioncited by 9
- 2023Lookaround Optimizer: k steps around, 1 step averagecited by 9
- 2024Prompt-driven Latent Domain Generalization for Medical Image Classificationcited by 8
- 2023Histopathological Image Analysis with Style-Augmented Feature Domain Mixing for Improved Generalizationcited by 1
Built on by
Not cited yet.