S2S2: Semantic Stacking for Robust Semantic Segmentation in Medical Imaging
Not on the map. Why?
Abstract (arXiv)
Robustness and generalizability in medical image segmentation are often hindered by scarcity and limited diversity of training data, which stands in contrast to the variability encountered during inference. While conventional strategies -- such as domain-specific augmentation, specialized architectures, and tailored training procedures -- can alleviate these issues, they depend on the availability and reliability of domain knowledge. When such knowledge is unavailable, misleading, or improperly applied, performance may deteriorate. In response, we introduce a novel, domain-agnostic, add-on, and data-driven strategy inspired by image stacking in image denoising. Termed ``semantic stacking,'' our method estimates a denoised semantic representation that complements the conventional segmentation loss during training. This method does not depend on domain-specific assumptions, making it broadly applicable across diverse image modalities, model architectures, and augmentation techniques. Through extensive experiments, we validate the superiority of our approach in improving segmentation performance under diverse conditions. Code is available at https://github.com/ymp5078/Semantic-Stacking.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 43 of its 61 references that are in the map. First posted on arXiv 17 Dec 2024.
Builds on
43 of 61 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2022Generative Adversarial Networkscited by 5,627
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
31 more
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
- 2018AutoAugment: Learning Augmentation Policies from Datacited by 730
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 589
- 2021Domain Generalization with MixStylecited by 566
- 2020PraNet: Parallel Reverse Attention Network for Polyp Segmentationcited by 460
- 2019Domain Generalization by Solving Jigsaw Puzzlescited by 450
- 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
- 2021ResNet strikes back: An improved training procedure in timmcited by 368
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 309
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 273
- 2018Attention Gated Networks: Learning to Leverage Salient Regions in Medical Imagescited by 272
- 2018Generative Adversarial Network in Medical Imaging: A Reviewcited by 257
- 2015Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networkscited by 214
- 2020Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scanscited by 158
- 2020Robust and Generalizable Visual Representation Learning via Random Convolutionscited by 142
- 2021MSRF-Net: A Multi-Scale Residual Fusion Network for Biomedical Image Segmentationcited by 53
- 2021Generalizable Cross-modality Medical Image Segmentation via Style Augmentation and Dual Normalizationcited by 46
- 2022FCN-Transformer Feature Fusion for Polyp Segmentationcited by 37
- 2022Can segmentation models be trained with fully synthetically generated data?cited by 37
- 2018Data Augmentation for Skin Lesion Analysiscited by 28
- 2019Impact of Adversarial Examples on Deep Learning Models for Biomedical Image Segmentationcited by 26
- 2020Automatic Data Augmentation for 3D Medical Image Segmentationcited by 22
- 2022AADG: Automatic Augmentation for Domain Generalization on Retinal Image Segmentationcited by 18
- 2018High-resolution medical image synthesis using progressively grown generative adversarial networkscited by 17
- 2020Searching Learning Strategy with Reinforcement Learning for 3D Medical Image Segmentationcited by 17
- 2020Automatic Data Augmentation via Deep Reinforcement Learning for Effective Kidney Tumor Segmentationcited by 8
- 2023Multi-Level Global Context Cross Consistency Model for Semi-Supervised Ultrasound Image Segmentation with Diffusion Modelcited by 8
- 2023Shape-guided Conditional Latent Diffusion Models for Synthesising Brain Vasculaturecited by 5
Built on by
Citing papers per year: 2025: 2.
2 papers.