mlsanityData to 14 Oct 2026

Switched auxiliary loss for robust training of transformer models for histopathological image segmentation

arXiv 2308.10994 ↗First posted 21 Aug 2023eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Functional tissue Units (FTUs) are cell population neighborhoods local to a particular organ performing its main function.The FTUs provide crucial information to the pathologist in understanding the disease affecting a particular organ by providing information at the cellular level.In our research, we have developed a model to segment multi-organ FTUs across 5 organs namely: the kidney, large intestine, lung, prostate and spleen by utilizing the 'HuBMAP + HPA - Hacking the Human Body' competition dataset.We propose adding switched auxiliary loss for training models like the transformers to overcome the diminishing gradient problem which poses a challenge towards optimal training of deep models.Overall, our model achieved a dice score of 0.793 on the public dataset and 0.778 on the private dataset.The results supports the robustness of the proposed training methodology.The findings also bolster the use of transformers models for dense prediction tasks in the field of medical image analysis.The study assists in understanding the relationships between cell and tissue organization thereby providing a useful medium to look at the impact of cellular functions on human health.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 33 references that are in the map. First posted on arXiv 21 Aug 2023.

Builds on

23 of 33 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  6. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  7. 2014Going Deeper with Convolutionscited by 4,241
  8. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  9. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  10. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  11. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  12. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
11 more
  1. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 751
  2. 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 300
  3. 2018A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decaycited by 226
  4. 2021Co-Scale Conv-Attentional Image Transformerscited by 224
  5. 2021DS-TransUNet:Dual Swin Transformer U-Net for Medical Image Segmentationcited by 126
  6. 2021UTNet: A Hybrid Transformer Architecture for Medical Image Segmentationcited by 116
  7. 2021Mixed Transformer U-Net For Medical Image Segmentationcited by 95
  8. 2017CNN-based Segmentation of Medical Imaging Datacited by 48
  9. 2021Multi-Compound Transformer for Accurate Biomedical Image Segmentationcited by 42
  10. 2023MDViT: Multi-domain Vision Transformer for Small Medical Image Segmentation Datasetscited by 9
  11. 2021Auxiliary Loss of Transformer with Residual Connection for End-to-End Speaker Diarizationcited by 7

Built on by

Not cited yet.