TransUNet-GradCAM: A Hybrid Transformer-U-Net with Self-Attention and Explainable Visualizations for Foot Ulcer Segmentation
Not on the map. Why?
Abstract (arXiv)
Automated segmentation of diabetic foot ulcers (DFUs) supports clinical diagnosis, treatment planning, and wound monitoring, but remains challenging because of heterogeneous appearance, irregular morphology, and cluttered backgrounds in clinical photographs. We evaluate a hybrid ViT-bottleneck U-Net that combines a convolutional encoder-decoder with a Transformer bottleneck and attention-gated skip connections. We emphasise rigorous validation and explainability rather than architectural novelty. The model was trained on the public Foot Ulcer Segmentation Challenge (FUSeg) dataset using a hybrid Dice and cross-entropy loss. Results are reported over five seeds as mean +/- 95% confidence interval at a fixed threshold. On the internal validation set, the model achieved a Dice of 0.8035 +/- 0.0053 and IoU of 0.7149 +/- 0.0073 (HD95 = 19.74 px, ASSD = 6.12 px). Ablation showed that only the hybrid loss significantly changed Dice (-0.038, p < 0.001), while the Transformer bottleneck, attention gates, and augmentation had small, non-significant in-domain effects. External validation without retraining achieved a Dice of 0.7460 on the AZH Wound Care Center cohort (n = 278), retaining about 92% of internal Dice. A small Medetec subset (n = 8) was used only for qualitative assessment, indicating partial rather than robust generalisation under domain shift. Explainability analysis found Grad-CAM more wound-localised (energy-in-mask 0.871 vs. 0.102), while attention rollout was significantly more faithful (p = 0.038, n = 200). Predicted and expert wound areas showed strong agreement (Pearson r = 0.944), with a lightweight model of 8.79 M parameters.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 15 of its 53 references that are in the map. First posted on arXiv 4 Aug 2025.
Builds on
15 of 53 references.
References · 15
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2020Quantifying Attention Flow in Transformerscited by 775
- 2018Albumentations: fast and flexible image augmentationscited by 560
- 2020Fully Automatic Wound Segmentation with Deep Convolutional Neural Networkscited by 32
- 2024Few-shot Adaptation of Medical Vision-Language Modelscited by 24
- 2022FUSeg: The Foot Ulcer Segmentation Challengecited by 22
- 2020Deep Learning in Diabetic Foot Ulcers Detection: A Comprehensive Evaluationcited by 19
- 2022Scheduling Techniques for Liver Segmentation: ReduceLRonPlateau Vs OneCycleLRcited by 19
- 2023FUSegNet: A Deep Convolutional Neural Network for Foot Ulcer Segmentationcited by 13
- 2021Weighted Intersection over Union (wIoU) for Evaluating Image Segmentationcited by 11
- 2021Automatic Foot Ulcer Segmentation Using an Ensemble of Convolutional Neural Networkscited by 9
- 2024Wound Tissue Segmentation in Diabetic Foot Ulcer Images Using Deep Learning: A Pilot Studycited by 5
3 more
- 2024Efficient In-Context Medical Segmentation with Meta-driven Visual Prompt Selectioncited by 4
- 2024Understanding implementation pitfalls of distance-based metrics for image segmentationcited by 3
- 2025Deploying and Evaluating Multiple Deep Learning Models on Edge Devices for Diabetic Retinopathy Detectioncited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.