XBound-Former: Toward Cross-scale Boundary Modeling in Transformers
Not on the map. Why?
Abstract (arXiv)
Skin lesion segmentation from dermoscopy images is of great significance in the quantitative analysis of skin cancers, which is yet challenging even for dermatologists due to the inherent issues, i.e., considerable size, shape and color variation, and ambiguous boundaries. Recent vision transformers have shown promising performance in handling the variation through global context modeling. Still, they have not thoroughly solved the problem of ambiguous boundaries as they ignore the complementary usage of the boundary knowledge and global contexts. In this paper, we propose a novel cross-scale boundary-aware transformer, XBound-Former, to simultaneously address the variation and boundary problems of skin lesion segmentation. XBound-Former is a purely attention-based network and catches boundary knowledge via three specially designed learners. We evaluate the model on two skin lesion datasets, ISIC-2016&PH2 and ISIC-2018, where our model consistently outperforms other convolution- and transformer-based models, especially on the boundary-wise metrics. We extensively verify the generalization ability of polyp lesion segmentation that has similar characteristics, and our model can also yield significant improvement compared to the latest models.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 36 of its 57 references that are in the map. First posted on arXiv 2 Jun 2022.
Builds on
36 of 57 references.
References · 36
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
24 more
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,133
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 751
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 589
- 2017Convolutional Sequence to Sequence Learningcited by 552
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2020PraNet: Parallel Reverse Attention Network for Polyp Segmentationcited by 460
- 2017Dilated Residual Networkscited by 294
- 2021TransFuse: Fusing Transformers and CNNs for Medical Image Segmentationcited by 258
- 2016A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Imagescited by 221
- 2019CE-Net: Context Encoder Network for 2D Medical Image Segmentationcited by 220
- 2018Boundary loss for highly unbalanced segmentationcited by 190
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
- 2019Reducing the Hausdorff Distance in Medical Image Segmentation with Convolutional Neural Networkscited by 116
- 2021Shallow Attention Network for Polyp Segmentationcited by 107
- 2020CA-Net: Comprehensive Attention Convolutional Neural Networks for Explainable Medical Image Segmentationcited by 79
- 2021HarDNet-MSEG: A Simple Encoder-Decoder Polyp Segmentation Neural Network that Achieves over 0.9 Mean Dice and 86 FPScited by 71
- 2022TGANet: Text-guided attention for improved polyp segmentationcited by 59
- 2021Boundary-aware Transformers for Skin Lesion Segmentationcited by 39
- 2020Attention-Based Transformers for Instance Segmentation of Cells in Microstructurescited by 38
- 2021Enhanced U-Net: A Feature Enhancement Network for Polyp Segmentationcited by 34
- 2021Duplex Contextual Relation Network for Polyp Segmentationcited by 22
- 2017Global and Local Information Based Deep Network for Skin Lesion Segmentationcited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 3.
6 papers.
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Surveycited by 5
- 2025Rethinking Boundary Detection in Deep Learning-Based Medical Image Segmentationcited by 2
- 2024EPPS: Advanced Polyp Segmentation via Edge Information Injection and Selective Feature Decouplingcited by 1
- 2025Minding Fuzzy Regions: A Data-driven Alternating Learning Paradigm for Stable Lesion Segmentationcited by 1
- 2023PnPNet: Pull-and-Push Networks for Volumetric Segmentation with Boundary Confusioncited by 0
- 2025ScaleFusionNet: Transformer-Guided Multi-Scale Feature Fusion for Skin Lesion Segmentationcited by 0
- 2025Rethinking Boundary Detection in Deep Learning-Based Medical Image Segmentation6 May 2025
- 2025Minding Fuzzy Regions: A Data-driven Alternating Learning Paradigm for Stable Lesion Segmentation14 Mar 2025
- 2025ScaleFusionNet: Transformer-Guided Multi-Scale Feature Fusion for Skin Lesion Segmentation5 Mar 2025
- 2024EPPS: Advanced Polyp Segmentation via Edge Information Injection and Selective Feature Decoupling20 May 2024
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Survey22 Jan 2024
- 2023PnPNet: Pull-and-Push Networks for Volumetric Segmentation with Boundary Confusion13 Dec 2023