SkinMamba: A Precision Skin Lesion Segmentation Architecture with Cross-Scale Global State Modeling and Frequency Boundary Guidance
Not on the map. Why?
Abstract (arXiv)
Skin lesion segmentation is a crucial method for identifying early skin cancer. In recent years, both convolutional neural network (CNN) and Transformer-based methods have been widely applied. Moreover, combining CNN and Transformer effectively integrates global and local relationships, but remains limited by the quadratic complexity of Transformer. To address this, we propose a hybrid architecture based on Mamba and CNN, called SkinMamba. It maintains linear complexity while offering powerful long-range dependency modeling and local feature extraction capabilities. Specifically, we introduce the Scale Residual State Space Block (SRSSB), which captures global contextual relationships and cross-scale information exchange at a macro level, enabling expert communication in a global state. This effectively addresses challenges in skin lesion segmentation related to varying lesion sizes and inconspicuous target areas. Additionally, to mitigate boundary blurring and information loss during model downsampling, we introduce the Frequency Boundary Guided Module (FBGM), providing sufficient boundary priors to guide precise boundary segmentation, while also using the retained information to assist the decoder in the decoding process. Finally, we conducted comparative and ablation experiments on two public lesion segmentation datasets (ISIC2017 and ISIC2018), and the results demonstrate the strong competitiveness of SkinMamba in skin lesion segmentation tasks. The code is available at https://github.com/zs1314/SkinMamba.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 47 of its 64 references that are in the map. First posted on arXiv 17 Sep 2024.
Builds on
47 of 64 references.
References · 47
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
35 more
- 2024VMamba: Visual State Space Modelcited by 955
- 2022Simplified State Space Layers for Sequence Modelingcited by 776
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 657
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 607
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 583
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 495
- 2022MaxViT: Multi-Axis Vision Transformercited by 476
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
- 2022Diagonal State Spaces are as Effective as Structured State Spacescited by 350
- 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentationcited by 286
- 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
- 2022Long Range Language Modeling via Gated State Spacescited by 265
- 2022Medical Image Segmentation Review: The success of U-Netcited by 190
- 2018Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentationcited by 180
- 2021nnFormer: Interleaved Transformer for Volumetric Segmentationcited by 179
- 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformercited by 124
- 2024ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Modelcited by 118
- 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
- 2024RS-Mamba for Large Remote Sensing Image Dense Predictioncited by 80
- 2022MALUNet: A Multi-Attention and Light-weight UNet for Skin Lesion Segmentationcited by 59
- 2018Fully Dense UNet for 2D Sparse Photoacoustic Tomography Artifact Removalcited by 56
- 2023EGE-UNet: an Efficient Group Enhanced UNet for skin lesion segmentationcited by 53
- 2023Scale-Aware Modulation Meet Transformercited by 49
- 2024UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentationcited by 45
- 2024U-shaped Vision Mamba for Single Image Dehazingcited by 40
- 2024VM-UNET-V2 Rethinking Vision Mamba UNet for Medical Image Segmentationcited by 39
- 2024Samba: Semantic Segmentation of Remotely Sensed Images with State Space Modelcited by 37
- 2024H-vmunet: High-order Vision Mamba UNet for Medical Image Segmentationcited by 34
- 2023U-Net v2: Rethinking the Skip Connections of U-Net for Medical Image Segmentationcited by 23
- 2022Attention Swin U-Net: Cross-Contextual Attention Mechanism for Skin Lesion Segmentationcited by 21
- 2024CMViM: Contrastive Masked Vim Autoencoder for 3D Multi-modal Representation Learning for AD classificationcited by 15
- 2024MambaUIE&SR: Unraveling the Ocean's Secrets with Only 2.8 GFLOPscited by 5
- 2024OCTAMamba: A State-Space Model Approach for Precision OCTA Vasculature Segmentationcited by 3
- 2024MambaMIC: An Efficient Baseline for Microscopic Image Classification with State Space Modelscited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 2.
4 papers.
- 2024When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentationcited by 0
- 2025Diff-CL: A Novel Cross Pseudo-Supervision Method for Semi-supervised Medical Image Segmentationcited by 0
- 2026Uncertainty-Guided Dual-Domain Learning for Reliable Skin Lesion Segmentationcited by 0
- 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigmscited by 0
- 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms29 Jun 2026
- 2026Uncertainty-Guided Dual-Domain Learning for Reliable Skin Lesion Segmentation10 May 2026
- 2025Diff-CL: A Novel Cross Pseudo-Supervision Method for Semi-supervised Medical Image Segmentation12 Mar 2025
- 2024When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentation14 Nov 2024
Similar, not cited
Close in wording, no citation either way
- 2024MUCM-Net: A Mamba Powered UCM-Net for Skin Lesion Segmentation
- 2024MambaU-Lite: A Lightweight Model based on Mamba and Integrated Channel-Spatial Attention for Skin Lesion Segmentation
- 2026MambaLiteUNet: Cross-Gated Adaptive Feature Fusion for Robust Skin Lesion Segmentation
- 2024AC-MAMBASEG: An adaptive convolution and Mamba-based architecture for enhanced skin lesion segmentation
- 2025UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentation
- 2025ASP-VMUNet: Atrous Shifted Parallel Vision Mamba U-Net for Skin Lesion Segmentation
- 2023DermoSegDiff: A Boundary-aware Segmentation Diffusion Model for Skin Lesion Delineation
- 2026Geometry-Aware Superpixel Graph Transformer with Metadata for Skin Lesion Classification