GAD-MambaUNet: Direction-Group Mamba with Gradient-Adaptive DINOv3 Distillation for Lightweight Medical Image Segmentation
On the map: State-space sequence models (S4, Mamba) → Mamba for medical image analysis
Abstract (arXiv)
In this paper, we proposed GAD-MambaUNet, a lightweight medical image segmentation network that combines efficient local modeling, direction--group state-space interaction, and training-time foundation-model supervision. To improve contextual modeling in compact segmentation networks, we introduced Direction-Group Graph Selective Scan (DG-GSS), which treated scan-direction and channel-group responses as graph nodes and enabled structured information exchange before multi-directional fusion. We further incorporated DINOv3-GAD supervision, where a frozen DINOv3 teacher provided semantic guidance during training, and Gradient-Adaptive Distillation dynamically regulated the distillation strength. GAD-MambaUNet achieves a favorable accuracy--efficiency balance compared with representative lightweight and general segmentation methods. Ablation studies further verify the effectiveness of DG-GSS and training-time DINOv3-GAD supervision. In future work, we will explore more flexible teacher--student alignment strategies and extend the proposed framework to more diverse medical segmentation scenarios, such as multi-class and multi-modal segmentation tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Mamba for medical image analysis, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 16 of its 21 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
16 of 21 references.
Closest ancestors · 2
Same direction, newest first
- 2024UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentation29 Mar
- 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentation4 Feb
Other references · 14
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2017Graph Attention Networkscited by 8,854
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 657
- 2016A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Imagescited by 220
- 2022UNeXt: MLP-based Rapid Medical Image Segmentation Networkcited by 185
- 2024EMCAD: Efficient Multi-scale Convolutional Attention Decoding for Medical Image Segmentationcited by 64
- 2021UACANet: Uncertainty Augmented Context Attention for Polyp Segmentationcited by 61
- 2023CMUNeXt: An Efficient Medical Image Segmentation Network based on Large Kernel and Skip Fusioncited by 31
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024MambaClinix: Hierarchical Gated Convolution and Mamba-Based U-Net for Enhanced 3D Medical Image Segmentation
- 2025Mamba-Sea: A Mamba-based Framework with Global-to-Local Sequence Augmentation for Generalizable Medical Image Segmentation
- 2026Patch-MoE Mamba: A Patch-Ordered Mixture-of-Experts State Space Architecture for Medical Image Segmentation
- 2025Prompt-Guided Dual-Path UNet with Mamba for Medical Image Segmentation
- 2025Mamba Goes HoME: Hierarchical Soft Mixture-of-Experts for 3D Medical Image Segmentation
- 2025DM-SegNet: Dual-Mamba Architecture for 3D Medical Image Segmentation with Global Context Modeling
- 2025HybridMamba: A Dual-domain Mamba for 3D Medical Image Segmentation
- 2025A Comprehensive Analysis of Mamba for 3D Volumetric Medical Image Segmentation