MK-UNet: Multi-kernel Lightweight CNN for Medical Image Segmentation
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce MK-UNet, a paradigm shift towards ultra-lightweight, multi-kernel U-shaped CNNs tailored for medical image segmentation. Central to MK-UNet is the multi-kernel depth-wise convolution block (MKDC) we design to adeptly process images through multiple kernels, while capturing complex multi-resolution spatial relationships. MK-UNet also emphasizes the images salient features through sophisticated attention mechanisms, including channel, spatial, and grouped gated attention. Our MK-UNet network, with a modest computational footprint of only 0.316M parameters and 0.314G FLOPs, represents not only a remarkably lightweight, but also significantly improved segmentation solution that provides higher accuracy over state-of-the-art (SOTA) methods across six binary medical imaging benchmarks. Specifically, MK-UNet outperforms TransUNet in DICE score with nearly 333× and 123× fewer parameters and FLOPs, respectively. Similarly, when compared against UNeXt, MK-UNet exhibits superior segmentation performance, improving the DICE score up to 6.7% margins while operating with 4.7× fewer #Params. Our MK-UNet also outperforms other recent lightweight networks, such as MedT, CMUNeXt, EGE-UNet, and Rolling-UNet, with much lower computational resources. This leap in performance, coupled with drastic computational gains, positions MK-UNet as an unparalleled solution for real-time, high-fidelity medical diagnostics in resource-limited settings, such as point-of-care devices. Our implementation is available at https://github.com/SLDGroup/MK-UNet.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 33 of its 45 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
33 of 45 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
21 more
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2020PraNet: Parallel Reverse Attention Network for Polyp Segmentationcited by 460
- 2017Road Extraction by Deep Residual U-Netcited by 333
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 320
- 2016A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Imagescited by 221
- 2016SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioningcited by 219
- 2022UNeXt: MLP-based Rapid Medical Image Segmentation Networkcited by 185
- 2024EMCAD: Efficient Multi-scale Convolutional Attention Decoding for Medical Image Segmentationcited by 64
- 2021UACANet: Uncertainty Augmented Context Attention for Polyp Segmentationcited by 61
- 2022MALUNet: A Multi-Attention and Light-weight UNet for Skin Lesion Segmentationcited by 59
- 2023EGE-UNet: an Efficient Group Enhanced UNet for skin lesion segmentationcited by 53
- 2023Scale-Aware Modulation Meet Transformercited by 49
- 2024UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentationcited by 45
- 2023Multi-scale Hierarchical Vision Transformer with Cascaded Attention Decoding for Medical Image Segmentationcited by 34
- 2023CMUNeXt: An Efficient Medical Image Segmentation Network based on Large Kernel and Skip Fusioncited by 31
- 2023ACC-UNet: A Completely Convolutional UNet model for the 2020scited by 26
- 2023G-CASCADE: Efficient Cascaded Graph Convolutional Decoding for 2D Medical Image Segmentationcited by 21
Built on by
Citing papers per year: 2025: 4; 2026: 8.
12 papers.
- 2025UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentationcited by 3
- 2025LoMix: Learnable Weighted Multi-Scale Logits Mixing for Medical Image Segmentationcited by 1
- 2026Efficient Deep Learning for Medical Imaging: Bridging the Gap Between High-Performance AI and Clinical Deploymentcited by 1
- 2026CP-WSP: A Declarative CP-SAT Framework for Configurable Multi-Constraint Workforce Schedulingcited by 1
- 2026Modular Deep Learning Mechanisms for Auditable Next-Day Wildfire Spread Predictioncited by 1
- 2025Q2: Quantization-Aware Gradient Balancing and Attention Alignment for Low-Bit Quantizationcited by 0
- 2025CephRes-MHNet: A Multi-Head Residual Network for Accurate and Robust Cephalometric Landmark Detectioncited by 0
- 2026LAW & ORDER: Adaptive Spatial Weighting for Medical Diffusion and Segmentationcited by 0
- 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigmscited by 0
- 2026G^2RA-NET: Graph-based Cross-Slice Relation Modeling with Attention Gating for Medical Image Segmentationcited by 0
- 2026GAD-MambaUNet: Direction-Group Mamba with Gradient-Adaptive DINOv3 Distillation for Lightweight Medical Image Segmentationcited by 0
- 2026LightMIS: Ultra-Lightweight Medical Image Segmentation Without a Stage-Wise Decodercited by 0
- 2026LightMIS: Ultra-Lightweight Medical Image Segmentation Without a Stage-Wise Decoder23 Sep 2026
- 2026GAD-MambaUNet: Direction-Group Mamba with Gradient-Adaptive DINOv3 Distillation for Lightweight Medical Image Segmentation22 Sep 2026
- 2026G^2RA-NET: Graph-based Cross-Slice Relation Modeling with Attention Gating for Medical Image Segmentation17 Sep 2026
- 2026Modular Deep Learning Mechanisms for Auditable Next-Day Wildfire Spread Prediction15 Sep 2026
- 2026CP-WSP: A Declarative CP-SAT Framework for Configurable Multi-Constraint Workforce Scheduling6 Jul 2026
- 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms29 Jun 2026
- 2026LAW & ORDER: Adaptive Spatial Weighting for Medical Diffusion and Segmentation5 Mar 2026
- 2026Efficient Deep Learning for Medical Imaging: Bridging the Gap Between High-Performance AI and Clinical Deployment31 Jan 2026
- 2025UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentation25 Dec 2025
- 2025CephRes-MHNet: A Multi-Head Residual Network for Accurate and Robust Cephalometric Landmark Detection13 Nov 2025
- 2025Q2: Quantization-Aware Gradient Balancing and Attention Alignment for Low-Bit Quantization8 Nov 2025
- 2025LoMix: Learnable Weighted Multi-Scale Logits Mixing for Medical Image Segmentation27 Oct 2025