mlsanityData to 14 Oct 2026

Uni-Light: An Ultra-Lightweight Framework via Uncertainty-Aware Knowledge Distillation for Brain Tumour Segmentation

arXiv 2609.06729 ↗First posted 6 Sep 2026cs.CVcited by 0

On the map: Knowledge distillation → Distillation for medical imaging

Abstract (arXiv)

Accurate 3D brain tumour segmentation from multi-modal Magnetic Resonance Imaging (MRI) is essential for clinical diagnosis and treatment planning. Existing brain tumour segmentation methods often suffer from heavy computational demands, while current lightweight architectures frequently lack the capacity to maintain segmentation fidelity in complex tumour regions. To address these issues, we propose a novel ultra-lightweight framework (Uni-Light) that achieves high-fidelity segmentation with substantially reduced computational overhead. It combines multi-scale convolutions with an uncertainty-aware knowledge distillation scheme that directs the student model toward hard-to-classify regions, complemented by a Signed Distance Field boundary loss for geometric constraints. Experimental results on BraTS2023-GLI and MSD-BTS datasets demonstrate that Uni-Light reduces parameters by 97.56%, floating-point operations (FLOPs) by 73.03%, and inference memory footprint by 81.58%, while surpassing the state-of-the-art model by an average of 1.47% in Dice score, offering a highly competitive trade-off between segmentation accuracy and computational efficiency in resource-constrained clinical settings. This work also advances data engineering for medical imaging by demonstrating that teacher model uncertainty can be exploited as a data-driven supervisory signal, re-prioritising the training data distribution without requiring additional annotation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Distillation for medical imaging, one of 12 directions in Knowledge distillation. Builds on 17 of its 34 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

17 of 34 references.

References · 17

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  4. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  5. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  6. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
  7. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
  8. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,077
  9. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
  10. 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
  11. 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 373
  12. 2019Structured Knowledge Distillation for Dense Predictioncited by 279
5 more
  1. 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
  2. 2018Boundary loss for highly unbalanced segmentationcited by 190
  3. 2019Knowledge Adaptation for Efficient Semantic Segmentationcited by 105
  4. 20193D Dilated Multi-Fiber Network for Real-time Brain Tumor Segmentation in MRIcited by 28
  5. 2024LATUP-Net: A Lightweight 3D Attention U-Net with Parallel Convolutions for Brain Tumor Segmentationcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Bridging the Gap in Missing Modalities: Leveraging Knowledge Distillation and Style Matching for Brain Tumor Segmentation
  2. 2021Efficient Medical Image Segmentation Based on Knowledge Distillation
  3. 2025NNDM: NN_UNet Diffusion Model for Brain Tumor Segmentation
  4. 2023LightBTSeg: A lightweight breast tumor segmentation model using ultrasound images via dual-path joint knowledge distillation
  5. 2026Mtextsuperscript4Fuse: Lightweight State-Space MoE with a Cross-Scale Gating Bridge for Brain Tumor Segmentation
  6. 2026A Unified Benchmark of Deep Learning Models for Multi-task 3D Brain Tumor Segmentation from Magnetic Resonance Imaging
  7. 2025No Modality Left Behind: Adapting to Missing Modalities via Knowledge Distillation for Brain Tumor Segmentation
  8. 2024Unsupervised Tumor-Aware Distillation for Multi-Modal Brain Image Translation