UniCompress: Enhancing Multi-Data Medical Image Compression with Knowledge Distillation
On the map: Knowledge distillation → General knowledge distillation methods
Abstract (arXiv)
In the field of medical image compression, Implicit Neural Representation (INR) networks have shown remarkable versatility due to their flexible compression ratios, yet they are constrained by a one-to-one fitting approach that results in lengthy encoding times. Our novel method, ``UniCompress'', innovatively extends the compression capabilities of INR by being the first to compress multiple medical data blocks using a single INR network. By employing wavelet transforms and quantization, we introduce a codebook containing frequency domain information as a prior input to the INR network. This enhances the representational power of INR and provides distinctive conditioning for different image blocks. Furthermore, our research introduces a new technique for the knowledge distillation of implicit representations, simplifying complex model knowledge into more manageable formats to improve compression ratios. Extensive testing on CT and electron microscopy (EM) datasets has demonstrated that UniCompress outperforms traditional INR methods and commercial compression solutions like HEVC, especially in complex and high compression scenarios. Notably, compared to existing INR techniques, UniCompress achieves a 4~5 times increase in compression speed, marking a significant advancement in the field of medical image compression. Codes will be publicly available.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in General knowledge distillation methods, one of 12 directions in Knowledge distillation. Builds on 5 of its 44 references that are in the map. First posted on arXiv 27 May 2024.
Builds on
5 of 44 references.
References · 5
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023Generative Text-Guided 3D Vision-Language Pretraining for Unified Medical Image Segmentationcited by 47
- 2024BIMCV-R: A Landmark Dataset for 3D CT Text-Image Retrievalcited by 30
- 2023Compression with Bayesian Implicit Neural Representationscited by 25
- 2024DeepGI: An Automated Approach for Gastrointestinal Tract Segmentation in MRI Scanscited by 13
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 2.
3 papers.
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 179
- 2026Learning from Compressed CT: Feature Attention Style Transfer and Structured Factorized Projections for Resource-Efficient Medical Image Analysiscited by 0
- 2026KD-NVC: A Search-and-Distill Framework to Accelerate Neural Video Codingcited by 0
- 2026KD-NVC: A Search-and-Distill Framework to Accelerate Neural Video Coding3 Jun 2026
- 2026Learning from Compressed CT: Feature Attention Style Transfer and Structured Factorized Projections for Resource-Efficient Medical Image Analysis1 May 2026
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generation5 Jun 2024
Similar, not cited
Close in wording, no citation either way
- 2021Implicit Neural Representations for Image Compression
- 2025Efficient Learned Image Compression Through Knowledge Distillation
- 2025MIND: Modality-Informed Knowledge Distillation Framework for Multimodal Clinical Prediction Tasks
- 2025NEURAL: Attention-Guided Pruning for Unified Multimodal Resource-Constrained Clinical Evaluation
- 2026Efficient Deep Learning for Medical Imaging: Bridging the Gap Between High-Performance AI and Clinical Deployment
- 2025SINR: Sparsity Driven Compressed Implicit Neural Representations
- 2026MRIComp4Flow: Compression of 3D Brain MRI for Training Multi-Modal Generative Models
- 2024NVRC: Neural Video Representation Compression