Diagnosis-oriented Medical Image Compression with Efficient Transfer Learning
Not on the map. Why?
Abstract (arXiv)
Remote medical diagnosis has emerged as a critical and indispensable technique in practical medical systems, where medical data are required to be efficiently compressed and transmitted for diagnosis by either professional doctors or intelligent diagnosis devices. In this process, a large amount of redundant content irrelevant to the diagnosis is subjected to high-fidelity coding, leading to unnecessary transmission costs. To mitigate this, we propose diagnosis-oriented medical image compression, a special semantic compression task designed for medical scenarios, targeting to reduce the compression cost without compromising the diagnosis accuracy. However, collecting sufficient medical data to optimize such a compression system is significantly expensive and challenging due to privacy issues and the lack of professional annotation. In this study, we propose DMIC, the first efficient transfer learning-based codec, for diagnosis-oriented medical image compression, which can be effectively optimized with only few-shot annotated medical examples, by reusing the knowledge in the existing reinforcement learning-based task-driven semantic coding framework, i.e., HRLVSC [1]. Concretely, we focus on tuning only the partial parameters of the policy network for bit allocation within HRLVSC, which enables it to adapt to the medical images. In this work, we validate our DMIC with the typical medical task, Coronary Artery Segmentation. Extensive experiments have demonstrated that our DMIC can achieve 47.594%BD-Rate savings compared to the HEVC anchor, by tuning only the A2C module (2.7% parameters) of the policy network with only 1 medical sample.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 25 references that are in the map. First posted on arXiv 20 Oct 2023.
Builds on
13 of 25 references.
References · 13
- 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,026
- 2023GraphAdapter: Tuning Vision-Language Models With Dual Knowledge Graphcited by 69
- 2022Generative Joint Source-Channel Coding for Semantic Image Transmissioncited by 58
- 2022ImageCAS: A Large-Scale Dataset and Benchmark for Coronary Artery Segmentation based on Computed Tomography Angiography Imagescited by 55
- 2018DSSLIC: Deep Semantic Segmentation-based Layered Image Compressioncited by 27
- 2021Task-driven Semantic Coding via Reinforcement Learningcited by 25
- 2022Preprocessing Enhanced Image Compression for Machine Visioncited by 18
- 2022Domain Adaptation Meets Zero-Shot Learning: An Annotation-Efficient Approach to Multi-Modality Medical Image Segmentationcited by 16
- 2018DeepSIC: Deep Semantic Image Compressioncited by 10
- 2022RTN: Reinforced Transformer Network for Coronary CT Angiography Vessel-level Image Quality Assessmentcited by 8
- 2019Reinforced Bit Allocation under Task-Driven Semantic Distortion Metricscited by 6
- 2021Image Compression with Encoder-Decoder Matched Semantic Segmentationcited by 4
1 more
Built on by
Not cited yet.