mlsanityData to 7 Oct 2026

Compressed Gastric Image Generation Based on Soft-Label Dataset Distillation for Medical Data Sharing

arXiv 2209.14635 ↗First posted 29 Sep 2022cs.CV cs.AI cs.LGcited by 35

Not on the map. Why?

Abstract (arXiv)

Background and objective: Sharing of medical data is required to enable the cross-agency flow of healthcare information and construct high-accuracy computer-aided diagnosis systems. However, the large sizes of medical datasets, the massive amount of memory of saved deep convolutional neural network (DCNN) models, and patients' privacy protection are problems that can lead to inefficient medical data sharing. Therefore, this study proposes a novel soft-label dataset distillation method for medical data sharing. Methods: The proposed method distills valid information of medical image data and generates several compressed images with different data distributions for anonymous medical data sharing. Furthermore, our method can extract essential weights of DCNN models to reduce the memory required to save trained models for efficient medical data sharing. Results: The proposed method can compress tens of thousands of images into several soft-label images and reduce the size of a trained model to a few hundredths of its original size. The compressed images obtained after distillation have been visually anonymized; therefore, they do not contain the private information of the patients. Furthermore, we can realize high-detection performance with a small number of compressed images. Conclusions: The experimental results show that the proposed method can improve the efficiency and security of medical data sharing.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 31 of its 75 references that are in the map. First posted on arXiv 29 Sep 2022.

Builds on

31 of 75 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2014Going Deeper with Convolutionscited by 4,231
  6. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
  7. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
  8. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
  9. 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 673
  10. 2018Rethinking the Value of Network Pruningcited by 595
  11. 2020Dataset Condensation with Gradient Matchingcited by 510
  12. 2013Do Deep Nets Really Need to be Deep?cited by 466
19 more
  1. 2017ThiNet: A Filter Level Pruning Method for Deep Neural Network Compressioncited by 438
  2. 2022Dataset Distillation by Matching Training Trajectoriescited by 437
  3. 2014Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluationcited by 304
  4. 2016EIE: Efficient Inference Engine on Compressed Deep Neural Networkcited by 291
  5. 2021Dataset Condensation with Differentiable Siamese Augmentationcited by 290
  6. 2017Variational Dropout Sparsifies Deep Neural Networkscited by 265
  7. 2018Dataset Distillationcited by 224
  8. 2016Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learningcited by 209
  9. 2022Dataset Distillation using Neural Feature Regressioncited by 177
  10. 2022Privacy for Free: How does Dataset Condensation Help Privacy?cited by 119
  11. 2019Soft-Label Dataset Distillation and Text Dataset Distillationcited by 106
  12. 2017Practical Coreset Constructions for Machine Learningcited by 75
  13. 2018Bayesian Coreset Construction via Greedy Iterative Geodesic Ascentcited by 68
  14. 2019Low-Memory Neural Network Training: A Technical Reportcited by 56
  15. 2021Soft-Label Anonymous Gastric X-ray Image Distillationcited by 51
  16. 2013Are all training examples equally valuable?cited by 14
  17. 2022Self-Knowledge Distillation based Self-Supervised Learning for Covid-19 Detection from Chest X-Ray Imagescited by 13
  18. 2021Self-Supervised Learning for Gastritis Detection with Gastric X-ray Imagescited by 9
  19. 2022TriBYOL: Triplet BYOL for Self-Supervised Representation Learningcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 4; 2024: 9; 2025: 9; 2026: 9.

35 papers.

Sort:

By area:

  1. 2023Dataset Distillation: A Comprehensive Reviewcited by 126
  2. 2023A Comprehensive Survey of Dataset Distillationcited by 114
  3. 2023Data Distillation: A Surveycited by 86
  4. 2022Accelerating Dataset Distillation via Model Augmentationcited by 62
  5. 2024Towards Stable and Storage-efficient Dataset Distillation: Matching Convexified Trajectorycited by 20
  6. 2024Importance-Aware Adaptive Dataset Distillationcited by 18
  7. 2024Generative Dataset Distillation: Balancing Global Structure and Local Detailscited by 18
  8. 2025Hyperbolic Dataset Distillationcited by 15
  9. 2024Generative Dataset Distillation Based on Diffusion Modelcited by 13
  10. 2025Diversity-Driven Generative Dataset Distillation Based on Diffusion Model with Self-Adaptive Memorycited by 10
  11. 2025Information-Guided Diffusion Sampling for Dataset Distillationcited by 10
  12. 2025Task-Specific Generative Dataset Distillation with Difficulty-Guided Samplingcited by 8
23 more
  1. 2022COVID-19 Detection Based on Self-Supervised Transfer Learning Using Chest X-Ray Imagescited by 7
  2. 2024Distributional Dataset Distillation with Subtask Decompositioncited by 7
  3. 2024Image Distillation for Safe Data Sharing in Histopathologycited by 6
  4. 2025Decoupled Audio-Visual Dataset Distillationcited by 6
  5. 2024Progressive trajectory matching for medical dataset distillationcited by 5
  6. 2025Generative Dataset Distillation Based on Self-knowledge Distillationcited by 5
  7. 2024Dataset Distillation in Medical Imaging: A Feasibility Studycited by 4
  8. 2024Dataset Distillation for Histopathology Image Classificationcited by 4
  9. 2025LCMem: A Universal Model for Robust Image Memorization Detectioncited by 4
  10. 2022Boosting Automatic COVID-19 Detection Performance with Self-Supervised Learning and Batch Knowledge Ensemblingcited by 3
  11. 2025High-Order Progressive Trajectory Matching for Medical Image Dataset Distillationcited by 2
  12. 2026FD2: A Dedicated Framework for Fine-Grained Dataset Distillationcited by 2
  13. 2022RGMIM: Region-Guided Masked Image Modeling for Learning Meaningful Representations from X-Ray Imagescited by 1
  14. 2026Closed-Form Linear-Probe Dataset Distillation for Pre-trained Vision Modelscited by 1
  15. 2023Towards Efficient Deep Hashing Retrieval: Condensing Your Data via Feature-Embedding Matchingcited by 0
  16. 2025Dataset Distillation with Probabilistic Latent Featurescited by 0
  17. 2026Foreground-Aware Dataset Distillation via Dynamic Patch Selectioncited by 0
  18. 2026Difficulty-guided Sampling: Bridging the Target Gap between Dataset Distillation and Downstream Taskscited by 0
  19. 2026SAS: Semantic-aware Sampling for Generative Dataset Distillationcited by 0
  20. 2026Efficient Video Dataset Distillation via Cluster-Guided Prototype Blendingcited by 0
  21. 2026DeCO: Discriminative Evidence Composition for Fine-Grained Dataset Distillationcited by 0
  22. 2026Latent Dataset Distillation for Human Motion Predictioncited by 0
  23. 2026PSM: Dataset Distillation Based on Precise Statistical Matching by Difficultycited by 0