mlsanityData to 14 Oct 2026

MedDiff-FT: Data-Efficient Diffusion Model Fine-tuning with Structural Guidance for Controllable Medical Image Synthesis

arXiv 2507.00377 ↗First posted 1 Jul 2025cs.CVcited by 5

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, their effectiveness in medical imaging remains constrained due to their reliance on large-scale medical datasets and the need for higher image quality. To address these challenges, we present MedDiff-FT, a controllable medical image generation method that fine-tunes a diffusion foundation model to produce medical images with structural dependency and domain specificity in a data-efficient manner. During inference, a dynamic adaptive guiding mask enforces spatial constraints to ensure anatomically coherent synthesis, while a lightweight stochastic mask generator enhances diversity through hierarchical randomness injection. Additionally, an automated quality assessment protocol filters suboptimal outputs using feature-space metrics, followed by mask corrosion to refine fidelity. Evaluated on five medical segmentation datasets,MedDiff-FT's synthetic image-mask pairs improve SOTA method's segmentation performance by an average of 1% in Dice score. The framework effectively balances generation quality, diversity, and computational efficiency, offering a practical solution for medical data augmentation. The code is available at https://github.com/JianhaoXie1/MedDiff-FT.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 21 of its 26 references that are in the map. First posted on arXiv 1 Jul 2025.

Builds on

21 of 26 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Diffusion-based Data Augmentation for Skin Disease Classification: Impact Across Original Medical Datasets to Fully Synthetic Images12 Jan

Other references · 20

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  8. 2020Denoising Diffusion Implicit Modelscited by 9,781
  9. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  11. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  12. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
8 more
  1. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  2. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
  3. 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
  4. 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
  5. 2015An Introduction to Convolutional Neural Networkscited by 514
  6. 2022RoentGen: Vision-Language Foundation Model for Chest X-ray Generationcited by 89
  7. 2018BUSIS: A Benchmark for Breast Ultrasound Image Segmentationcited by 32
  8. 2024From Majority to Minority: A Diffusion-based Augmentation for Underrepresented Groups in Skin Lesion Analysiscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Model
  2. 2024Anatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Models
  3. 2025StructDiff: Structure-aware Diffusion Model for 3D Fine-grained Medical Image Synthesis
  4. 2025Noise-Consistent Siamese-Diffusion for Medical Image Synthesis and Segmentation
  5. 2025Adaptively Distilled ControlNet: Accelerated Training and Superior Sampling for Medical Image Synthesis
  6. 2025Diffusion Model in Latent Space for Medical Image Segmentation Task
  7. 2024MedDiff-FM: A Diffusion-based Foundation Model for Versatile Medical Image Applications
  8. 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generation