MedDiff-FT: Data-Efficient Diffusion Model Fine-tuning with Structural Guidance for Controllable Medical Image Synthesis
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, their effectiveness in medical imaging remains constrained due to their reliance on large-scale medical datasets and the need for higher image quality. To address these challenges, we present MedDiff-FT, a controllable medical image generation method that fine-tunes a diffusion foundation model to produce medical images with structural dependency and domain specificity in a data-efficient manner. During inference, a dynamic adaptive guiding mask enforces spatial constraints to ensure anatomically coherent synthesis, while a lightweight stochastic mask generator enhances diversity through hierarchical randomness injection. Additionally, an automated quality assessment protocol filters suboptimal outputs using feature-space metrics, followed by mask corrosion to refine fidelity. Evaluated on five medical segmentation datasets,MedDiff-FT's synthetic image-mask pairs improve SOTA method's segmentation performance by an average of 1% in Dice score. The framework effectively balances generation quality, diversity, and computational efficiency, offering a practical solution for medical data augmentation. The code is available at https://github.com/JianhaoXie1/MedDiff-FT.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 21 of its 26 references that are in the map. First posted on arXiv 1 Jul 2025.
Builds on
21 of 26 references.
Closest ancestors · 1
Same direction, newest first
Other references · 20
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
8 more
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2015An Introduction to Convolutional Neural Networkscited by 514
- 2022RoentGen: Vision-Language Foundation Model for Chest X-ray Generationcited by 89
- 2018BUSIS: A Benchmark for Breast Ultrasound Image Segmentationcited by 32
- 2024From Majority to Minority: A Diffusion-based Augmentation for Underrepresented Groups in Skin Lesion Analysiscited by 9
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025Guided Transfer Learning for Discrete Diffusion Modelscited by 3
- 2025A New One-Shot Federated Learning Framework for Medical Imaging Classification with Feature-Guided Rectified Flow and Knowledge Distillationcited by 1
- 2025BrainNormalizer: Anatomy-Informed Pseudo-Healthy Brain Reconstruction from Tumor MRI via Edge-Guided ControlNetcited by 0
- 2026Geodesic-informed Generative Diffusion Model For Topology-preserved Image Video Generationcited by 0
- 2026AWR-Net: Decoupling Anatomy and Appearance for 3D Fetal Brain Ultrasound Synthesiscited by 0
- 2026AWR-Net: Decoupling Anatomy and Appearance for 3D Fetal Brain Ultrasound Synthesis18 Sep 2026
- 2026Geodesic-informed Generative Diffusion Model For Topology-preserved Image Video Generation8 Sep 2026
- 2025Guided Transfer Learning for Discrete Diffusion Models11 Dec 2025
- 2025BrainNormalizer: Anatomy-Informed Pseudo-Healthy Brain Reconstruction from Tumor MRI via Edge-Guided ControlNet17 Nov 2025
- 2025A New One-Shot Federated Learning Framework for Medical Imaging Classification with Feature-Guided Rectified Flow and Knowledge Distillation25 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2023DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Model
- 2024Anatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Models
- 2025StructDiff: Structure-aware Diffusion Model for 3D Fine-grained Medical Image Synthesis
- 2025Noise-Consistent Siamese-Diffusion for Medical Image Synthesis and Segmentation
- 2025Adaptively Distilled ControlNet: Accelerated Training and Superior Sampling for Medical Image Synthesis
- 2025Diffusion Model in Latent Space for Medical Image Segmentation Task
- 2024MedDiff-FM: A Diffusion-based Foundation Model for Versatile Medical Image Applications
- 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generation