StructDiff: Structure-aware Diffusion Model for 3D Fine-grained Medical Image Synthesis
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Solving medical imaging data scarcity through semantic image generation has attracted growing attention in recent years. However, existing generative models mainly focus on synthesizing whole-organ or large-tissue structures, showing limited capability in reproducing fine-grained anatomical details. Due to the stringent requirement of topological consistency and the complex 3D morphological heterogeneity of medical data, accurately reconstructing fine-grained anatomical details remains a significant challenge. To address these limitations, we propose StructDiff, a Structure-aware Diffusion Model for fine-grained 3D medical image synthesis, which enables precise generation of topologically complex anatomies. In addition to the conventional mask-based guidance, StructDiff further introduces a paired image-mask template to guide the generation process, providing structural constrains and offering explicit knowledge of mask-to-image correspondence. Moreover, a Mask Generation Module (MGM) is designed to enrich mask diversity and alleviate the scarcity of high-quality reference masks. Furthermore, we propose a Confidence-aware Adaptive Learning (CAL) strategy based on Skip-Sampling Variance (SSV), which mitigates uncertainty introduced by imperfect synthetic data when transferring to downstream tasks. Extensive experiments demonstrate that StructDiff achieves state-of-the-art performance in terms of topological consistency and visual realism, and significantly boosts downstream segmentation performance. Code will be released upon acceptance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 38 of its 56 references that are in the map. First posted on arXiv 12 Mar 2025.
Builds on
38 of 56 references.
Closest ancestors · 6
Same direction, newest first
- 2024MAISI: Medical AI for Synthetic Imaging13 Sep
- 2024WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis29 Feb
- 2023Adaptive Latent Diffusion Model for 3D Medical Image to Image Translation: Multi-modal Magnetic Resonance Imaging Study1 Nov
- 2023DiffInfinite: Large Mask-Image Synthesis via Parallel Random Patch Diffusion in Histopathology23 Jun
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis29 May
- 2022Diffusion Probabilistic Models beat GANs on Medical Images14 Dec
Other references · 32
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 182
- 2019Data augmentation using learned transformations for one-shot medical image segmentationcited by 138
- 2016Multivariate mixture model for myocardium segmentation combining multi-source imagescited by 133
- 2023Beyond One-to-One: Rethinking the Referring Image Segmentationcited by 68
- 2024Towards Generalizable Tumor Synthesiscited by 65
20 more
- 2020Hierarchical Amortized Training for Memory-efficient High Resolution 3D GANcited by 60
- 2020Efficient Semantic Image Synthesis via Class-Adaptive Normalizationcited by 58
- 2022ImageCAS: A Large-Scale Dataset and Benchmark for Coronary Artery Segmentation based on Computed Tomography Angiography Imagescited by 54
- 2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
- 2022XMorpher: Full Transformer for Deformable Medical Image Registration via Cross Attentioncited by 46
- 2021Image Synthesis via Semantic Compositioncited by 45
- 2022SceneComposer: Any-Level Semantic Image Synthesiscited by 43
- 2024CleanDIFT: Diffusion Features without Noisecited by 42
- 2023MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Imagescited by 41
- 2023Geometric Visual Similarity Learning in 3D Medical Image Self-supervised Pre-trainingcited by 36
- 2023MedGen3D: A Deep Generative Framework for Paired 3D Image and Mask Generationcited by 34
- 2017Simultaneous Super-Resolution and Cross-Modality Synthesis of 3D Medical Images using Weakly-Supervised Joint Convolutional Sparse Codingcited by 33
- 2024It's All About Your Sketch: Democratising Sketch Control in Diffusion Modelscited by 28
- 2024PLACE: Adaptive Layout-Semantic Fusion for Semantic Image Synthesiscited by 20
- 2021ImageCHD: A 3D Computed Tomography Image Dataset for Classification of Congenital Heart Diseasecited by 16
- 2023Synthetic optical coherence tomography angiographs for detailed retinal vessel segmentation without human annotationscited by 16
- 2023Pre- to Post-Contrast Breast MRI Synthesis for Enhanced Tumour Segmentationcited by 9
- 2023Unlocking Pre-trained Image Backbones for Semantic Image Synthesiscited by 6
- 2022Current State of Community-Driven Radiological AI Deployment in Medical Imagingcited by 5
- 2025Homeomorphism Prior for False Positive and Negative Problem in Medical Image Dense Contrastive Representation Learningcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MedDiff-FT: Data-Efficient Diffusion Model Fine-tuning with Structural Guidance for Controllable Medical Image Synthesis
- 2026Sketch2CT: Multimodal Diffusion for Structure-Aware 3D Medical Volume Generation
- 2026MUMINS: Metadata-conditioned Uncertainty-aware Medical Image Next-state Synthesis
- 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generation
- 2024Anatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Models
- 2024MedDiff-FM: A Diffusion-based Foundation Model for Versatile Medical Image Applications
- 2025PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditions
- 2025PathoSyn: Imaging-Pathology MRI Synthesis via Disentangled Deviation Diffusion