mlsanityData to 7 Oct 2026

Exploiting Completeness Perception with Diffusion Transformer for Unified 3D MRI Synthesis

arXiv 2602.18400 ↗First posted 20 Feb 2026eess.IV cs.CVcited by 0

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Missing data problems, such as missing modalities in multi-modal brain MRI and missing slices in cardiac MRI, pose significant challenges in clinical practice. Existing methods rely on external guidance to supply detailed missing-state information for instructing generative models to synthesize missing MRIs. However, manual indicators are not always available or reliable in real-world scenarios due to the unpredictable nature of clinical environments. Moreover, these explicit masks are not informative enough to provide guidance for improving semantic consistency. In this work, we argue that generative models should infer and recognize missing states in a self-perceptive manner, enabling them to better capture subtle anatomical and pathological variations. Towards this goal, we propose CoPeDiT, a shared completeness-perception framework for 3D MRI synthesis, following a common conditioning strategy with task-specific instantiations for different missing-data scenarios. Specifically, we incorporate dedicated pretext tasks into our tokenizer, CoPeVAE, empowering it to learn completeness-aware discriminative prompt tokens, and design MDiT3D, a specialized diffusion transformer architecture for 3D MRI synthesis that effectively uses the completeness-aware prompt tokens as guidance to enhance semantic consistency in 3D space. Comprehensive evaluations on three large-scale MRI datasets demonstrate that CoPeDiT consistently improves upon state-of-the-art methods across diverse missing patterns, yielding high-fidelity and structurally consistent MRI synthesis. Our code is available at https://github.com/JK-Liu7/CoPeDiT.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 53 of its 84 references that are in the map. First posted on arXiv 20 Feb 2026.

Builds on

53 of 84 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Diffusion-Based Data Augmentation for Medical Image Segmentation25 Aug
  2. 2025MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Loss7 Aug
  3. 2025Text2CT: Towards 3D CT Volume Generation from Free-text Descriptions Using Diffusion Model7 May
  4. 2025Regression is all you need for medical image translation4 May
  5. 2024Latent Drifting in Diffusion Models for Counterfactual Medical Image Synthesis30 Dec
  6. 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generation17 Dec
  7. 2024Volumetric Conditioning Module to Control Pretrained Diffusion Models for 3D Medical Images29 Oct
  8. 2023Learned representation-guided diffusion models for large-image generation12 Dec
  9. 2023Adaptive Latent Diffusion Model for 3D Medical Image to Image Translation: Multi-modal Magnetic Resonance Imaging Study1 Nov
  10. 2023GenerateCT: Text-Conditional Generation of 3D Chest CT Volumes25 May

Other references · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  9. 2022Scalable Diffusion Models with Transformerscited by 5,931
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  12. 2017Neural Discrete Representation Learningcited by 4,650
31 more
  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  2. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  4. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  5. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
  6. 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
  7. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
  8. 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 159
  9. 2023Multimodal Prompting with Missing Modalities for Visual Recognitioncited by 121
  10. 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generationcited by 110
  11. 2023VDT: General-purpose Video Diffusion Transformers via Mask Modelingcited by 102
  12. 2019Missing MRI Pulse Sequence Synthesis using Multi-Modal Generative Adversarial Networkcited by 98
  13. 2020Cardiac Segmentation on Late Gadolinium Enhancement MRI: A Benchmark Study from Multi-Sequence Cardiac MR Segmentation Challengecited by 41
  14. 2023Fast Diffusion-Based Counterfactuals for Shortcut Removal and Generationcited by 41
  15. 2022One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputationcited by 40
  16. 2022Self-Guided Diffusion Modelscited by 36
  17. 2024Generative AI for Synthetic Data Across Multiple Medical Modalities: A Systematic Review of Recent Developments and Challengescited by 24
  18. 2021Self-supervised Spatiotemporal Representation Learning by Exploiting Video Continuitycited by 22
  19. 2024Multi-modal Vision Pre-training for Medical Image Analysiscited by 22
  20. 2025Noise-Consistent Siamese-Diffusion for Medical Image Synthesis and Segmentationcited by 21
  21. 2024Measuring Cross-Modal Interactions in Multimodal Modelscited by 16
  22. 2022FakeNews: GAN-based generation of realistic 3D volumetric data -- A systematic review and taxonomycited by 13
  23. 2024DiffuX2CT: Diffusion Learning to Reconstruct CT Images from Biplanar X-Rayscited by 9
  24. 2025Knowledge Bridger: Towards Training-free Missing Modality Completioncited by 9
  25. 2025TRACE: Temporally Reliable Anatomically-Conditioned 3D CT Generation with Enhanced Efficiencycited by 8
  26. 2024Part-aware Prompted Segment Anything Model for Adaptive Segmentationcited by 5
  27. 2024Learning Modality-Aware Representations: Adaptive Group-wise Interaction Network for Multimodal MRI Synthesiscited by 4
  28. 2025Structure-aware Semantic Discrepancy and Consistency for 3D Medical Image Self-supervised Learningcited by 4
  29. 2024MRGen: Segmentation Data Engine for Underrepresented MRI Modalitiescited by 3
  30. 2025SAGCNet: Spatial-Aware Graph Completion Network for Missing Slice Imputation in Population CMR Imagingcited by 3
  31. 2026UniX: Unifying Autoregression and Diffusion for Chest X-Ray Understanding and Generationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025SLaM-DiMM: Shared Latent Modeling for Diffusion Based Missing Modality Synthesis in MRI
  2. 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis
  3. 2023Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis
  4. 2026CardioDiT: Latent Diffusion Transformers for 4D Cardiac MRI Synthesis
  5. 2025Reconstruct or Generate: Exploring the Spectrum of Generative Modeling for Cardiac MRI
  6. 2025Lesion-Aware Post-Training of Latent Diffusion Models for Synthesizing Diffusion MRI from CT Perfusion
  7. 2026BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation
  8. 2025Deep generative priors for 3D brain analysis