Multiscale Structure-Guided Latent Diffusion for Multimodal MRI Translation
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Although diffusion models have achieved remarkable progress in multi-modal magnetic resonance imaging (MRI) translation tasks, existing methods still tend to suffer from anatomical inconsistencies or degraded texture details when handling arbitrary missing-modality scenarios. To address these issues, we propose a latent diffusion-based multi-modal MRI translation framework, termed MSG-LDM. By leveraging the available modalities, the proposed method infers complete structural information, which preserves reliable boundary details. Specifically, we introduce a style--structure disentanglement mechanism in the latent space, which explicitly separates modality-specific style features from shared structural representations, and jointly models low-frequency anatomical layouts and high-frequency boundary details in a multi-scale feature space. During the structure disentanglement stage, high-frequency structural information is explicitly incorporated to enhance feature representations, guiding the model to focus on fine-grained structural cues while learning modality-invariant low-frequency anatomical representations. Furthermore, to reduce interference from modality-specific styles and improve the stability of structure representations, we design a style consistency loss and a structure-aware loss. Extensive experiments on the BraTS2020 and WMH datasets demonstrate that the proposed method outperforms existing MRI synthesis approaches, particularly in reconstructing complete structures. The source code is publicly available at https://github.com/ziyi-start/MSG-LDM.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 18 of its 26 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
18 of 26 references.
Closest ancestors · 5
Same direction, newest first
- 2024WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis29 Feb
- 2023Adaptive Latent Diffusion Model for 3D Medical Image to Image Translation: Multi-modal Magnetic Resonance Imaging Study1 Nov
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis29 May
- 2023Cycle-guided Denoising Diffusion Probability Model for 3D Cross-modality MRI Synthesis28 Apr
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Models17 Jul
Other references · 13
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2017Neural Discrete Representation Learningcited by 4,650
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2021Variational Diffusion Modelscited by 1,145
- 2018Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challengecited by 508
- 2019Standardized Assessment of Automatic Segmentation of White Matter Hyperintensities and Results of the WMH Segmentation Challengecited by 115
- 2019Missing MRI Pulse Sequence Synthesis using Multi-Modal Generative Adversarial Networkcited by 98
- 2024Similarity and Quality Metrics for MR Image-To-Image Translationcited by 20
- 2019High Frequency Residual Learning for Multi-Scale Image Classificationcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Physics-Informed Latent Diffusion for Multimodal Brain MRI Synthesis
- 2023CoLa-Diff: Conditional Latent Diffusion Model for Multi-Modal MRI Synthesis
- 2025Lesion-Aware Post-Training of Latent Diffusion Models for Synthesizing Diffusion MRI from CT Perfusion
- 2025Pattern-Aware Diffusion Synthesis of fMRI/dMRI with Tissue and Microstructural Refinement
- 2026Multimodal synthesis of MRI and tabular data with diffusion in a joint latent space via cross-attention
- 20253D Wavelet Latent Diffusion Model for Whole-Body MR-to-CT Modality Translation
- 2025SLaM-DiMM: Shared Latent Modeling for Diffusion Based Missing Modality Synthesis in MRI
- 2024Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusion