Fully Guided Neural Schr"odinger bridge for Brain MR image synthesis
Not on the map. Why?
Abstract (arXiv)
Multi-modal brain MRI provides essential complementary information for clinical diagnosis. However, acquiring all modalities in practice is often constrained by time and cost. To address this, various methods have been proposed to generate missing modalities from available ones. Existing approaches can be broadly categorized into two types: paired and unpaired methods. While paired methods achieve high synthesis accuracy, obtaining large-scale paired datasets is typically impractical. In contrast, unpaired methods, though more scalable, often fail to preserve critical anatomical features, such as lesions. In this paper, we propose Fully Guided Schr"odinger Bridge (FGSB), a novel framework designed to overcome these limitations by enabling high-fidelity generation with extremely limited paired data. When lesion-specific information, such as expert annotations or segmentation masks, is available, FGSB preserves clinically relevant lesions during missing modality synthesis. Our model comprises two stages: (1) a generation stage that iteratively refines synthetic images using paired source images and Gaussian noise, and (2) a training stage that learns optimal transformation pathways by modeling intermediate states to ensure consistent, high-fidelity synthesis. Experimental results across multiple datasets demonstrate that FGSB achieves reliable synthesis performance across diverse imaging resolutions and data acquisition environments. In addition, incorporating lesion-specific priors further enhances the preservation of clinically relevant features.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 37 references that are in the map. First posted on arXiv 24 Jan 2025.
Builds on
25 of 37 references.
References · 25
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2018MINE: Mutual Information Neural Estimationcited by 683
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 516
- 2018Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challengecited by 511
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 192
- 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
13 more
- 2019Automated brain extraction of multi-sequence MRI using artificial neural networkscited by 134
- 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 132
- 2022Adaptive Diffusion Priors for Accelerated MRI Reconstructioncited by 118
- 2019Standardized Assessment of Automatic Segmentation of White Matter Hyperintensities and Results of the WMH Segmentation Challengecited by 115
- 2023Unpaired Image-to-Image Translation via Neural Schr"odinger Bridgecited by 96
- 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
- 2023CoLa-Diff: Conditional Latent Diffusion Model for Multi-Modal MRI Synthesiscited by 65
- 2018InstaGAN: Instance-aware Image-to-Image Translationcited by 37
- 2019mustGAN: Multi-Stream Generative Adversarial Networks for MR Image Synthesiscited by 34
- 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modelingcited by 26
- 2023Structure-Preserving Synthesis: MaskGAN for Unpaired MR-CT Translationcited by 19
- 2022Where is VALDO? VAscular Lesions Detection and segmentatiOn challenge at MICCAI 2021cited by 14
- 2022Multi-scale Transformer Network with Edge-aware Pre-training for Cross-Modality MR Image Synthesiscited by 13
Built on by
Not cited yet.