mlsanityData to 7 Oct 2026

Posterior Samplings are Missing Modalities Generators for Medical Image Translation

arXiv 2607.18763 ↗First posted 21 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Magnetic resonance imaging comes in various modality contrasts that provide complementary anatomical and pathological information. Complete multimodal acquisitions are often unavailable due to time and protocol constraints. This leads to real-world datasets with missing modalities, where conventional medical image translation methods are typically limited to fixed source-target settings or require retraining for each observed source-target pair. We propose a unified framework that formulates missing-modality generation as a linear inverse problem under a joint distribution and solves it via posterior sampling with a flow matching model. By learning a joint prior over the complete modality set, our method can reconstruct arbitrary missing modalities at inference time by guiding the sampling trajectory to enforce measurement consistency with observed modalities. We further mitigate inter-modality error propagation in multi-target generation by adopting a many-to-one sampling strategy. Experiments on BraTS and IXI datasets show that our method achieves the best performance over baselines across most missing-modality scenarios. In downstream tumor segmentation, synthesized images from our method result in higher segmentation performance, indicating better preservation of clinically relevant structures.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 50 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

32 of 50 references.

References · 32

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2022Flow Matching for Generative Modelingcited by 5,426
  9. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  11. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  12. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
20 more
  1. 2017The Perception-Distortion Tradeoffcited by 582
  2. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
  3. 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
  4. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  5. 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 191
  6. 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
  7. 2024A Survey on Diffusion Models for Inverse Problemscited by 173
  8. 2024Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealingcited by 157
  9. 2023Solving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion Modelscited by 156
  10. 2023Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse Problemscited by 129
  11. 2019Standardized Assessment of Automatic Segmentation of White Matter Hyperintensities and Results of the WMH Segmentation Challengecited by 115
  12. 2019Missing MRI Pulse Sequence Synthesis using Multi-Modal Generative Adversarial Networkcited by 98
  13. 2024PnP-Flow: Plug-and-Play Image Restoration with Flow Matchingcited by 92
  14. 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
  15. 2023Prompt-tuning latent diffusion models for inverse problemscited by 70
  16. 2025FlowDPS: Flow-Driven Posterior Sampling for Inverse Problemscited by 65
  17. 2023Adaptive Latent Diffusion Model for 3D Medical Image to Image Translation: Multi-modal Magnetic Resonance Imaging Studycited by 64
  18. 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translationcited by 26
  19. 2024Unified Cross-Modal Medical Image Synthesis with Hierarchical Mixture of Product-of-Expertscited by 8
  20. 2025Regression is all you need for medical image translationcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Compositional Cross-Modality Translation via Whole-Volume Multitask Latent Flow Matching
  2. 2026MPFlow: Multi-modal Posterior-Guided Flow Matching for Zero-Shot MRI Reconstruction
  3. 2025AMM-Diff: Adaptive Multi-Modality Diffusion Network for Missing Modality Imputation
  4. 2025SLaM-DiMM: Shared Latent Modeling for Diffusion Based Missing Modality Synthesis in MRI
  5. 2025Med-K2N: Flexible K-to-N Modality Translation for Medical Image Synthesis
  6. 2025MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Loss
  7. 2026Generative Translation Priors: Bayesian Imaging with Cross-Modality Image Translation
  8. 2026Multimodal synthesis of MRI and tabular data with diffusion in a joint latent space via cross-attention