S2T-Unet: A Structure-to-Style Framework for Inter-Modality MRI Translation
Not on the map. Why?
Abstract (arXiv)
Inter-modality MRI translation aims to synthesize missing MRI modalities from available acquisitions, reducing the need for additional scanning while preserving clinically relevant anatomical information. However, existing image translation methods often learn intensity mappings without explicitly separating modality-invariant structural information from modality-specific appearance, which may lead to structural information loss or unrealistic image details. In this work, we propose S2T-Unet, a structure-to-style framework that explicitly models these two aspects. Specifically, vector quantization is introduced at the lower-level bottleneck to encode modality-invariant structural information using a learned discrete codebook. At higher levels, a modality transformation module uses decoder features to condition and transform encoder representations toward the target modality, thereby recovering modality-specific intensity and contrast information. Experiments on the IXI multi-contrast MRI dataset across four translation tasks demonstrate that S2T-Unet is comparable or outperform with state-of-art method.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 15 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
11 of 15 references.
References · 11
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2022Generative Adversarial Networkscited by 5,627
- 2017Neural Discrete Representation Learningcited by 4,712
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
- 2024Addressing Representation Collapse in Vector Quantized Models with One Linear Layercited by 80
- 2016Semi-supervised Learning using Denoising Autoencoders for Brain Lesion Detection and Segmentationcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Compositional Cross-Modality Translation via Whole-Volume Multitask Latent Flow Matching
- 2026Posterior Samplings are Missing Modalities Generators for Medical Image Translation
- 2026Multiscale Structure-Guided Latent Diffusion for Multimodal MRI Translation
- 2025Med-K2N: Flexible K-to-N Modality Translation for Medical Image Synthesis
- 2025Modality Translation and Registration of MR and Ultrasound Images Using Diffusion Models
- 2025SLaM-DiMM: Shared Latent Modeling for Diffusion Based Missing Modality Synthesis in MRI
- 2026Visual Instruction-Finetuned Language Model for Versatile Brain MR Image Tasks
- 2026Multimodal synthesis of MRI and tabular data with diffusion in a joint latent space via cross-attention