X-Diffusion: Generating Detailed 3D MRI Volumes From a Single Image Using Cross-Sectional Diffusion Models
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Magnetic Resonance Imaging (MRI) is a crucial diagnostic tool, but high-resolution scans are often slow and expensive due to extensive data acquisition requirements. Traditional MRI reconstruction methods aim to expedite this process by filling in missing frequency components in the K-space, performing 3D-to-3D reconstructions that demand full 3D scans. In contrast, we introduce X-Diffusion, a novel cross-sectional diffusion model that reconstructs detailed 3D MRI volumes from extremely sparse spatial-domain inputs, achieving 2D-to-3D reconstruction from as little as a single 2D MRI slice or few slices. A key aspect of X-Diffusion is that it models MRI data as holistic 3D volumes during the cross-sectional training and inference, unlike previous learning approaches that treat MRI scans as collections of 2D slices in standard planes (coronal, axial, sagittal). We evaluated X-Diffusion on brain tumor MRIs from the BRATS dataset and full-body MRIs from the UK Biobank dataset. Our results demonstrate that X-Diffusion not only surpasses state-of-the-art methods in quantitative accuracy (PSNR) on unseen data but also preserves critical anatomical features such as tumor profiles, spine curvature, and brain volume. Remarkably, the model generalizes beyond the training domain, successfully reconstructing knee MRIs despite being trained exclusively on brain data. Medical expert evaluations further confirm the clinical relevance and fidelity of the generated images. To our knowledge, X-Diffusion is the first method capable of producing detailed 3D MRIs from highly limited 2D input data, potentially accelerating MRI acquisition and reducing associated costs. The code is available on the project website https://emmanuelleb985.github.io/XDiffusion/ .
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 58 of its 99 references that are in the map. First posted on arXiv 30 Apr 2024.
Builds on
58 of 99 references.
Closest ancestors · 3
Same direction, newest first
- 2023Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models15 Mar
- 2022Solving 3D Inverse Problems using Pre-trained 2D Diffusion Models19 Nov
- 2021Score-based diffusion models for accelerated MRI8 Oct
Other references · 55
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
38 more
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
- 2015Multi-view Convolutional Neural Networks for 3D Shape Recognitioncited by 565
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 508
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 470
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 422
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 232
- 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 182
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2020MVTN: Multi-View Transformation Network for 3D Shape Recognitioncited by 140
- 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Imagecited by 111
- 2017Compressed Sensing MRI Reconstruction using a Generative Adversarial Network with a Cyclic Losscited by 82
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
- 2023DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Modelcited by 43
- 2017On the Compactness, Efficiency, and Representation of 3D Convolutional Networks: Brain Parcellation as a Pretext Taskcited by 36
- 2022Conffusion: Confidence Intervals for Diffusion Modelscited by 33
- 2023TOSS:High-quality Text-guided Novel View Synthesis from a Single Imagecited by 26
- 2017Self-Supervised Learning for Spinal MRIscited by 24
- 2021Voint Cloud: Multi-View Point Cloud Representation for 3D Understandingcited by 22
- 2022SPARF: Large-Scale Learning of 3D Sparse Radiance Fields from Few Input Imagescited by 17
- 2020A Convolutional Approach to Vertebrae Detection and Labelling in Whole Spine MRIcited by 12
- 2023SinMPI: Novel View Synthesis from a Single Image with Expanded Multiplane Imagescited by 11
- 2019Fully Automated Multi-Organ Segmentation in Abdominal Magnetic Resonance Imaging with Deep Neural Networkscited by 8
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 3.
5 papers.
- 2025UKBOB: One Billion MRI Labeled Masks for Generalizable 3D Medical Image Segmentationcited by 4
- 2024X-ray2CTPA: Leveraging Diffusion Models to Enhance Pulmonary Embolism Classificationcited by 2
- 2026Interpretable Motion Artificat Detection in structural Brain MRIcited by 1
- 2026Single-Slice-to-3D Reconstruction in Medical Imaging and Natural Objects: A Comparative Benchmark with SAM 3Dcited by 0
- 2026MK-ResRecon: Multi-Kernel Residual Framework for Texture-Aware 3D MRI Refinement from Sparse 2D Slicescited by 0
- 2026MK-ResRecon: Multi-Kernel Residual Framework for Texture-Aware 3D MRI Refinement from Sparse 2D Slices5 May 2026
- 2026Interpretable Motion Artificat Detection in structural Brain MRI5 Mar 2026
- 2026Single-Slice-to-3D Reconstruction in Medical Imaging and Natural Objects: A Comparative Benchmark with SAM 3D10 Feb 2026
- 2025UKBOB: One Billion MRI Labeled Masks for Generalizable 3D Medical Image Segmentation9 Apr 2025
- 2024X-ray2CTPA: Leveraging Diffusion Models to Enhance Pulmonary Embolism Classification23 Jun 2024
Similar, not cited
Close in wording, no citation either way
- 2026Improving 2D Diffusion Models for 3D Medical Imaging with Inter-Slice Consistent Stochasticity
- 2024Resolution-Robust 3D MRI Reconstruction with 2D Diffusion Priors: Diverse-Resolution Training Outperforms Interpolation
- 2026Unified Multi-plane Autoregressive Diffusion for 3D Multi-contrast MRI Synthesis
- 2023Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis
- 2025ReBrain: Brain MRI Reconstruction from Sparse CT Slice via Retrieval-Augmented Diffusion
- 2026DM4CT: Benchmarking Diffusion Models for Computed Tomography Reconstruction
- 2026Uncertainty-Aware 3D Residual Wavelet Diffusion for Ultra Low-Field MRI Super-Resolution
- 2024Diff5T: Benchmarking Human Brain Diffusion MRI with an Extensive 5.0 Tesla K-Space and Spatial Dataset