mlsanityData to 7 Oct 2026

VoxStruct3D: Structure-Leading Flow Matching for Voxel-Space 3D MRI Synthesis

arXiv 2608.04557 ↗First posted 5 Aug 2026cs.CVcited by 0

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

High-fidelity 3D MRI synthesis requires both globally coherent anatomy and fine-grained voxel-level detail. Although latent diffusion makes volumetric generation tractable, its image autoencoder introduces a reconstruction bottleneck that can limit the fine detail recoverable in the final volume. We present VoxStruct3D, a voxel-space flow-matching framework that directly models full-resolution MRI volumes using a clean-data prediction objective. Its Volumetric Voxel Generator (VVG) combines factorized 3D patch embedding with overlapping upsampling, time-modulated residual refinement, and skip fusion, enabling neighboring tokens to jointly reconstruct shared voxel regions and suppress patch-boundary artifacts. To complement direct voxel-space modeling with an explicit anatomical prior, we further introduce a Structure-First, Image-Follows (SFIF) strategy. A frozen pretrained 3D medical encoder and a StructVAE extract compact structure tokens that preserve dominant anatomy, while a structure-leading schedule keeps their trajectory ahead of the image trajectory. Patch-Aligned RoPE spatially aligns the unequal token grids, and asymmetric attention enforces one-way guidance from structure to image. Experiments on pathological and healthy T1-weighted brain MRI datasets show that VoxStruct3D achieves the strongest overall performance across feature-distribution alignment, sample diversity, and perceptual quality, producing anatomically coherent and visually realistic volumes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 19 of its 36 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

19 of 36 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026WFM: 3D Wavelet Flow Matching for Ultrafast Multi-Modal MRI Synthesis22 Apr
  2. 2026FlowLet: Conditional 3D Brain MRI Synthesis using Wavelet Flow Matching8 Jan
  3. 2025MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Loss7 Aug
  4. 2025Flow Matching for Medical Image Synthesis: Bridging the Gap Between Speed and Quality1 Mar
  5. 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generation17 Dec
  6. 2024MAISI: Medical AI for Synthetic Imaging13 Sep
  7. 2024WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis29 Feb
  8. 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis29 May

Other references · 11

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
  3. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  4. 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
  5. 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 282
  6. 2019Convolutional Neural Networks for Classification of Alzheimer's Disease: Overview and Reproducible Evaluationcited by 106
  7. 2025PixelFlow: Pixel-Space Generative Models with Flowcited by 91
  8. 2025PixelDiT: Pixel Diffusion Transformers for Image Generationcited by 75
  9. 2020Hierarchical Amortized Training for Memory-efficient High Resolution 3D GANcited by 60
  10. 2025U-REPA: Aligning Diffusion U-Nets to ViTscited by 29
  11. 2026PiD: Fast and High-Resolution Latent Decoding with Pixel Diffusioncited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis
  2. 2026WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesis
  3. 2026Compositional Cross-Modality Translation via Whole-Volume Multitask Latent Flow Matching
  4. 2026Unified Multi-plane Autoregressive Diffusion for 3D Multi-contrast MRI Synthesis
  5. 2026Structure-Adaptive Sparse Diffusion in Voxel Space for 3D Medical Image Enhancement
  6. 2024X-Diffusion: Generating Detailed 3D MRI Volumes From a Single Image Using Cross-Sectional Diffusion Models
  7. 2026Sketch2CT: Multimodal Diffusion for Structure-Aware 3D Medical Volume Generation
  8. 2026BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation