mlsanityData to 7 Oct 2026

Virtual Full-stack Scanning of Brain MRI via Imputing Any Quantised Code

arXiv 2501.18328 ↗First posted 30 Jan 2025cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Magnetic resonance imaging (MRI) is a powerful and versatile imaging technique, offering a wide spectrum of information about the anatomy by employing different acquisition modalities. However, in the clinical workflow, it is impractical to collect all relevant modalities due to the scan time and cost constraints. Virtual full-stack scanning aims to impute missing MRI modalities from available but incomplete acquisitions, offering a cost-efficient solution to enhance data completeness and clinical usability. Existing imputation methods often depend on global conditioning or modality-specific designs, which limit their generalisability across patient cohorts and imaging protocols. To address these limitations, we propose CodeBrain, a unified framework that reformulates various ``any-to-any'' imputation tasks as a region-level full-stack code prediction problem. CodeBrain adopts a two-stage pipeline: (1) it learns the compact representation of a complete MRI modality set by encoding it into scalar-quantised codes at the region level, enabling high-fidelity image reconstruction after decoding these codes along with modality-agnostic common features; (2) it trains a projection encoder to predict the full-stack code map from incomplete modalities via a grading-based design for diverse imputation scenarios. Extensive experiments on two public brain MRI datasets, i.e., IXI and BraTS 2023, demonstrate that CodeBrain consistently outperforms state-of-the-art methods, establishing a new benchmark for unified brain MRI imputation and enabling virtual full-stack scanning. Our code will be released at https://github.com/ycwu1997/CodeBrain.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 35 of its 53 references that are in the map. First posted on arXiv 30 Jan 2025.

Builds on

35 of 53 references.

References · 35

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2017Neural Discrete Representation Learningcited by 4,650
  3. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  4. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  5. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  6. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  7. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  8. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  9. 2022Simple Baselines for Image Restorationcited by 701
  10. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
  11. 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
  12. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
23 more
  1. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
  2. 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 295
  3. 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 235
  4. 2021Checkerboard Context Model for Efficient Learned Image Compressioncited by 193
  5. 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
  6. 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 131
  7. 2022MoVQ: Modulating Quantized Vectors for High-Fidelity Image Generationcited by 125
  8. 2022Adaptive Diffusion Priors for Accelerated MRI Reconstructioncited by 117
  9. 2024Image and Video Tokenization with Binary Spherical Quantizationcited by 110
  10. 2019Missing MRI Pulse Sequence Synthesis using Multi-Modal Generative Adversarial Networkcited by 98
  11. 2024MAISI: Medical AI for Synthetic Imagingcited by 86
  12. 2024Addressing Representation Collapse in Vector Quantized Models with One Linear Layercited by 77
  13. 2023Towards Accurate Image Coding: Improved Autoregressive Image Generation with Dynamic Vector Quantizationcited by 59
  14. 2020Hierarchical Quantized Autoencoderscited by 55
  15. 2023The ASNR-MICCAI Brain Tumor Segmentation (BraTS) Challenge 2023: Intracranial Meningiomacited by 51
  16. 2022One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputationcited by 40
  17. 2023Disentanglement via Latent Quantizationcited by 40
  18. 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 39
  19. 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translationcited by 26
  20. 2022One Model to Unite Them All: Personalized Federated Learning of Multi-Contrast MRI Synthesiscited by 22
  21. 2024Unified Cross-Modal Medical Image Synthesis with Hierarchical Mixture of Product-of-Expertscited by 8
  22. 2024BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilitiescited by 5
  23. 2024Learning Modality-Aware Representations: Adaptive Group-wise Interaction Network for Multimodal MRI Synthesiscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.