LiFT: Lifted Inter-slice Feature Trajectories for 3D Image Generation from 2D Generators
Not on the map. Why?
Abstract (arXiv)
High-resolution 3D medical image generation remains challenging because fully volumetric models are computationally expensive, while efficient 2D slice generators often fail to preserve anatomical consistency across the third dimension. We propose LiFT, a framework for Lifted inter-slice Feature Trajectories that factorizes 3D volume synthesis into per-slice image generation and inter-slice trajectory learning. Rather than modeling the volumetric distribution end-to-end, LiFT treats a volume as an ordered trajectory in feature space, capturing how anatomical structures appear, transform, and disappear across depth. A tri-planar drifting loss aligns the trajectory of generated slices with the trajectories of real volumes, enabling distributional learning over inter-slice progressions in unconditional generation; in paired translation, a bidirectional z-context mixer trained against the registered target supplies through-plane coherence while preserving per-slice fidelity. We evaluate LiFT on BraTS 2023 (unconditional and missing-modality MR) and SynthRAD2023 (MR-to-CT). Across these settings, LiFT preserves per-slice quality, approaches the reported cWDM missing-MR reconstruction quality at ~135× lower inference cost (without formal equivalence testing), and improves through-plane coherence on MR-to-CT relative to a no-mapper ablation, demonstrating that lightweight inter-slice trajectory learning is a viable route to high-resolution 3D medical synthesis.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 52 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
32 of 52 references.
References · 32
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2016Improved Techniques for Training GANscited by 2,970
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 288
- 2022Brain Imaging Generation with Latent Diffusion Modelscited by 268
- 2015Generative Moment Matching Networkscited by 257
- 2017MMD GAN: Towards Deeper Understanding of Moment Matching Networkcited by 254
- 2018GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classificationcited by 242
20 more
- 2018Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networkscited by 147
- 2026Generative Modeling via Driftingcited by 116
- 2021MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluationcited by 88
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesiscited by 86
- 2023Adaptive Latent Diffusion Model for 3D Medical Image to Image Translation: Multi-modal Magnetic Resonance Imaging Studycited by 64
- 2020Hierarchical Amortized Training for Memory-efficient High Resolution 3D GANcited by 60
- 2024WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesiscited by 56
- 2023Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesiscited by 43
- 2020SAINT: Spatially Aware Interpolation NeTwork for Medical Slice Synthesiscited by 37
- 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generationcited by 37
- 2023Memory-Efficient 3D Denoising Diffusion Models for Medical Image Processingcited by 30
- 2024Generative AI for Synthetic Data Across Multiple Medical Modalities: A Systematic Review of Recent Developments and Challengescited by 24
- 2023Structure-Preserving Synthesis: MaskGAN for Unpaired MR-CT Translationcited by 19
- 2024cWDM: Conditional Wavelet Diffusion Models for Cross-Modality 3D Medical Image Synthesiscited by 19
- 2024Slice-Consistent 3D Volumetric Brain CT-to-MRI Translation with 2D Brownian Bridge Diffusion Modelcited by 16
- 20242.5D Multi-view Averaging Diffusion Model for 3D Medical Image Translation: Application to Low-count PET Reconstruction with CT-less Attenuation Correctioncited by 13
- 2024Latent Drifting in Diffusion Models for Counterfactual Medical Image Synthesiscited by 13
- 2023CSAM: A 2.5D Cross-Slice Attention Module for Anisotropic Volumetric Medical Image Segmentationcited by 7
- 20243D MRI Synthesis with Slice-Based Latent Diffusion Models: Improving Tumor Segmentation Tasks in Data-Scarce Regimescited by 6
- 2026MRI-to-CT synthesis using drifting modelscited by 2
Built on by
Not cited yet.