mlsanityData to 14 Oct 2026

ViCTr: Vital Consistency Transfer for Pathology Aware Image Synthesis

arXiv 2505.04963 ↗First posted 8 May 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Synthesizing medical images remains challenging due to limited annotated pathological data, modality domain gaps, and the complexity of representing diffuse pathologies such as liver cirrhosis. Existing methods often struggle to maintain anatomical fidelity while accurately modeling pathological features, frequently relying on priors derived from natural images or inefficient multi-step sampling. In this work, we introduce ViCTr (Vital Consistency Transfer), a novel two-stage framework that combines a rectified flow trajectory with a Tweedie-corrected diffusion process to achieve high-fidelity, pathology-aware image synthesis. First, we pretrain ViCTr on the ATLAS-8k dataset using Elastic Weight Consolidation (EWC) to preserve critical anatomical structures. We then fine-tune the model adversarially with Low-Rank Adaptation (LoRA) modules for precise control over pathology severity. By reformulating Tweedie's formula within a linear trajectory framework, ViCTr supports one-step sampling, reducing inference from 50 steps to just 4, without sacrificing anatomical realism. We evaluate ViCTr on BTCV (CT), AMOS (MRI), and CirrMRI600+ (cirrhosis) datasets. Results demonstrate state-of-the-art performance, achieving a Medical Frechet Inception Distance (MFID) of 17.01 for cirrhosis synthesis 28% lower than existing approaches and improving nnUNet segmentation by +3.8% mDSC when used for data augmentation. Radiologist reviews indicate that ViCTr-generated liver cirrhosis MRIs are clinically indistinguishable from real scans. To our knowledge, ViCTr is the first method to provide fine-grained, pathology-aware MRI synthesis with graded severity control, closing a critical gap in AI-driven medical imaging research.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 8 May 2025.

Builds on

38 of 52 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  10. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  11. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  12. 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentationcited by 351
26 more
  1. 2023Effective Data Augmentation With Diffusion Modelscited by 283
  2. 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Modelcited by 180
  3. 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 162
  4. 2023Diverse Data Augmentation with Diffusions for Effective Test-time Prompt Tuningcited by 154
  5. 2024Improving the Training of Rectified Flowscited by 108
  6. 2023Diversify Your Vision Datasets with Automatic Diffusion-Based Augmentationcited by 100
  7. 2016Medical Image Synthesis with Context-Aware Generative Adversarial Networkscited by 91
  8. 2023Leaving Reality to Imagination: Robust Classification via Generated Datasetscited by 91
  9. 2020On Mixup Regularizationcited by 83
  10. 2024DiffuseMix: Label-Preserving Data Augmentation with Diffusion Modelscited by 78
  11. 2022Diffusion Probabilistic Models beat GANs on Medical Imagescited by 77
  12. 2023IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Modelscited by 72
  13. 2020Multi-organ Segmentation over Partially Labeled Datasets with Multi-scale Feature Abstractioncited by 70
  14. 2024Anatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Modelscited by 69
  15. 2024Towards Generalizable Tumor Synthesiscited by 65
  16. 2023AbdomenAtlas-8K: Annotating 8,000 CT Volumes for Multi-Organ Segmentation in Three Weekscited by 52
  17. 2017A Bayesian Data Augmentation Approach for Learning Deep Modelscited by 50
  18. 2024DetDiffusion: Synergizing Generative and Perceptive Models for Enhanced Data Generation and Perceptioncited by 32
  19. 2022Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Modelscited by 27
  20. 2024DreamDA: Generative Data Augmentation with Diffusion Modelscited by 24
  21. 2022How Much More Data Do I Need? Estimating Requirements for Downstream Taskscited by 23
  22. 2023Using Diffusion Models to Generate Synthetic Labelled Data for Medical Image Segmentationcited by 10
  23. 2024Large Scale MRI Collection and Segmentation of Cirrhotic Livercited by 10
  24. 2023MedDiffusion: Boosting Health Risk Prediction via Diffusion-based Data Augmentationcited by 4
  25. 2024GenMix: Combining Generative and Mixture Data Augmentation for Medical Image Classificationcited by 3
  26. 2024DiNO-Diffusion. Scaling Medical Diffusion via Self-Supervised Pre-Trainingcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Scalable next-scale autoregression for medical image generation across anatomical regions
  2. 2026Structure-Guided Histopathology Synthesis via Dual-LoRA Diffusion
  3. 2026MUMINS: Metadata-conditioned Uncertainty-aware Medical Image Next-state Synthesis
  4. 2025MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Loss
  5. 2026PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Images
  6. 2025PathoSyn: Imaging-Pathology MRI Synthesis via Disentangled Deviation Diffusion
  7. 2026A Generative Foundation Model for Multimodal Histopathology
  8. 2025StructDiff: Structure-aware Diffusion Model for 3D Fine-grained Medical Image Synthesis