mlsanityData to 14 Oct 2026

AURAD: Anatomy-Pathology Unified Radiology Synthesis with Progressive Representations

arXiv 2509.04819 ↗First posted 5 Sep 2025eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Medical image synthesis has become an essential strategy for augmenting datasets and improving model generalization in data-scarce clinical settings. However, fine-grained and controllable synthesis remains difficult due to limited high-quality annotations and domain shifts across datasets. Existing methods, often designed for natural images or well-defined tumors, struggle to generalize to chest radiographs, where disease patterns are morphologically diverse and tightly intertwined with anatomical structures. To address these challenges, we propose AURAD, a controllable radiology synthesis framework that jointly generates high-fidelity chest X-rays and pseudo semantic masks. Unlike prior approaches that rely on randomly sampled masks-limiting diversity, controllability, and clinical relevance-our method learns to generate masks that capture multi-pathology coexistence and anatomical-pathological consistency. It follows a progressive pipeline: pseudo masks are first generated from clinical prompts conditioned on anatomical structures, and then used to guide image synthesis. We also leverage pretrained expert medical models to filter outputs and ensure clinical plausibility. Beyond visual realism, the synthesized masks also serve as labels for downstream tasks such as detection and segmentation, bridging the gap between generative modeling and real-world clinical applications. Extensive experiments and blinded radiologist evaluations demonstrate the effectiveness and generalizability of our method across tasks and datasets. In particular, 78% of our synthesized images are classified as authentic by board-certified radiologists, and over 40% of predicted segmentation overlays are rated as clinically useful. All code, pre-trained models, and the synthesized dataset will be released upon publication.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 62 references that are in the map. First posted on arXiv 5 Sep 2025.

Builds on

45 of 62 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2017Mask R-CNNcited by 7,277
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
  10. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
  11. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  12. 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 597
33 more
  1. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
  2. 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 461
  3. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
  4. 2018GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classificationcited by 242
  5. 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 239
  6. 2022Diffusion Models for Medical Anomaly Detectioncited by 232
  7. 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Modelcited by 180
  8. 2021TorchXRayVision: A library of chest X-ray datasets and modelscited by 131
  9. 2018Translating and Segmenting Multimodal Medical Volumes with Cycle- and Shape-Consistency Generative Adversarial Networkcited by 97
  10. 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
  11. 2022Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domainscited by 86
  12. 2024Towards Generalizable Tumor Synthesiscited by 65
  13. 2023LayoutDM: Transformer-based Diffusion Model for Layout Generationcited by 57
  14. 2023Label-Free Liver Tumor Segmentationcited by 56
  15. 2024Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Modelscited by 43
  16. 2020ChestX-Det10: Chest X-ray Dataset on Detection of Thoracic Abnormalitiescited by 38
  17. 2021A Structure-Aware Relation Network for Thoracic Diseases Detection and Segmentationcited by 34
  18. 2023MedGen3D: A Deep Generative Framework for Paired 3D Image and Mask Generationcited by 34
  19. 2023Cascaded Latent Diffusion Models for High-Resolution Chest X-ray Synthesiscited by 32
  20. 2023BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeyscited by 29
  21. 2023RadEdit: stress-testing biomedical vision models via diffusion image editingcited by 28
  22. 2022Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Modelscited by 27
  23. 2021GAN-Based Data Augmentation and Anonymization for Skin-Lesion Analysis: A Critical Reviewcited by 25
  24. 2023DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Modelcited by 23
  25. 2023Complex Organ Mask Guided Radiology Report Generationcited by 22
  26. 2023Boosting Dermatoscopic Lesion Segmentation via Diffusion Models with Visual and Textual Promptscited by 17
  27. 2024Chest-Diffusion: A Light-Weight Text-to-Image Model for Report-to-CXR Generationcited by 16
  28. 2017Abnormality Detection and Localization in Chest X-Rays using Deep Convolutional Neural Networkscited by 14
  29. 2021A multi-stage GAN for multi-organ chest X-ray image generation and segmentationcited by 8
  30. 2024XReal: Realistic Anatomy and Pathology-Aware X-ray Generation via Controllable Diffusion Modelcited by 8
  31. 2020XRayGAN: Consistency-preserving Generation of X-ray Images from Radiology Reportscited by 3
  32. 2024Evaluating and Improving the Effectiveness of Synthetic Chest X-Rays for Medical Image Analysiscited by 3
  33. 2024MaskMedPaint: Masked Medical Image Inpainting with Diffusion Models for Mitigation of Spurious Correlationscited by 2

Built on by

Not cited yet.