mlsanityData to 7 Oct 2026

Exploring Foundation Models for Synthetic Medical Imaging: A Study on Chest X-Rays and Fine-Tuning Techniques

arXiv 2409.04424 ↗First posted 6 Sep 2024eess.IV cs.CV cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine learning has significantly advanced healthcare by aiding in disease prevention and treatment identification. However, accessing patient data can be challenging due to privacy concerns and strict regulations. Generating synthetic, realistic data offers a potential solution for overcoming these limitations, and recent studies suggest that fine-tuning foundation models can produce such data effectively. In this study, we explore the potential of foundation models for generating realistic medical images, particularly chest x-rays, and assess how their performance improves with fine-tuning. We propose using a Latent Diffusion Model, starting with a pre-trained foundation model and refining it through various configurations. Additionally, we performed experiments with input from a medical professional to assess the realism of the images produced by each trained model.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 35 references that are in the map. First posted on arXiv 6 Sep 2024.

Builds on

28 of 35 references.

References · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  8. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  10. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  11. 2019Language Models as Knowledge Bases?cited by 1,922
  12. 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 896
16 more
  1. 2016Generative Adversarial Text to Image Synthesiscited by 735
  2. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
  3. 20218-bit Optimizers via Block-wise Quantizationcited by 395
  4. 2017Data Augmentation Generative Adversarial Networkscited by 278
  5. 2022Brain Imaging Generation with Latent Diffusion Modelscited by 267
  6. 2022Re-Imagen: Retrieval-Augmented Text-to-Image Generatorcited by 208
  7. 2023Prodigy: An Expeditiously Adaptive Parameter-Free Learnercited by 129
  8. 2021LAFITE: Towards Language-Free Training for Text-to-Image Generationcited by 126
  9. 2023Learning-Rate-Free Learning by D-Adaptationcited by 113
  10. 2023Foundational Models in Medical Imaging: A Comprehensive Survey and Future Visioncited by 74
  11. 2022Generation of Anonymous Chest Radiographs Using Latent Diffusion Models for Training Thoracic Abnormality Classification Systemscited by 44
  12. 2022Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Modelscited by 27
  13. 2021GAN-based Data Augmentation for Chest X-ray Classificationcited by 18
  14. 2020PCA-SRGAN: Incremental Orthogonal Projection Discrimination for Face Super-resolutioncited by 10
  15. 2020Precision Health Data: Requirements, Challenges and Existing Techniques for Data Security and Privacycited by 10
  16. 2019Using Big Five Personality Model to Detect Cultural Aspects in Crowdscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Evaluating and Improving the Effectiveness of Synthetic Chest X-Rays for Medical Image Analysis
  2. 2026Scaling Generative Foundation Models for Chest Radiography with Rectified Flow Transformers
  3. 2025A Generative Foundation Model for Chest Radiography
  4. 2026A data- and compute-efficient chest X-ray foundation model beyond aggressive scaling
  5. 2023Cascaded Latent Diffusion Models for High-Resolution Chest X-ray Synthesis
  6. 2025Improving Performance, Robustness, and Fairness of Radiographic AI Models with Finely-Controllable Synthetic Data
  7. 2023Synthetically Enhanced: Unveiling Synthetic Data's Potential in Medical Imaging Research
  8. 2025Foundation Models in Biomedical Imaging: Turning Hype into Reality