mlsanityData to 7 Oct 2026

Generative AI and Foundation Models in Medical Image

arXiv 2608.01686 ↗First posted 3 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In recent years, generative AI has attracted significant public attention, and its use has been rapidly expanding across a wide range of domains. From creative tasks such as text summarization, idea generation, and source code generation, to the streamlining of medical support tasks like diagnostic report generation and summarization, AI is now deeply involved in many areas. Today's breadth of AI applications is clearly distinct from what was seen before generative AI gained widespread recognition. Representative generative AI services include DALL-E 3 (OpenAI, California, USA) and Stable Diffusion (Stability AI, London, England, UK) for image generation, ChatGPT (OpenAI, California, USA), and Gemini (Google, California, USA) for text generation. The rise of generative AI has been influenced by advances in deep learning models and the scaling up of data, models, and computational resources based on the scaling laws. Moreover, the emergence of foundation models, which are trained on large-scale datasets and possess general-purpose knowledge applicable to various downstream tasks, is creating a new paradigm in AI development. These shifts brought about by generative AI and foundation models also profoundly impact medical image processing, fundamentally changing the framework for AI development in healthcare. This paper provides an overview of diffusion models used in image generation AI and large language models (LLMs) used in text generation AI, and introduces their applications in medical support. This paper also discusses foundation models, which are gaining attention alongside generative AI, including their construction methods and applications in the medical field. Finally, the paper explores how to develop foundation models and high-performance AI for medical support by fully utilizing national data and computational resources.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 60 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

42 of 60 references.

References · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  6. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  7. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  8. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  9. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  10. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  11. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  12. 2020Scaling Laws for Neural Language Modelscited by 6,411
30 more
  1. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  2. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  4. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  6. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  7. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
  8. 2021Scaling Vision Transformerscited by 993
  9. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  10. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  11. 2022Brain Imaging Generation with Latent Diffusion Modelscited by 267
  12. 2023Segment Anything in Medical Imagescited by 226
  13. 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 210
  14. 2022The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrinkcited by 183
  15. 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Modelcited by 180
  16. 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
  17. 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 151
  18. 2022Contrastive Masked Autoencoders are Stronger Vision Learnerscited by 133
  19. 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformercited by 124
  20. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  21. 2022What to Hide from Your Students: Attention-Guided Masked Image Modelingcited by 117
  22. 2023What Do Self-Supervised Vision Transformers Learn?cited by 90
  23. 2022Diffusion Deformable Model for 4D Temporal Medical Image Generationcited by 65
  24. 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathologycited by 57
  25. 2023AbdomenAtlas-8K: Annotating 8,000 CT Volumes for Multi-Organ Segmentation in Three Weekscited by 52
  26. 2023BerDiff: Conditional Bernoulli Diffusion Model for Medical Image Segmentationcited by 27
  27. 2024Enhancing Label-efficient Medical Image Segmentation with Text-guided Diffusion Modelscited by 13
  28. 2022Physiology-based simulation of the retinal vasculature enables annotation-free segmentation of OCT angiographscited by 12
  29. 2024Diff-VPS: Video Polyp Segmentation via a Multi-task Diffusion Network with Adversarial Temporal Reasoningcited by 6
  30. 2024Image Synthesis with Class-Aware Semantic Diffusion Models for Surgical Scene Segmentationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape
  2. 2025Foundation Model in Biomedicine
  3. 2025Generative Artificial Intelligence and Agents in Research and Teaching
  4. 2026Smart Content Ingestion for Generative AI Workloads
  5. 2024AI and Generative AI for Research Discovery and Summarization
  6. 2024Natural Language Programming in Medicine: Administering Evidence Based Clinical Workflows with Autonomous Agents Powered by Generative Large Language Models
  7. 2025From large language models to multimodal AI: A scoping review on the potential of generative AI in medicine
  8. 2024Free to play: UN Trade and Development's experience with developing its own open-source Retrieval Augmented Generation Large Language Model application