mlsanityData to 14 Oct 2026

Artificial General Intelligence for Medical Imaging Analysis

arXiv 2306.05480 ↗First posted 8 Jun 2023cs.AIcited by 32

Not on the map. Why?

Abstract (arXiv)

Large-scale Artificial General Intelligence (AGI) models, including Large Language Models (LLMs) such as ChatGPT/GPT-4, have achieved unprecedented success in a variety of general domain tasks. Yet, when applied directly to specialized domains like medical imaging, which require in-depth expertise, these models face notable challenges arising from the medical field's inherent complexities and unique characteristics. In this review, we delve into the potential applications of AGI models in medical imaging and healthcare, with a primary focus on LLMs, Large Vision Models, and Large Multimodal Models. We provide a thorough overview of the key features and enabling techniques of LLMs and AGI, and further examine the roadmaps guiding the evolution and implementation of AGI models in the medical sector, summarizing their present applications, potentialities, and associated challenges. In addition, we highlight potential future research directions, offering a holistic view on upcoming ventures. This comprehensive review aims to offer insights into the future implications of AGI in medical imaging, healthcare, and beyond.

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 108 of its 216 references that are in the map. First posted on arXiv 8 Jun 2023.

Builds on

108 of 216 references.

References · 108

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  7. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  8. 2023GPT-4 Technical Reportcited by 18,396
  9. 2022Training language models to follow instructions with human feedbackcited by 15,971
  10. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  11. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  12. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
38 more
  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2023Segment Anythingcited by 8,234
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  10. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  11. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  12. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  13. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  14. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  15. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  16. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  17. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  18. 2019Advances and Open Problems in Federated Learningcited by 3,046
  19. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  20. 2022Emergent Abilities of Large Language Modelscited by 2,512
  21. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  22. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  23. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  24. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  25. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  26. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  27. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
  28. 2021GPT Understands, Toocited by 716
  29. 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 669
  30. 2020The Future of Digital Health with Federated Learningcited by 633
  31. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
  32. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
  33. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
  34. 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 490
  35. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
  36. 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 368
  37. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
  38. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338

50 most cited of 108 All 108 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 12; 2024: 10; 2025: 9; 2026: 1.

32 papers.

Sort:

By area:

  1. 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
  2. 2023Review of Large Vision Models and Visual Prompt Engineeringcited by 77
  3. 2024Understanding LLMs: A Comprehensive Overview from Training to Inferencecited by 59
  4. 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
  5. 2023Radiology-Llama2: Best-in-Class Large Language Model for Radiologycited by 42
  6. 2023SAMAug: Point Prompt Augmentation for Segment Anything Modelcited by 38
  7. 2023Segment Anything Model (SAM) for Radiation Oncologycited by 24
  8. 2023Multimodality of AI for Education: Towards Artificial General Intelligencecited by 21
  9. 2023Holistic Evaluation of GPT-4V for Biomedical Imagingcited by 19
  10. 2023RadOnc-GPT: A Large Language Model for Radiation Oncologycited by 18
  11. 2024EchoFM: Foundation Model for Generalizable Echocardiogram Analysiscited by 15
  12. 2023Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challengescited by 14
20 more
  1. 2024Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translationcited by 12
  2. 2024MM-CamObj: A Comprehensive Multimodal Dataset for Camouflaged Object Scenarioscited by 10
  3. 2024Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarioscited by 10
  4. 2025From Screens to Scenes: A Survey of Embodied AI in Healthcarecited by 10
  5. 2023Ophtha-LLaMA2: A Large Language Model for Ophthalmologycited by 9
  6. 2023Hierarchical Semantic Tree Concept Whitening for Interpretable Image Classificationcited by 5
  7. 2024A recent evaluation on the performance of LLMs on radiation oncology physics using questions of randomly shuffled optionscited by 5
  8. 2025MedVista3D: Vision-Language Modeling for Reducing Diagnostic Errors in 3D CT Disease Detection, Understanding and Reportingcited by 4
  9. 2023PharmacyGPT: The AI Pharmacistcited by 3
  10. 2025Large Language Models for Bioinformaticscited by 3
  11. 2025Advancing Embodied Intelligence in Robotic-Assisted Endovascular Procedures: A Systematic Review of AI Solutionscited by 2
  12. 2025Generalist Models in Medical Image Segmentation: A Survey and Performance Comparison with Task-Specific Approachescited by 2
  13. 2025Enabling Ultra-Fast Cardiovascular Imaging Across Heterogeneous Clinical Environments with A Generalist Foundation Model and Multimodal Databasecited by 2
  14. 2024Parameter Efficient Fine Tuning for Multi-scanner PET to PET Reconstructioncited by 1
  15. 2025Improving Medical Visual Representation Learning with Pathological-level Cross-Modal Alignment and Correlation Explorationcited by 1
  16. 2026Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancercited by 1
  17. 2023Using Global Land Cover Product as Prompt for Cropland Mapping via Visual Foundation Modelcited by 0
  18. 2024Is Dataset Quality Still a Concern in Diagnosis Using Large Foundation Model?cited by 0
  19. 2025UrbanMind: Towards Urban General Intelligence via Tool-Enhanced Retrieval-Augmented Generation and Multilevel Optimizationcited by 0
  20. 2025LLM-Assisted Iterative Evolution with Swarm Intelligence Toward SuperBraincited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024MiniGPT-Med: Large Language Model as a General Interface for Radiology Diagnosis
  2. 2024Potential of Multimodal Large Language Models for Data Mining of Medical Images and Free-text Reports
  3. 2024An Early Investigation into the Utility of Multimodal Large Language Models in Medical Imaging
  4. 2024GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AI
  5. 2024Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology
  6. 2023Path to Medical AGI: Unify Domain-specific Medical LLMs with the Lowest Cost
  7. 2023Enhancing Medical Task Performance in GPT-4V: A Comprehensive Study on Prompt Engineering Strategies
  8. 2025From large language models to multimodal AI: A scoping review on the potential of generative AI in medicine