mlsanityData to 7 Oct 2026

Data-Centric Foundation Models in Computational Healthcare: A Survey

arXiv 2401.02458 ↗First posted 4 Jan 2024cs.LG cs.AIcited by 27

Not on the map. Why?

Abstract (arXiv)

The advent of foundation models (FMs) as an emerging suite of AI techniques has struck a wave of opportunities in computational healthcare. The interactive nature of these models, guided by pre-training data and human instructions, has ignited a data-centric AI paradigm that emphasizes better data characterization, quality, and scale. In healthcare AI, obtaining and processing high-quality clinical data records has been a longstanding challenge, encompassing data quantity, annotation, patient privacy, and ethics. In this survey, we investigate a wide range of data-centric approaches in the FM era (from model pre-training to inference) towards improving the healthcare workflow. We discuss key perspectives in AI security, assessment, and alignment with human values. Finally, we offer a promising outlook on FM-based analytics to enhance patient outcomes and clinical workflows in the evolving landscape of healthcare and medicine. We provide an up-to-date list of healthcare-related foundation models and datasets at https://github.com/Yunkun-Zhang/Data-Centric-FM-Healthcare.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 174 of its 410 references that are in the map. First posted on arXiv 4 Jan 2024.

Builds on

174 of 410 references.

References · 174

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  6. 2022Training language models to follow instructions with human feedbackcited by 15,712
  7. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  8. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  9. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  10. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  11. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  12. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
38 more
  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  8. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  9. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  10. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  11. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  12. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  13. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  14. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  15. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  16. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  17. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  18. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  19. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  20. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  21. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  22. 2023Qwen Technical Reportcited by 3,273
  23. 2023Mistral 7Bcited by 3,065
  24. 2020Extracting Training Data from Large Language Modelscited by 2,144
  25. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  26. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  27. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
  28. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
  29. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  30. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  31. 2018Datasheets for Datasetscited by 1,371
  32. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  33. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  34. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  35. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  36. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  37. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
  38. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147

50 most cited of 174 All 174 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 12; 2026: 6.

27 papers.

Sort:

By area:

  1. 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
  2. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  3. 2024MedBench: A Comprehensive, Standardized, and Reliable Benchmarking System for Evaluating Chinese Medical Large Language Modelscited by 21
  4. 2024Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Surveycited by 20
  5. 2024Aligning Human Knowledge with Visual Concepts Towards Explainable Medical Image Classificationcited by 17
  6. 2025Show and Segment: Universal Medical Image Segmentation via In-Context Learningcited by 15
  7. 2024PathM3: A Multimodal Multi-Task Multiple Instance Learning Framework for Whole Slide Image Classification and Captioningcited by 13
  8. 2025Think Twice to See More: Iterative Visual Reasoning in Medical VLMscited by 12
  9. 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Reviewcited by 8
  10. 2024Cost-effective Instruction Learning for Pathology Vision and Language Analysiscited by 7
  11. 2024OpenMEDLab: An Open-source Platform for Multi-modality Foundation Models in Medicinecited by 5
  12. 2025Mediator-Guided Multi-Agent Collaboration among Open-Source Models for Medical Decision-Makingcited by 5
15 more
  1. 2025Towards the Autonomous Optimization of Urban Logistics: Training Generative AI with Scientific Tools via Agentic Digital Twins and Model Context Protocolcited by 4
  2. 2025Benchmarking Foundation Models and Parameter-Efficient Fine-Tuning for Prognosis Prediction in Medical Imagingcited by 3
  3. 2025Anatomy-VLM: A Fine-grained Vision-Language Model for Medical Interpretationcited by 3
  4. 2024Empowering Cognitive Digital Twins with Generative Foundation Models: Developing a Low-Carbon Integrated Freight Transportation Systemcited by 1
  5. 2025MedForge: Building Medical Foundation Models Like Open Source Software Developmentcited by 1
  6. 2025Aligning Large Language Models with Healthcare Stakeholders: A Pathway to Trustworthy AI Integrationcited by 1
  7. 2025Language-Enhanced Generative Modeling for Amyloid PET Synthesis from MRI and Blood Biomarkerscited by 1
  8. 2026DExTeR: Weakly Semi-Supervised Object Detection with Class and Instance Experts for Medical Imagingcited by 1
  9. 2026Clinical Note Bloat Reduction for Efficient LLM Usecited by 1
  10. 2025Brain Imaging Foundation Models, Are We There Yet? A Systematic Review of Foundation Models for Brain Imaging and Biomedical Researchcited by 0
  11. 2025ALL-PET: A Low-resource and Low-shot PET Foundation Model in Projection Domaincited by 0
  12. 2026Does medical specialization of VLMs enhance discriminative power?: A comprehensive investigation through feature distribution analysiscited by 0
  13. 2026Toward Clinically Ready Foundation Models in Medical Image Analysis: Adaptation Mechanisms and Deployment Trade-offscited by 0
  14. 2026Enhancing Brain MRI Anomaly Detection and Reasoning with ROI Rethink and Synthetic Datacited by 0
  15. 2026Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learningcited by 0