mlsanityData to 7 Oct 2026

When is a Foundation Model a Foundation Model

arXiv 2309.11510 ↗First posted 14 Sep 2023cs.IR cs.AI cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Recently, several studies have reported on the fine-tuning of foundation models for image-text modeling in the field of medicine, utilizing images from online data sources such as Twitter and PubMed. Foundation models are large, deep artificial neural networks capable of learning the context of a specific domain through training on exceptionally extensive datasets. Through validation, we have observed that the representations generated by such models exhibit inferior performance in retrieval tasks within digital pathology when compared to those generated by significantly smaller, conventional deep networks.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 9 of its 13 references that are in the map. First posted on arXiv 14 Sep 2023.

Builds on

9 of 13 references.

References · 9

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  3. 2022Emergent Abilities of Large Language Modelscited by 2,483
  4. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  5. 2022Benchmarking Self-Supervised Learning on Diverse Pathology Datasetscited by 148
  6. 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
  7. 2021Fine-Tuning and Training of DenseNet for Histopathology Image Representation Using TCGA Diagnostic Slidescited by 52
  8. 2019Yottixel -- An Image Search Engine for Large Archives of Histopathology Whole Slide Imagescited by 41
  9. 2019Pan-Cancer Diagnostic Consensus Through Searching Archival Histopathology Images Using Artificial Intelligencecited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 0; 2026: 1.

7 papers.

  1. 2024A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Modelcited by 59
  2. 2024Data-Centric Foundation Models in Computational Healthcare: A Surveycited by 27
  3. 2024On Image Search in Histopathologycited by 12
  4. 2024Towards Ground-truth-free Evaluation of Any Segmentation in Medical Imagescited by 3
  5. 2024Self-Normalizing Foundation Model for Enhanced Multi-Omics Data Analysis in Oncologycited by 1
  6. 2024Improving Segment Anything on the Fly: Auxiliary Online Learning and Adaptive Fusion for Medical Image Segmentationcited by 1
  7. 2026Foundation Models for Medical Imaging: Status, Challenges, and Directionscited by 0