Foundational Models for Pathology and Endoscopy Images: Application for Gastric Inflammation
Not on the map. Why?
Abstract (arXiv)
The integration of artificial intelligence (AI) in medical diagnostics represents a significant advancement in managing upper gastrointestinal (GI) cancer, a major cause of global cancer mortality. Specifically for gastric cancer (GC), chronic inflammation causes changes in the mucosa such as atrophy, intestinal metaplasia (IM), dysplasia and ultimately cancer. Early detection through endoscopic regular surveillance is essential for better outcomes. Foundation models (FM), which are machine or deep learning models trained on diverse data and applicable to broad use cases, offer a promising solution to enhance the accuracy of endoscopy and its subsequent pathology image analysis. This review explores the recent advancements, applications, and challenges associated with FM in endoscopy and pathology imaging. We started by elucidating the core principles and architectures underlying these models, including their training methodologies and the pivotal role of large-scale data in developing their predictive capabilities. Moreover, this work discusses emerging trends and future research directions, emphasizing the integration of multimodal data, the development of more robust and equitable models, and the potential for real-time diagnostic support. This review aims to provide a roadmap for researchers and practitioners in navigating the complexities of incorporating FM into clinical practice for prevention/management of GC cases, thereby improving patient outcomes.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 46 of its 65 references that are in the map. First posted on arXiv 26 Jun 2024.
Builds on
46 of 65 references.
References · 46
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,322
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
- 2023Segment Anythingcited by 8,195
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,915
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,103
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,855
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,368
- 2022Survey of Hallucination in Natural Language Generationcited by 2,068
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,616
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,267
34 more
- 2021Grounded Language-Image Pre-trainingcited by 1,152
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 895
- 2021Multimodal Few-Shot Learning with Frozen Language Modelscited by 659
- 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 648
- 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 627
- 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 531
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 472
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
- 2021CRIS: CLIP-Driven Referring Image Segmentationcited by 353
- 2022GLIPv2: Unifying Localization and Vision-Language Understandingcited by 275
- 2022Unifying Flow, Stereo and Depth Estimationcited by 271
- 2022Unified Contrastive Learning in Image-Text-Label Spacecited by 194
- 2023Segment and Track Anythingcited by 193
- 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
- 2020Self supervised contrastive learning for digital histopathologycited by 146
- 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 133
- 2022Language Models are General-Purpose Interfacescited by 96
- 2023Image Captioners Are Scalable Vision Learners Toocited by 89
- 2023Virchow: A Million-Slide Digital Pathology Foundation Modelcited by 88
- 2023Foundation Model for Endoscopy Video Analysis via Large-scale Self-supervised Pre-traincited by 75
- 2023Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmarkcited by 62
- 2023FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcarecited by 59
- 2023Towards a Visual-Language Foundation Model for Computational Pathologycited by 52
- 2024Surgical-DINO: Adapter Learning of Foundation Models for Depth Estimation in Endoscopic Surgerycited by 52
- 2023Text-guided Foundation Model Adaptation for Pathological Image Classificationcited by 47
- 2023A General-Purpose Self-Supervised Model for Computational Pathologycited by 42
- 2024RudolfV: A Foundation Model by Pathologists for Pathologistscited by 41
- 2023All-in-SAM: from Weak Annotation to Pixel-wise Nuclei Segmentation with Prompt-based Finetuningcited by 32
- 2023Computational Pathology at Health System Scale -- Self-Supervised Foundation Models from Three Billion Imagescited by 30
- 2023SAM-Path: A Segment Anything Model for Semantic Segmentation in Digital Pathologycited by 26
- 2024Low-resource finetuning of foundation models beats state-of-the-art in histopathologycited by 11
- 2022It Takes Two: Masked Appearance-Motion Modeling for Self-supervised Video Transformer Pre-trainingcited by 10
- 2023Toward Building General Foundation Models for Language, Vision, and Vision-Language Understanding Taskscited by 9
- 2023Leverage Weakly Annotation to Pixel-wise Annotation via Zero-shot Segment Anything Model for Molecular-empowered Learningcited by 4
Built on by
Citing papers per year: 2025: 1.
1 paper.