FOCUS: Knowledge-enhanced Adaptive Visual Compression for Few-shot Whole Slide Image Classification
Not on the map. Why?
Abstract (arXiv)
Few-shot learning presents a critical solution for cancer diagnosis in computational pathology (CPath), addressing fundamental limitations in data availability, particularly the scarcity of expert annotations and patient privacy constraints. A key challenge in this paradigm stems from the inherent disparity between the limited training set of whole slide images (WSIs) and the enormous number of contained patches, where a significant portion of these patches lacks diagnostically relevant information, potentially diluting the model's ability to learn and focus on critical diagnostic features. While recent works attempt to address this by incorporating additional knowledge, several crucial gaps hinder further progress: (1) despite the emergence of powerful pathology foundation models (FMs), their potential remains largely untapped, with most approaches limiting their use to basic feature extraction; (2) current language guidance mechanisms attempt to align text prompts with vast numbers of WSI patches all at once, struggling to leverage rich pathological semantic information. To this end, we introduce the knowledge-enhanced adaptive visual compression framework, dubbed FOCUS, which uniquely combines pathology FMs with language prior knowledge to enable a focused analysis of diagnostically relevant regions by prioritizing discriminative WSI patches. Our approach implements a progressive three-stage compression strategy: we first leverage FMs for global visual redundancy elimination, and integrate compressed features with language prompts for semantic relevance assessment, then perform neighbor-aware visual token filtering while preserving spatial coherence. Extensive experiments on pathological datasets spanning breast, lung, and ovarian cancers demonstrate its superior performance in few-shot pathology diagnosis. Codes are available at https://github.com/dddavid4real/FOCUS.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 34 of its 61 references that are in the map. First posted on arXiv 22 Nov 2024.
Builds on
34 of 61 references.
References · 34
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
- 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classificationcited by 254
- 2019Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosiscited by 165
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 132
- 2023Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Predictioncited by 92
22 more
- 2023Interventional Bag Multi-Instance Learning On Whole-Slide Pathological Imagescited by 91
- 2024MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathologycited by 87
- 2023Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Predictioncited by 86
- 2022A graph-transformer for whole slide image classificationcited by 84
- 2023Cross-Modal Translation and Alignment for Survival Analysiscited by 70
- 2024Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathologycited by 70
- 2024Dynamic Graph Representation with Knowledge-aware Attention for Histopathology Whole Slide Image Analysiscited by 66
- 2024A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Modelcited by 59
- 2024Multimodal Prototyping for cancer survival predictioncited by 47
- 2024HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interactioncited by 43
- 2023The Rise of AI Language Pathologists: Exploring Two-level Prompt Learning for Few-shot Weakly-supervised Whole Slide Image Classificationcited by 41
- 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Predictioncited by 41
- 2024Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillationcited by 30
- 2023Diagnose Like a Pathologist: Transformer-Enabled Hierarchical Attention-Guided Multiple Instance Learning for Whole Slide Image Classificationcited by 27
- 2024MoME: Mixture of Multimodal Experts for Cancer Survival Predictioncited by 23
- 2022Towards better understanding and better generalization of few-shot classification in histology images with contrastive learningcited by 16
- 2024MSCPT: Few-shot Whole Slide Image Classification with Multi-scale and Context-focused Prompt Tuningcited by 16
- 2023Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directionscited by 14
- 2024Pathology-knowledge Enhanced Multi-instance Prompt Learning for Few-shot Whole Slide Image Classificationcited by 13
- 2024FAST: A Dual-tier Few-Shot Learning Paradigm for Whole Slide Image Classificationcited by 8
- 2021DSNet: A Dual-Stream Framework for Weakly-Supervised Gigapixel Pathology Image Analysiscited by 7
- 2023TAKT: Target-Aware Knowledge Transfer for Whole Slide Image Classificationcited by 7
Built on by
Citing papers per year: 2025: 5; 2026: 15.
20 papers.
Sort:
By area:
- 2025Efficient Whole Slide Pathology VQA via Token Compressioncited by 6
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compressioncited by 6
- 2025Few-Shot Learning from Gigapixel Images via Hierarchical Vision-Language Alignment and Modelingcited by 3
- 2026Act Like a Pathologist: Tissue-Aware Whole Slide Image Reasoningcited by 3
- 2026PathSelect: Sequential Token Selection for Whole Slide Pathologycited by 2
- 2025Exploiting Low-Dimensional Manifold of Features for Few-Shot Whole Slide Image Classificationcited by 1
- 2025A Unified Low-level Foundation Model for Enhancing Pathology Image Qualitycited by 1
- 2025MAPLE: Multi-scale Attribute-enhanced Prompt Learning for Few-shot Whole Slide Image Classificationcited by 1
- 2026MUSE: Harnessing Precise and Diverse Semantics for Few-Shot Whole Slide Image Classificationcited by 1
- 2026ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasetscited by 0
- 2026AINet: Anchor Instances Learning for Regional Heterogeneity in Whole Slide Imagecited by 0
- 2026Parameter-efficient Prompt Tuning and Hierarchical Textual Guidance for Few-shot Whole Slide Image Classificationcited by 0
8 more
- 2026VidPrism: Heterogeneous Mixture of Experts for Image-to-Video Transfercited by 0
- 2026LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classificationcited by 0
- 2026From Patches to Evidence Balls: Class-Conditioned Evidence Retrieval for Few-Shot Whole Slide Image Classificationcited by 0
- 2026Understanding Synergistic Interactions among Pathology Foundation Models via Adaptive Fusioncited by 0
- 2026From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathologycited by 0
- 2026Gated Spatial Redundancy Projection for Pathology Transformer Attentionscited by 0
- 2026FFM-CP: Cross-Backbone Fusion of Vision-Language Foundation Models for Few-Shot Computational Pathologycited by 0
- 2026A Multimodal Dataset for Survival Prediction in Resected Pancreatic Ductal Adenocarcinomacited by 0
- 2026A Multimodal Dataset for Survival Prediction in Resected Pancreatic Ductal Adenocarcinoma24 Sep 2026
- 2026FFM-CP: Cross-Backbone Fusion of Vision-Language Foundation Models for Few-Shot Computational Pathology23 Sep 2026
- 2026Gated Spatial Redundancy Projection for Pathology Transformer Attentions8 Aug 2026
- 2026From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology4 Aug 2026
- 2026Understanding Synergistic Interactions among Pathology Foundation Models via Adaptive Fusion2 Aug 2026
- 2026From Patches to Evidence Balls: Class-Conditioned Evidence Retrieval for Few-Shot Whole Slide Image Classification2 Aug 2026
- 2026PathSelect: Sequential Token Selection for Whole Slide Pathology26 Jul 2026
- 2026LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classification5 Jun 2026
- 2026VidPrism: Heterogeneous Mixture of Experts for Image-to-Video Transfer27 May 2026
- 2026Parameter-efficient Prompt Tuning and Hierarchical Textual Guidance for Few-shot Whole Slide Image Classification23 Mar 2026
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compression19 Mar 2026
- 2026Act Like a Pathologist: Tissue-Aware Whole Slide Image Reasoning28 Feb 2026
8 more
- 2026MUSE: Harnessing Precise and Diverse Semantics for Few-Shot Whole Slide Image Classification24 Feb 2026
- 2026ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasets23 Feb 2026
- 2026AINet: Anchor Instances Learning for Regional Heterogeneity in Whole Slide Image21 Feb 2026
- 2025MAPLE: Multi-scale Attribute-enhanced Prompt Learning for Few-shot Whole Slide Image Classification30 Sep 2025
- 2025A Unified Low-level Foundation Model for Enhancing Pathology Image Quality1 Sep 2025
- 2025Efficient Whole Slide Pathology VQA via Token Compression19 Jul 2025
- 2025Few-Shot Learning from Gigapixel Images via Hierarchical Vision-Language Alignment and Modeling23 May 2025
- 2025Exploiting Low-Dimensional Manifold of Features for Few-Shot Whole Slide Image Classification21 May 2025
- 2025Efficient Whole Slide Pathology VQA via Token Compressioncited by 6
- 2025Few-Shot Learning from Gigapixel Images via Hierarchical Vision-Language Alignment and Modelingcited by 3
- 2026PathSelect: Sequential Token Selection for Whole Slide Pathologycited by 2
- 2025MAPLE: Multi-scale Attribute-enhanced Prompt Learning for Few-shot Whole Slide Image Classificationcited by 1
- 2026VidPrism: Heterogeneous Mixture of Experts for Image-to-Video Transfercited by 0
- 2026FFM-CP: Cross-Backbone Fusion of Vision-Language Foundation Models for Few-Shot Computational Pathologycited by 0
- 2026FFM-CP: Cross-Backbone Fusion of Vision-Language Foundation Models for Few-Shot Computational Pathology23 Sep 2026
- 2026PathSelect: Sequential Token Selection for Whole Slide Pathology26 Jul 2026
- 2026VidPrism: Heterogeneous Mixture of Experts for Image-to-Video Transfer27 May 2026
- 2025MAPLE: Multi-scale Attribute-enhanced Prompt Learning for Few-shot Whole Slide Image Classification30 Sep 2025
- 2025Efficient Whole Slide Pathology VQA via Token Compression19 Jul 2025
- 2025Few-Shot Learning from Gigapixel Images via Hierarchical Vision-Language Alignment and Modeling23 May 2025
- 2026ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasetscited by 0
- 2026ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasets23 Feb 2026
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compressioncited by 6
- 2025Exploiting Low-Dimensional Manifold of Features for Few-Shot Whole Slide Image Classificationcited by 1
- 2025A Unified Low-level Foundation Model for Enhancing Pathology Image Qualitycited by 1
- 2026MUSE: Harnessing Precise and Diverse Semantics for Few-Shot Whole Slide Image Classificationcited by 1
- 2026AINet: Anchor Instances Learning for Regional Heterogeneity in Whole Slide Imagecited by 0
- 2026Parameter-efficient Prompt Tuning and Hierarchical Textual Guidance for Few-shot Whole Slide Image Classificationcited by 0
- 2026LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classificationcited by 0
- 2026From Patches to Evidence Balls: Class-Conditioned Evidence Retrieval for Few-Shot Whole Slide Image Classificationcited by 0
- 2026Understanding Synergistic Interactions among Pathology Foundation Models via Adaptive Fusioncited by 0
- 2026From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathologycited by 0
- 2026Gated Spatial Redundancy Projection for Pathology Transformer Attentionscited by 0
- 2026A Multimodal Dataset for Survival Prediction in Resected Pancreatic Ductal Adenocarcinomacited by 0
- 2026A Multimodal Dataset for Survival Prediction in Resected Pancreatic Ductal Adenocarcinoma24 Sep 2026
- 2026Gated Spatial Redundancy Projection for Pathology Transformer Attentions8 Aug 2026
- 2026From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology4 Aug 2026
- 2026Understanding Synergistic Interactions among Pathology Foundation Models via Adaptive Fusion2 Aug 2026
- 2026From Patches to Evidence Balls: Class-Conditioned Evidence Retrieval for Few-Shot Whole Slide Image Classification2 Aug 2026
- 2026LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classification5 Jun 2026
- 2026Parameter-efficient Prompt Tuning and Hierarchical Textual Guidance for Few-shot Whole Slide Image Classification23 Mar 2026
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compression19 Mar 2026
- 2026MUSE: Harnessing Precise and Diverse Semantics for Few-Shot Whole Slide Image Classification24 Feb 2026
- 2026AINet: Anchor Instances Learning for Regional Heterogeneity in Whole Slide Image21 Feb 2026
- 2025A Unified Low-level Foundation Model for Enhancing Pathology Image Quality1 Sep 2025
- 2025Exploiting Low-Dimensional Manifold of Features for Few-Shot Whole Slide Image Classification21 May 2025