mlsanityData to 7 Oct 2026

FOCUS: Knowledge-enhanced Adaptive Visual Compression for Few-shot Whole Slide Image Classification

arXiv 2411.14743 ↗First posted 22 Nov 2024cs.CV cs.AI q-bio.QMcited by 20

Not on the map. Why?

Abstract (arXiv)

Few-shot learning presents a critical solution for cancer diagnosis in computational pathology (CPath), addressing fundamental limitations in data availability, particularly the scarcity of expert annotations and patient privacy constraints. A key challenge in this paradigm stems from the inherent disparity between the limited training set of whole slide images (WSIs) and the enormous number of contained patches, where a significant portion of these patches lacks diagnostically relevant information, potentially diluting the model's ability to learn and focus on critical diagnostic features. While recent works attempt to address this by incorporating additional knowledge, several crucial gaps hinder further progress: (1) despite the emergence of powerful pathology foundation models (FMs), their potential remains largely untapped, with most approaches limiting their use to basic feature extraction; (2) current language guidance mechanisms attempt to align text prompts with vast numbers of WSI patches all at once, struggling to leverage rich pathological semantic information. To this end, we introduce the knowledge-enhanced adaptive visual compression framework, dubbed FOCUS, which uniquely combines pathology FMs with language prior knowledge to enable a focused analysis of diagnostically relevant regions by prioritizing discriminative WSI patches. Our approach implements a progressive three-stage compression strategy: we first leverage FMs for global visual redundancy elimination, and integrate compressed features with language prompts for semantic relevance assessment, then perform neighbor-aware visual token filtering while preserving spatial coherence. Extensive experiments on pathological datasets spanning breast, lung, and ovarian cancers demonstrate its superior performance in few-shot pathology diagnosis. Codes are available at https://github.com/dddavid4real/FOCUS.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 34 of its 61 references that are in the map. First posted on arXiv 22 Nov 2024.

Builds on

34 of 61 references.

References · 34

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  4. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  5. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
  6. 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
  7. 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
  8. 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classificationcited by 254
  9. 2019Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosiscited by 165
  10. 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
  11. 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 132
  12. 2023Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Predictioncited by 92
22 more
  1. 2023Interventional Bag Multi-Instance Learning On Whole-Slide Pathological Imagescited by 91
  2. 2024MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathologycited by 87
  3. 2023Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Predictioncited by 86
  4. 2022A graph-transformer for whole slide image classificationcited by 84
  5. 2023Cross-Modal Translation and Alignment for Survival Analysiscited by 70
  6. 2024Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathologycited by 70
  7. 2024Dynamic Graph Representation with Knowledge-aware Attention for Histopathology Whole Slide Image Analysiscited by 66
  8. 2024A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Modelcited by 59
  9. 2024Multimodal Prototyping for cancer survival predictioncited by 47
  10. 2024HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interactioncited by 43
  11. 2023The Rise of AI Language Pathologists: Exploring Two-level Prompt Learning for Few-shot Weakly-supervised Whole Slide Image Classificationcited by 41
  12. 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Predictioncited by 41
  13. 2024Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillationcited by 30
  14. 2023Diagnose Like a Pathologist: Transformer-Enabled Hierarchical Attention-Guided Multiple Instance Learning for Whole Slide Image Classificationcited by 27
  15. 2024MoME: Mixture of Multimodal Experts for Cancer Survival Predictioncited by 23
  16. 2022Towards better understanding and better generalization of few-shot classification in histology images with contrastive learningcited by 16
  17. 2024MSCPT: Few-shot Whole Slide Image Classification with Multi-scale and Context-focused Prompt Tuningcited by 16
  18. 2023Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directionscited by 14
  19. 2024Pathology-knowledge Enhanced Multi-instance Prompt Learning for Few-shot Whole Slide Image Classificationcited by 13
  20. 2024FAST: A Dual-tier Few-Shot Learning Paradigm for Whole Slide Image Classificationcited by 8
  21. 2021DSNet: A Dual-Stream Framework for Weakly-Supervised Gigapixel Pathology Image Analysiscited by 7
  22. 2023TAKT: Target-Aware Knowledge Transfer for Whole Slide Image Classificationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 15.

20 papers.

Sort:

By area:

  1. 2025Efficient Whole Slide Pathology VQA via Token Compressioncited by 6
  2. 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compressioncited by 6
  3. 2025Few-Shot Learning from Gigapixel Images via Hierarchical Vision-Language Alignment and Modelingcited by 3
  4. 2026Act Like a Pathologist: Tissue-Aware Whole Slide Image Reasoningcited by 3
  5. 2026PathSelect: Sequential Token Selection for Whole Slide Pathologycited by 2
  6. 2025Exploiting Low-Dimensional Manifold of Features for Few-Shot Whole Slide Image Classificationcited by 1
  7. 2025A Unified Low-level Foundation Model for Enhancing Pathology Image Qualitycited by 1
  8. 2025MAPLE: Multi-scale Attribute-enhanced Prompt Learning for Few-shot Whole Slide Image Classificationcited by 1
  9. 2026MUSE: Harnessing Precise and Diverse Semantics for Few-Shot Whole Slide Image Classificationcited by 1
  10. 2026ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasetscited by 0
  11. 2026AINet: Anchor Instances Learning for Regional Heterogeneity in Whole Slide Imagecited by 0
  12. 2026Parameter-efficient Prompt Tuning and Hierarchical Textual Guidance for Few-shot Whole Slide Image Classificationcited by 0
8 more
  1. 2026VidPrism: Heterogeneous Mixture of Experts for Image-to-Video Transfercited by 0
  2. 2026LRMIL: Efficient Low-Resolution Multiple Instance Learning via High-Resolution Knowledge Distillation for Whole Slide Image Classificationcited by 0
  3. 2026From Patches to Evidence Balls: Class-Conditioned Evidence Retrieval for Few-Shot Whole Slide Image Classificationcited by 0
  4. 2026Understanding Synergistic Interactions among Pathology Foundation Models via Adaptive Fusioncited by 0
  5. 2026From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathologycited by 0
  6. 2026Gated Spatial Redundancy Projection for Pathology Transformer Attentionscited by 0
  7. 2026FFM-CP: Cross-Backbone Fusion of Vision-Language Foundation Models for Few-Shot Computational Pathologycited by 0
  8. 2026A Multimodal Dataset for Survival Prediction in Resected Pancreatic Ductal Adenocarcinomacited by 0