mlsanityData to 7 Oct 2026

Unlocking adaptive digital pathology through dynamic feature learning

arXiv 2412.20430 ↗First posted 29 Dec 2024eess.IV cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Foundation models have revolutionized the paradigm of digital pathology, as they leverage general-purpose features to emulate real-world pathological practices, enabling the quantitative analysis of critical histological patterns and the dissection of cancer-specific signals. However, these static general features constrain the flexibility and pathological relevance in the ever-evolving needs of clinical applications, hindering the broad use of the current models. Here we introduce PathFiT, a dynamic feature learning method that can be effortlessly plugged into various pathology foundation models to unlock their adaptability. Meanwhile, PathFiT performs seamless implementation across diverse pathology applications regardless of downstream specificity. To validate PathFiT, we construct a digital pathology benchmark with over 20 terabytes of Internet and real-world data comprising 28 H&E-stained tasks and 7 specialized imaging tasks including Masson's Trichrome staining and immunofluorescence images. By applying PathFiT to the representative pathology foundation models, we demonstrate state-of-the-art performance on 34 out of 35 tasks, with significant improvements on 23 tasks and outperforming by 10.20% on specialized imaging tasks. The superior performance and versatility of PathFiT open up new avenues in computational pathology.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 75 references that are in the map. First posted on arXiv 29 Dec 2024.

Builds on

31 of 75 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2017Mask R-CNNcited by 7,259
  5. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  6. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  7. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
  8. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  9. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
  10. 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
  11. 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 357
  12. 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
19 more
  1. 2024Multimodal Whole Slide Foundation Model for Pathologycited by 156
  2. 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
  3. 2018BACH: Grand Challenge on Breast Cancer Histology Imagescited by 131
  4. 2021BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Imagescited by 130
  5. 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 107
  6. 2023Artificial Intelligence for Digital and Computational Pathologycited by 106
  7. 2020Deep Learning-based Computational Pathology Predicts Origins for Cancers of Unknown Primarycited by 89
  8. 2024PRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathologycited by 80
  9. 2024Feature Re-Embedding: Towards Foundation Model-Level Performance in Computational Pathologycited by 66
  10. 2024Dynamic Graph Representation with Knowledge-aware Attention for Histopathology Whole Slide Image Analysiscited by 66
  11. 2021A Petri Dish for Histopathology Image Analysiscited by 63
  12. 2023CoNIC Challenge: Pushing the Frontiers of Nuclear Detection, Segmentation, Classification and Countingcited by 33
  13. 2023NuInsSeg: A Fully Annotated Dataset for Nuclei Instance Segmentation in H&E-Stained Histological Imagescited by 29
  14. 2024Generalizable Whole Slide Image Classification with Fine-Grained Visual-Semantic Interactioncited by 27
  15. 2023When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathologycited by 16
  16. 2023PathoDuet: Foundation Models for Pathological Slide Analysis of H&E and IHC Stainscited by 14
  17. 2023Shapley Values-enabled Progressive Pseudo Bag Augmentation for Whole Slide Image Classificationcited by 12
  18. 2024Diagnostic Text-guided Representation Learning in Hierarchical Classification for Pathological Whole Slide Imagecited by 4
  19. 2024Towards a Comprehensive Benchmark for Pathological Lymph Node Metastasis in Breast Cancer Sectionscited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.