Detecting Cancer Metastases on Gigapixel Pathology Images
Not on the map. Why?
Abstract (arXiv)
Each year, the treatment decisions for more than 230,000 breast cancer patients in the U.S. hinge on whether the cancer has metastasized away from the breast. Metastasis detection is currently performed by pathologists reviewing large expanses of biological tissues. This process is labor intensive and error-prone. We present a framework to automatically detect and localize tumors as small as 100 x 100 pixels in gigapixel microscopy images sized 100,000 x 100,000 pixels. Our method leverages a convolutional neural network (CNN) architecture and obtains state-of-the-art results on the Camelyon16 dataset in the challenging lesion-level tumor detection task. At 8 false positives per image, we detect 92.4% of the tumors, relative to 82.7% by the previous best automated approach. For comparison, a human pathologist attempting exhaustive search achieved 73.2% sensitivity. We achieve image-level AUC scores above 97% on both the Camelyon16 test set and an independent set of 110 slides. In addition, we discover that two slides in the Camelyon16 training set were erroneously labeled normal. Our approach could considerably reduce false negative rates in metastasis detection.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 14; 2023: 16; 2024: 8; 2025: 1; 2026: 1.
51 papers.
Sort:
By area:
- 2022Federated Unlearning with Knowledge Distillationcited by 70
- 2021Supervised Transfer Learning at Scale for Medical Imagingcited by 38
- 2022Robust Medical Image Classification from Noisy Labeled Data with Global and Local Representation Guided Co-trainingcited by 21
- 2023Subspace based Federated Unlearningcited by 13
- 2021MCUa: Multi-level Context and Uncertainty aware Dynamic Deep Ensemble for Breast Cancer Histology Image Classificationcited by 12
- 2021Resolution-Based Distillation for Efficient Histology Image Classificationcited by 10
- 2022On the Origins of the Block Structure Phenomenon in Neural Network Representationscited by 10
- 2022Efficient High-Resolution Deep Learning: A Surveycited by 9
- 2021PointNu-Net: Keypoint-assisted Convolutional Neural Network for Simultaneous Multi-tissue Histology Nuclei Segmentation and Classificationcited by 8
- 2023Improving Representation Learning for Histopathologic Images with Cluster Constraintscited by 8
- 2022Unsupervised Domain Adaptation for Cardiac Segmentation: Towards Structure Mutual Information Maximizationcited by 7
- 2022Evaluating histopathology transfer learning with ChampKitcited by 7
38 more
- 2023Large-scale pretraining on pathological images for fine-tuning of small pathological benchmarkscited by 7
- 2023Detecting Heart Disease from Multi-View Ultrasound Images via Supervised Attention Multiple Instance Learningcited by 7
- 2022Rethinking Machine Learning Model Evaluation in Pathologycited by 5
- 2022Unsupervised Domain Adaptation Using Feature Disentanglement And GCNs For Medical Image Classificationcited by 5
- 2023A Dual-branch Self-supervised Representation Learning Framework for Tumour Segmentation in Whole Slide Imagescited by 5
- 2024SaccadeDet: A Novel Dual-Stage Architecture for Rapid and Accurate Detection in Gigapixel Imagescited by 5
- 2024Self-supervised Vision Transformer are Scalable Generative Models for Domain Generalizationcited by 4
- 2023Self-supervised learning-based general laboratory progress pretrained model for cardiovascular event detectioncited by 3
- 2023SLPerf: a Unified Framework for Benchmarking Split Learningcited by 3
- 2023Ranking Loss and Sequestering Learning for Reducing Image Search Bias in Histopathologycited by 3
- 2023Adaptive Region Selection for Active Learning in Whole Slide Image Semantic Segmentationcited by 3
- 2025Conformal Object Detection by Sequential Risk Controlcited by 3
- 2021An Efficient Cervical Whole Slide Image Analysis Framework Based on Multi-scale Semantic and Location Deep Featurescited by 2
- 2021Increasing a microscope's effective field of view via overlapped imaging and machine learningcited by 2
- 2022Interpretable Saliency Maps And Self-Supervised Learning For Generalized Zero Shot Medical Image Classificationcited by 2
- 2022HistoPerm: A Permutation-Based View Generation Approach for Improving Histopathologic Feature Representation Learningcited by 2
- 2021An XAI Approach to Deep Learning Models in the Detection of DCIScited by 1
- 2021An Interpretable Algorithm for Uveal Melanoma Subtyping from Whole Slide Cytology Imagescited by 1
- 2021Magnifying Networks for Images with Billions of Pixelscited by 1
- 2022NeuRegenerate: A Framework for Visualizing Neurodegenerationcited by 1
- 2023Patch Gradient Descent: Training Neural Networks on Very Large Imagescited by 1
- 2023Deep Multiple Instance Learning with Distance-Aware Self-Attentioncited by 1
- 2024Unleashing the Potential of Synthetic Images: A Study on Histopathology Image Classificationcited by 1
- 2024Advancing Histopathology with Deep Learning Under Data Scarcity: A Decade in Reviewcited by 1
- 2024Multimodal Quantum Natural Language Processing: A Novel Framework for using Quantum Methods to Analyse Real Datacited by 1
- 2026Exploiting Label-Independent Regularization from Spatial Dependencies for Whole Slide Image Analysiscited by 1
- 2021Chameleon: A Semi-AutoML framework targeting quick and scalable development and deployment of production-ready ML systems for SMEscited by 0
- 2021A Computer-Aided Diagnosis System for Breast Pathology: A Deep Learning Approach with Model Interpretability from Pathological Perspectivecited by 0
- 2022Multi-Scale Hybrid Vision Transformer for Learning Gastric Histology: AI-Based Decision Support System for Gastric Cancer Treatmentcited by 0
- 2022Machine learning based lens-free imaging technique for field-portable cytometrycited by 0
- 2022Transformation Invariant Cancerous Tissue Classification Using Spatially Transformed DenseNetcited by 0
- 2023Computational Pathology for Brain Disorderscited by 0
- 2023Robust Tumor Detection from Coarse Annotations via Multi-Magnification Ensemblescited by 0
- 2023eXplainable Artificial Intelligence on Medical Images: A Surveycited by 0
- 2023PseudoCell: Hard Negative Mining as Pseudo Labeling for Deep Learning-Based Centroblast Cell Detectioncited by 0
- 2023A three in one bottom-up framework for simultaneous semantic segmentation, instance segmentation and classification of multi-organ nuclei in digital cancer histologycited by 0
- 2024Pathology-genomic fusion via biologically informed cross-modality graph learning for survival analysiscited by 0
- 2024Region of Interest Detection in Melanocytic Skin Tumor Whole Slide Images -- Nevus & Melanomacited by 0
50 most cited of 51 All 51 (JSON)
- 2026Exploiting Label-Independent Regularization from Spatial Dependencies for Whole Slide Image Analysis23 Feb 2026
- 2025Conformal Object Detection by Sequential Risk Control29 May 2025
- 2024Multimodal Quantum Natural Language Processing: A Novel Framework for using Quantum Methods to Analyse Real Data29 Oct 2024
- 2024Advancing Histopathology with Deep Learning Under Data Scarcity: A Decade in Review18 Oct 2024
- 2024Unleashing the Potential of Synthetic Images: A Study on Histopathology Image Classification24 Sep 2024
- 2024Deep Learning with Data Privacy via Residual Perturbation11 Aug 2024
- 2024SaccadeDet: A Novel Dual-Stage Architecture for Rapid and Accurate Detection in Gigapixel Images25 Jul 2024
- 2024Self-supervised Vision Transformer are Scalable Generative Models for Domain Generalization3 Jul 2024
- 2024Region of Interest Detection in Melanocytic Skin Tumor Whole Slide Images -- Nevus & Melanoma16 May 2024
- 2024Pathology-genomic fusion via biologically informed cross-modality graph learning for survival analysis11 Apr 2024
- 2023Improving Representation Learning for Histopathologic Images with Cluster Constraints18 Oct 2023
- 2023A three in one bottom-up framework for simultaneous semantic segmentation, instance segmentation and classification of multi-organ nuclei in digital cancer histology22 Aug 2023
38 more
- 2023Adaptive Region Selection for Active Learning in Whole Slide Image Semantic Segmentation14 Jul 2023
- 2023PseudoCell: Hard Negative Mining as Pseudo Labeling for Deep Learning-Based Centroblast Cell Detection6 Jul 2023
- 2023Detecting Heart Disease from Multi-View Ultrasound Images via Supervised Attention Multiple Instance Learning25 May 2023
- 2023Deep Multiple Instance Learning with Distance-Aware Self-Attention17 May 2023
- 2023eXplainable Artificial Intelligence on Medical Images: A Survey12 May 2023
- 2023Ranking Loss and Sequestering Learning for Reducing Image Search Bias in Histopathology15 Apr 2023
- 2023SLPerf: a Unified Framework for Benchmarking Split Learning4 Apr 2023
- 2023Robust Tumor Detection from Coarse Annotations via Multi-Magnification Ensembles29 Mar 2023
- 2023Large-scale pretraining on pathological images for fine-tuning of small pathological benchmarks28 Mar 2023
- 2023A Dual-branch Self-supervised Representation Learning Framework for Tumour Segmentation in Whole Slide Images20 Mar 2023
- 2023Self-supervised learning-based general laboratory progress pretrained model for cardiovascular event detection13 Mar 2023
- 2023Subspace based Federated Unlearning24 Feb 2023
- 2023Patch Gradient Descent: Training Neural Networks on Very Large Images31 Jan 2023
- 2023Computational Pathology for Brain Disorders13 Jan 2023
- 2022HistoPerm: A Permutation-Based View Generation Approach for Improving Histopathologic Feature Representation Learning13 Sep 2022
- 2022Efficient High-Resolution Deep Learning: A Survey26 Jul 2022
- 2022Unsupervised Domain Adaptation Using Feature Disentanglement And GCNs For Medical Image Classification27 Jun 2022
- 2022Evaluating histopathology transfer learning with ChampKit14 Jun 2022
- 2022Robust Medical Image Classification from Noisy Labeled Data with Global and Local Representation Guided Co-training10 May 2022
- 2022Transformation Invariant Cancerous Tissue Classification Using Spatially Transformed DenseNet23 Apr 2022
- 2022Unsupervised Domain Adaptation for Cardiac Segmentation: Towards Structure Mutual Information Maximization20 Apr 2022
- 2022Rethinking Machine Learning Model Evaluation in Pathology11 Apr 2022
- 2022Interpretable Saliency Maps And Self-Supervised Learning For Generalized Zero Shot Medical Image Classification4 Apr 2022
- 2022Machine learning based lens-free imaging technique for field-portable cytometry2 Mar 2022
- 2022Multi-Scale Hybrid Vision Transformer for Learning Gastric Histology: AI-Based Decision Support System for Gastric Cancer Treatment17 Feb 2022
- 2022On the Origins of the Block Structure Phenomenon in Neural Network Representations15 Feb 2022
- 2022NeuRegenerate: A Framework for Visualizing Neurodegeneration2 Feb 2022
- 2022Federated Unlearning with Knowledge Distillation24 Jan 2022
- 2021Magnifying Networks for Images with Billions of Pixels12 Dec 2021
- 2021PointNu-Net: Keypoint-assisted Convolutional Neural Network for Simultaneous Multi-tissue Histology Nuclei Segmentation and Classification1 Nov 2021
- 2021Increasing a microscope's effective field of view via overlapped imaging and machine learning10 Oct 2021
- 2021MCUa: Multi-level Context and Uncertainty aware Dynamic Deep Ensemble for Breast Cancer Histology Image Classification24 Aug 2021
- 2021An Interpretable Algorithm for Uveal Melanoma Subtyping from Whole Slide Cytology Images13 Aug 2021
- 2021A Computer-Aided Diagnosis System for Breast Pathology: A Deep Learning Approach with Model Interpretability from Pathological Perspective5 Aug 2021
- 2021An Efficient Cervical Whole Slide Image Analysis Framework Based on Multi-scale Semantic and Location Deep Features29 Jun 2021
- 2021An XAI Approach to Deep Learning Models in the Detection of DCIS27 Jun 2021
- 2021Chameleon: A Semi-AutoML framework targeting quick and scalable development and deployment of production-ready ML systems for SMEs8 May 2021
- 2021Supervised Transfer Learning at Scale for Medical Imaging14 Jan 2021
50 newest of 51 All 51 (JSON)
- 2022Federated Unlearning with Knowledge Distillationcited by 70
- 2023Subspace based Federated Unlearningcited by 13
- 2023Subspace based Federated Unlearning24 Feb 2023
- 2022Federated Unlearning with Knowledge Distillation24 Jan 2022
- 2021Supervised Transfer Learning at Scale for Medical Imagingcited by 38
- 2022Robust Medical Image Classification from Noisy Labeled Data with Global and Local Representation Guided Co-trainingcited by 21
- 2021MCUa: Multi-level Context and Uncertainty aware Dynamic Deep Ensemble for Breast Cancer Histology Image Classificationcited by 12
- 2021Resolution-Based Distillation for Efficient Histology Image Classificationcited by 10
- 2022On the Origins of the Block Structure Phenomenon in Neural Network Representationscited by 10
- 2022Efficient High-Resolution Deep Learning: A Surveycited by 9
- 2021PointNu-Net: Keypoint-assisted Convolutional Neural Network for Simultaneous Multi-tissue Histology Nuclei Segmentation and Classificationcited by 8
- 2023Improving Representation Learning for Histopathologic Images with Cluster Constraintscited by 8
- 2022Unsupervised Domain Adaptation for Cardiac Segmentation: Towards Structure Mutual Information Maximizationcited by 7
- 2022Evaluating histopathology transfer learning with ChampKitcited by 7
- 2023Large-scale pretraining on pathological images for fine-tuning of small pathological benchmarkscited by 7
- 2023Detecting Heart Disease from Multi-View Ultrasound Images via Supervised Attention Multiple Instance Learningcited by 7
12 most cited of 49 All 49 (JSON)
- 2026Exploiting Label-Independent Regularization from Spatial Dependencies for Whole Slide Image Analysis23 Feb 2026
- 2025Conformal Object Detection by Sequential Risk Control29 May 2025
- 2024Multimodal Quantum Natural Language Processing: A Novel Framework for using Quantum Methods to Analyse Real Data29 Oct 2024
- 2024Advancing Histopathology with Deep Learning Under Data Scarcity: A Decade in Review18 Oct 2024
- 2024Unleashing the Potential of Synthetic Images: A Study on Histopathology Image Classification24 Sep 2024
- 2024Deep Learning with Data Privacy via Residual Perturbation11 Aug 2024
- 2024SaccadeDet: A Novel Dual-Stage Architecture for Rapid and Accurate Detection in Gigapixel Images25 Jul 2024
- 2024Self-supervised Vision Transformer are Scalable Generative Models for Domain Generalization3 Jul 2024
- 2024Region of Interest Detection in Melanocytic Skin Tumor Whole Slide Images -- Nevus & Melanoma16 May 2024
- 2024Pathology-genomic fusion via biologically informed cross-modality graph learning for survival analysis11 Apr 2024
- 2023Improving Representation Learning for Histopathologic Images with Cluster Constraints18 Oct 2023
- 2023A three in one bottom-up framework for simultaneous semantic segmentation, instance segmentation and classification of multi-organ nuclei in digital cancer histology22 Aug 2023
12 newest of 49 All 49 (JSON)