Advancing Histopathology-Based Breast Cancer Diagnosis: Insights into Multi-Modality and Explainability
Not on the map. Why?
Abstract (arXiv)
It is imperative that breast cancer is detected precisely and timely to improve patient outcomes. Diagnostic methodologies have traditionally relied on unimodal approaches; however, medical data analytics is integrating diverse data sources beyond conventional imaging. Using multi-modal techniques, integrating both image and non-image data, marks a transformative advancement in breast cancer diagnosis. The purpose of this review is to explore the burgeoning field of multimodal techniques, particularly the fusion of histopathology images with non-image data. Further, Explainable AI (XAI) will be used to elucidate the decision-making processes of complex algorithms, emphasizing the necessity of explainability in diagnostic processes. This review utilizes multi-modal data and emphasizes explainability to enhance diagnostic accuracy, clinician confidence, and patient engagement, ultimately fostering more personalized treatment strategies for breast cancer, while also identifying research gaps in multi-modality and explainability, guiding future studies, and contributing to the strategic direction of the field.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 103 references that are in the map. First posted on arXiv 7 Jun 2024.
Builds on
25 of 103 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 134
- 2021BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Imagescited by 132
- 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Reviewcited by 125
- 2023PathLDM: Text conditioned Latent Diffusion Model for Histopathologycited by 52
- 2020HookNet: multi-resolution convolutional neural networks for semantic segmentation in histopathology whole-slide imagescited by 45
- 2024HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interactioncited by 43
- 2024LeGrad: An Explainability Method for Vision Transformers via Feature Formation Sensitivitycited by 33
- 2024LVLM-Interpret: An Interpretability Tool for Large Vision-Language Modelscited by 24
- 2020Towards Explainable Graph Representations in Digital Pathologycited by 17
- 2023A scoping review on multimodal deep learning in biomedical images and textscited by 13
13 more
- 2024LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Taskscited by 13
- 2023Uni-NLX: Unifying Textual Explanations for Vision and Vision-Language Taskscited by 12
- 2024On Image Search in Histopathologycited by 12
- 2023Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directionscited by 11
- 2023A Multimodal Graph Neural Network Framework of Cancer Molecular Subtype Classificationcited by 10
- 2020CLARA: Clinical Report Auto-completioncited by 5
- 2020Mini-DDSM: Mammography-based Automatic Age Estimationcited by 5
- 2023Publicly available datasets of breast histopathology H&E whole-slide images: A scoping reviewcited by 5
- 2021Multi-modality fusion using canonical correlation analysis methods: Application in breast cancer survival prediction from histology and genomicscited by 4
- 2023Improving mitosis detection on histopathology images using large vision-language modelscited by 3
- 2024MM-SurvNet: Deep Learning-Based Survival Risk Stratification in Breast Cancer Through Multimodal Data Fusioncited by 2
- 2024Envisioning MedCLIP: A Deep Dive into Explainability for Medical Vision-Language Modelscited by 2
- 2022The Ability of Image-Language Explainable Models to Resemble Domain Expertisecited by 1
Built on by
Not cited yet.