Understanding Breast Cancer Survival: Using Causality and Language Models on Multi-omics Data
Not on the map. Why?
Abstract (arXiv)
The need for more usable and explainable machine learning models in healthcare increases the importance of developing and utilizing causal discovery algorithms, which aim to discover causal relations by analyzing observational data. Explainable approaches aid clinicians and biologists in predicting the prognosis of diseases and suggesting proper treatments. However, very little research has been conducted at the crossroads between causal discovery, genomics, and breast cancer, and we aim to bridge this gap. Moreover, evaluation of causal discovery methods on real data is in general notoriously difficult because ground-truth causal relations are usually unknown, and accordingly, in this paper, we also propose to address the evaluation problem with large language models. In particular, we exploit suitable causal discovery algorithms to investigate how various perturbations in the genome can affect the survival of patients diagnosed with breast cancer. We used three main causal discovery algorithms: PC, Greedy Equivalence Search (GES), and a Generalized Precision Matrix-based one. We experiment with a subset of The Cancer Genome Atlas, which contains information about mutations, copy number variations, protein levels, and gene expressions for 705 breast cancer patients. Our findings reveal important factors related to the vital status of patients using causal discovery algorithms. However, the reliability of these results remains a concern in the medical domain. Accordingly, as another contribution of the work, the results are validated through language models trained on biomedical literature, such as BlueBERT and other large language models trained on medical corpora. Our results profess proper utilization of causal discovery algorithms and language models for revealing reliable causal relations for clinical applications.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 44 references that are in the map. First posted on arXiv 28 May 2023.
Builds on
12 of 44 references.
References · 12
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
- 2017Approximate Kernel-based Conditional Independence Tests for Fast Non-Parametric Causal Discoverycited by 76
- 2021Towards Few-Shot Fact-Checking via Perplexitycited by 63
- 2020Language Models as Fact Checkers?cited by 51
- 2019Neuropathic Pain Diagnosis Simulator for Causal Discovery Algorithm Evaluationcited by 32
- 2020Misinformation Has High Perplexitycited by 15
- 2023Generalized Precision Matrix for Scalable Estimation of Nonparametric Markov Networkscited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.