HEMERA: A Human-Explainable Transformer Model for Estimating Lung Cancer Risk using GWAS Data
Not on the map. Why?
Abstract (arXiv)
Lung cancer (LC) is the third most common cancer and the leading cause of cancer deaths in the US. Although smoking is the primary risk factor, the occurrence of LC in never-smokers and familial aggregation studies highlight a genetic component. Genetic biomarkers identified through genome-wide association studies (GWAS) are promising tools for assessing LC risk. We introduce HEMERA (Human-Explainable Transformer Model for Estimating Lung Cancer Risk using GWAS Data), a new framework that applies explainable transformer-based deep learning to GWAS data of single nucleotide polymorphisms (SNPs) for predicting LC risk. Unlike prior approaches, HEMERA directly processes raw genotype data without clinical covariates, introducing additive positional encodings, neural genotype embeddings, and refined variant filtering. A post hoc explainability module based on Layer-wise Integrated Gradients enables attribution of model predictions to specific SNPs, aligning strongly with known LC risk loci. Trained on data from 27,254 Million Veteran Program participants, HEMERA achieved >99% AUC (area under receiver characteristics) score. These findings support transparent, hypothesis-generating models for personalized LC risk assessment and early intervention.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 61 references that are in the map. First posted on arXiv 8 Oct 2025.
Builds on
10 of 61 references.
References · 10
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
- 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 856
- 2019Are Sixteen Heads Really Better than One?cited by 816
- 2020Captum: A unified and generic model interpretability library for PyTorchcited by 547
- 2020A Diagnostic Study of Explainability Techniques for Text Classificationcited by 159
- 2021Discretized Integrated Gradients for Explaining Language Modelscited by 46
- 2022SNP2Vec: Scalable Self-Supervised Pre-Training for Genome-Wide Association Studycited by 5
Built on by
Not cited yet.