DeepGene Transformer: Transformer for the gene expression-based classification of cancer subtypes
Not on the map. Why?
Abstract (arXiv)
Cancer and its subtypes constitute approximately 30% of all causes of death globally and display a wide range of heterogeneity in terms of clinical and molecular responses to therapy. Molecular subtyping has enabled the use of precision medicine to overcome these challenges and provide significant biological insights to predict prognosis and improve clinical decision-making. Over the past decade, conventional machine learning (ML) and deep learning (DL) algorithms have been widely espoused for the classification of cancer subtypes from gene expression datasets. However, these methods are potentially biased toward the identification of cancer biomarkers. Hence, an end-to-end deep learning approach, DeepGene Transformer, is proposed which addresses the complexity of high-dimensional gene expression with a multi-head self-attention module by identifying relevant biomarkers across multiple cancer subtypes without requiring feature selection as a pre-requisite for the current classification algorithms. Comparative analysis reveals that the proposed DeepGene Transformer outperformed the commonly used traditional and state-of-the-art classification algorithms and can be considered an efficient approach for classifying cancer and its subtypes, indicating that any improvement in deep learning models in computational biologists can be reflected well in this domain as well.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 7 of its 41 references that are in the map. First posted on arXiv 26 Aug 2021.
Builds on
7 of 41 references.
References · 7
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021A Survey of Transformerscited by 399
- 2019On the Relationship between Self-Attention and Convolutional Layerscited by 299
- 20191D Convolutional Neural Networks and Applications: A Surveycited by 152
- 2019Convolutional neural network models for cancer type prediction based on gene expressioncited by 22
- 2019Convolution, attention and structure embeddingcited by 15
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 1.
5 papers.
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 70
- 2022A survey on attention mechanisms for medical applications: are we moving towards better algorithms?cited by 15
- 2023Interpretable Medical Imagery Diagnosis with Self-Attentive Transformers: A Review of Explainable AI for Health Carecited by 4
- 2024Federated Learning in Genetics: Extended Analysis of Accuracy, Performance and Privacy Trade-offscited by 1
- 2024Federated Learning in Genetics: Extended Analysis of Accuracy, Performance and Privacy Trade-offs22 Feb 2024
- 2023Interpretable Medical Imagery Diagnosis with Self-Attentive Transformers: A Review of Explainable AI for Health Care1 Sep 2023
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Tasks11 Jun 2023
- 2022A survey on attention mechanisms for medical applications: are we moving towards better algorithms?26 Apr 2022
- 2022Transformers in Medical Imaging: A Survey24 Jan 2022