mlsanityData to 7 Oct 2026

DeepGene Transformer: Transformer for the gene expression-based classification of cancer subtypes

arXiv 2108.11833 ↗First posted 26 Aug 2021q-bio.QM cs.AI q-bio.GNcited by 5

Not on the map. Why?

Abstract (arXiv)

Cancer and its subtypes constitute approximately 30% of all causes of death globally and display a wide range of heterogeneity in terms of clinical and molecular responses to therapy. Molecular subtyping has enabled the use of precision medicine to overcome these challenges and provide significant biological insights to predict prognosis and improve clinical decision-making. Over the past decade, conventional machine learning (ML) and deep learning (DL) algorithms have been widely espoused for the classification of cancer subtypes from gene expression datasets. However, these methods are potentially biased toward the identification of cancer biomarkers. Hence, an end-to-end deep learning approach, DeepGene Transformer, is proposed which addresses the complexity of high-dimensional gene expression with a multi-head self-attention module by identifying relevant biomarkers across multiple cancer subtypes without requiring feature selection as a pre-requisite for the current classification algorithms. Comparative analysis reveals that the proposed DeepGene Transformer outperformed the commonly used traditional and state-of-the-art classification algorithms and can be considered an efficient approach for classifying cancer and its subtypes, indicating that any improvement in deep learning models in computational biologists can be reflected well in this domain as well.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 7 of its 41 references that are in the map. First posted on arXiv 26 Aug 2021.

Builds on

7 of 41 references.

References · 7

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021A Survey of Transformerscited by 399
  4. 2019On the Relationship between Self-Attention and Convolutional Layerscited by 299
  5. 20191D Convolutional Neural Networks and Applications: A Surveycited by 152
  6. 2019Convolutional neural network models for cancer type prediction based on gene expressioncited by 22
  7. 2019Convolution, attention and structure embeddingcited by 15

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 2; 2024: 1.

5 papers.