mlsanityData to 7 Oct 2026

Improving Cancer Hallmark Classification with BERT-based Deep Learning Approach

arXiv 2305.03501 ↗First posted 2 May 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents a novel approach to accurately classify the hallmarks of cancer, which is a crucial task in cancer research. Our proposed method utilizes the Bidirectional Encoder Representations from Transformers (BERT) architecture, which has shown exceptional performance in various downstream applications. By applying transfer learning, we fine-tuned the pre-trained BERT model on a small corpus of biomedical text documents related to cancer. The outcomes of our experimental investigations demonstrate that our approach attains a noteworthy accuracy of 94.45%, surpassing almost all prior findings with a substantial increase of at least 8.04% as reported in the literature. These findings highlight the effectiveness of our proposed model in accurately classifying and comprehending text documents for cancer research, thus contributing significantly to the field. As cancer remains one of the top ten leading causes of death globally, our approach holds great promise in advancing cancer research and improving patient outcomes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 39 references that are in the map. First posted on arXiv 2 May 2023.

Builds on

8 of 39 references.

References · 8

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2018Deep contextualized word representationscited by 2,285
  4. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  5. 2018A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decaycited by 223
  6. 2019BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysiscited by 176
  7. 2020Deep Learning Based Text Classification: A Comprehensive Reviewcited by 140
  8. 2020ktrain: A Low-Code Library for Augmented Machine Learningcited by 23

Built on by

Not cited yet.