mlsanityData to 14 Oct 2026

Leveraging Natural Language Processing to Unravel the Mystery of Life: A Review of NLP Approaches in Genomics, Transcriptomics, and Proteomics

arXiv 2506.02212 ↗First posted 2 Jun 2025cs.CL cs.AI q-bio.GNcited by 0

Not on the map. Why?

Abstract (arXiv)

Natural Language Processing (NLP) has transformed various fields beyond linguistics by applying techniques originally developed for human language to the analysis of biological sequences. This review explores the application of NLP methods to biological sequence data, focusing on genomics, transcriptomics, and proteomics. We examine how various NLP methods, from classic approaches like word2vec to advanced models employing transformers and hyena operators, are being adapted to analyze DNA, RNA, protein sequences, and entire genomes. The review also examines tokenization strategies and model architectures, evaluating their strengths, limitations, and suitability for different biological tasks. We further cover recent advances in NLP applications for biological data, such as structure prediction, gene expression, and evolutionary analysis, highlighting the potential of these methods for extracting meaningful insights from large-scale genomic data. As language models continue to advance, their integration into bioinformatics holds immense promise for advancing our understanding of biological processes in all domains of life.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 157 references that are in the map. First posted on arXiv 2 Jun 2025.

Builds on

37 of 157 references.

References · 37

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  5. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  6. 2020Longformer: The Long-Document Transformercited by 3,413
  7. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  8. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  9. 2018Deep contextualized word representationscited by 2,290
  10. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  11. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  12. 2020Reformer: The Efficient Transformercited by 1,668
25 more
  1. 2020Rethinking Attention with Performerscited by 1,601
  2. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  3. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  4. 2014Distributed Representations of Sentences and Documentscited by 678
  5. 2018Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidatescited by 639
  6. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
  7. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 519
  8. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 393
  9. 2019Evaluating Protein Transfer Learning with TAPEcited by 231
  10. 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolutioncited by 194
  11. 2023DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomecited by 143
  12. 2020ProGen: Language Modeling for Protein Generationcited by 128
  13. 2020BERTology Meets Biology: Interpreting Attention in Protein Language Modelscited by 85
  14. 2022Tranception: protein fitness prediction with autoregressive transformers and inference-time retrievalcited by 79
  15. 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 71
  16. 2019Learning protein sequence embeddings using information from structurecited by 51
  17. 2023Information Retrieval: Recent Advances and Beyondcited by 49
  18. 2022RITA: a Study on Scaling Up Generative Protein Sequence Modelscited by 42
  19. 2020Linear Attention Mechanism: An Efficient Attention for Semantic Segmentationcited by 21
  20. 2023A 5' UTR Language Model for Decoding Untranslated Regions of mRNA and Function Predictionscited by 20
  21. 2017dna2vec: Consistent vector representations of variable-length k-merscited by 16
  22. 2021Multi-modal Self-supervised Pre-training for Regulatory Genome Across Cell Typescited by 8
  23. 2024Linguistic Laws Meet Protein Sequences: A Comparative Analysis of Subword Tokenization Methodscited by 6
  24. 2016Distributed Representations for Biological Sequence Analysiscited by 4
  25. 2017HLA class I binding prediction via convolutional neural networkscited by 3

Built on by

Not cited yet.