Recent advances in deep learning and language models for studying the microbiome
Not on the map. Why?
Abstract (arXiv)
Recent advancements in deep learning, particularly large language models (LLMs), made a significant impact on how researchers study microbiome and metagenomics data. Microbial protein and genomic sequences, like natural languages, form a language of life, enabling the adoption of LLMs to extract useful insights from complex microbial ecologies. In this paper, we review applications of deep learning and language models in analyzing microbiome and metagenomics data. We focus on problem formulations, necessary datasets, and the integration of language modeling techniques. We provide an extensive overview of protein/genomic language modeling and their contributions to microbiome studies. We also discuss applications such as novel viromics language modeling, biosynthetic gene cluster prediction, and knowledge integration for metagenomics studies.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 61 references that are in the map. First posted on arXiv 15 Sep 2024.
Builds on
16 of 61 references.
References · 16
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
- 2020ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computingcited by 162
- 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 156
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 152
4 more
- 2024A Comprehensive Review of Multimodal Large Language Models: Performance and Challenges Across Different Taskscited by 57
- 2023BEND: Benchmarking DNA Language Models on biologically meaningful taskscited by 27
- 2024ProLLM: Protein Chain-of-Thoughts Enhanced LLM for Protein-Protein Interaction Predictioncited by 12
- 2024FGBERT: Function-Driven Pre-trained Gene Language Model for Metagenomicscited by 2
Built on by
Not cited yet.