Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have shown remarkable capabilities in general domains, but their application to multi-omics biology remains underexplored. To address this gap, we introduce Biology-Instructions, the first large-scale instruction-tuning dataset for multi-omics biological sequences, including DNA, RNA, proteins, and multi-molecules. This dataset bridges LLMs and complex biological sequence-related tasks, enhancing their versatility and reasoning while maintaining conversational fluency. We also highlight significant limitations of current state-of-the-art LLMs on multi-omics tasks without specialized training. To overcome this, we propose ChatMultiOmics, a strong baseline with a novel three-stage training pipeline, demonstrating superior biological understanding through Biology-Instructions. Both resources are publicly available, paving the way for better integration of LLMs in multi-omics analysis. The Biology-Instructions is publicly available at: https://github.com/hhnqqq/Biology-Instructions.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 32 of its 86 references that are in the map. First posted on arXiv 26 Dec 2024.
Builds on
32 of 86 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023Qwen Technical Reportcited by 3,273
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
20 more
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 686
- 2023Ring Attention with Blockwise Transformers for Near-Infinite Contextcited by 448
- 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 365
- 2024Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothingcited by 341
- 2022Reducing Activation Recomputation in Large Transformer Modelscited by 300
- 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
- 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 231
- 2019Evaluating Protein Transfer Learning with TAPEcited by 229
- 2023DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomecited by 139
- 2024A Closer Look at the Limitations of Instruction Tuningcited by 76
- 2024ProLLaMA: A Protein Large Language Model for Multi-Task Protein Language Processingcited by 53
- 2024Base of RoPE Bounds Context Lengthcited by 49
- 2020Is Transfer Learning Necessary for Protein Landscape Prediction?cited by 27
- 2023InstructProtein: Aligning Human and Protein Language via Knowledge Instructioncited by 27
- 2019ncRNA Classification with Graph Convolutional Networkscited by 7
- 2023Stimulative Training++: Go Beyond The Performance Limits of Residual Networkscited by 6
Built on by
Citing papers per year: 2025: 2; 2026: 7.
9 papers.
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 34
- 2026Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scalecited by 25
- 2025SciReasoner: Laying the Scientific Reasoning Ground Across Disciplinescited by 9
- 2026Intern-S2-Preview: Scientific Agentic Foundation Modelcited by 3
- 2026MemSFT: Mitigating Alignment Tax with an External Parametric Memorycited by 2
- 2026BABE: Biology Arena BEnchmarkcited by 0
- 2026Reasoning4Sciences: Bridging Reasoning Language Models to All Scientific Branchescited by 0
- 2026Monkey King Bang: A Unified Scientific Multimodal Foundation Modelcited by 0
- 2026Tool-Augmented On-Policy Distillation for LLM Domain Adaptation in Sequence-Based Omics Taskscited by 0
- 2026Tool-Augmented On-Policy Distillation for LLM Domain Adaptation in Sequence-Based Omics Tasks20 Sep 2026
- 2026Intern-S2-Preview: Scientific Agentic Foundation Model13 Aug 2026
- 2026MemSFT: Mitigating Alignment Tax with an External Parametric Memory28 Jul 2026
- 2026Monkey King Bang: A Unified Scientific Multimodal Foundation Model17 Jul 2026
- 2026Reasoning4Sciences: Bridging Reasoning Language Models to All Scientific Branches31 May 2026
- 2026Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale26 Mar 2026
- 2026BABE: Biology Arena BEnchmark5 Feb 2026
- 2025SciReasoner: Laying the Scientific Reasoning Ground Across Disciplines25 Sep 2025
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025