How Post-Training Shapes Biological Reasoning Models
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Scientific reasoning models for biology combine language models with foundation models trained on multimodal biological data, including DNA, RNA, and proteins. These models are built through post-training, yet how each stage shapes reasoning and generalization remains poorly understood. We study when post-training improves performance and when it induces over-specialization. Across genomics, transcriptomics, and proteins, we train and evaluate more than 100 biological reasoning models under controlled variation in backbone, continued pre-training (CPT), supervised fine-tuning (SFT), and reinforcement learning (RL), measuring both in-domain (ID) and out-of-domain (OOD) performance. We find that each post-training stage reshapes generalization in a distinct way rather than contributing uniform gains. CPT improves downstream performance by aligning models with biological language. SFT consistently increases ID performance but causes OOD performance to peak early and decline as models fit the training distribution. RL, when applied to strong SFT checkpoints with aligned rewards, improves OOD performance and partially recovers generalization. These results show that biological reasoning does not improve monotonically with additional supervision or compute. Instead, performance depends on how training stages are composed. Under fixed post-training budgets, the strongest ID-OOD trade-off comes from brief SFT, larger RL allocations, and asymmetric adaptation capacity across stages.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 44 of its 97 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
44 of 97 references.
Closest ancestors · 6
Same direction, newest first
- 2026scPilot: Large Language Model Reasoning Toward Automated Single-Cell Analysis and Discovery12 Feb
- 2025Unleashing Scientific Reasoning for Bio-experimental Protocol Generation via Structured Component-based Reward Mechanism17 Oct
- 2025Gene-R1: Reasoning with Data-Augmented Lightweight LLMs for Gene Set Analysis11 Sep
- 2025Training a Scientific Reasoning Model for Chemistry4 Jun
- 2025BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Model29 May
- 2025Toward Scientific Reasoning in LLMs: Training from Expert Discussions via Reinforcement Learning26 May
Other references · 38
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2025Qwen3 Technical Reportcited by 8,195
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,734
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,104
26 more
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
- 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
- 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 288
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
- 2024When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Methodcited by 201
- 2023Continual Pre-training of Language Modelscited by 194
- 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 156
- 2023DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomecited by 139
- 2023Continual Pre-Training of Large Language Models: How to (re)warm your model?cited by 135
- 2024Simple and Scalable Strategies to Continually Pre-train Large Language Modelscited by 122
- 2025The Art of Scaling Reinforcement Learning Compute for LLMscited by 91
- 2025AI-Researcher: Autonomous Scientific Innovationcited by 88
- 2024Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Modelscited by 69
- 2025MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoningcited by 56
- 2024D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Modelscited by 39
- 2025The Coverage Principle: How Pre-Training Enables Post-Trainingcited by 25
- 2025LoongRL: Reinforcement Learning for Advanced Reasoning over Long Contextscited by 25
- 2025EvoLM: In Search of Lost Language Model Training Dynamicscited by 16
- 2025Training Dynamics Impact Post-Training Quantization Robustnesscited by 13
- 2025Reshaping Reasoning in LLMs: A Theoretical Analysis of RL Training Dynamics through Pattern Selectioncited by 11
- 2025SCI-Verifier: Scientific Verifier with Thinkingcited by 6
- 2025VCWorld: A Biological World Model for Virtual Cell Simulationcited by 6
- 2025CoT-Evo: Evolutionary Distillation of Chain-of-Thought for Scientific Reasoningcited by 5
- 2026Helix: Evolutionary Reinforcement Learning for Open-Ended Scientific Problem Solvingcited by 1
- 2026PhageBench: Can LLMs Understand Raw Bacteriophage Genomes?cited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026BioAlchemy: Distilling Biological Literature into Reasoning-Ready Reinforcement Learning Training Data
- 2026PertMind: Eliciting Emergent Biological Reasoning in LLM via Reinforcement Learning on Cellular Perturbation Data
- 2025SynthPert: Enhancing LLM Biological Reasoning via Synthetic Reasoning Traces for Cellular Perturbation Prediction
- 2025On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models
- 2026BioBridge: Bridging Proteins and Language for Enhanced Biological Reasoning with LLMs
- 2026Post-Reasoning: Improving the Performance of Non-Thinking Models at No Cost
- 2026SciHorizon-GENE: Benchmarking LLM for Life Sciences Inference from Gene Knowledge to Functional Understanding
- 2025BioMedGPT-Mol: Multi-task Learning for Molecular Understanding and Generation