mlsanityData to 7 Oct 2026

How Post-Training Shapes Biological Reasoning Models

arXiv 2606.16517 ↗First posted 15 Jun 2026cs.LG q-bio.QMcited by 1

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Scientific reasoning models for biology combine language models with foundation models trained on multimodal biological data, including DNA, RNA, and proteins. These models are built through post-training, yet how each stage shapes reasoning and generalization remains poorly understood. We study when post-training improves performance and when it induces over-specialization. Across genomics, transcriptomics, and proteins, we train and evaluate more than 100 biological reasoning models under controlled variation in backbone, continued pre-training (CPT), supervised fine-tuning (SFT), and reinforcement learning (RL), measuring both in-domain (ID) and out-of-domain (OOD) performance. We find that each post-training stage reshapes generalization in a distinct way rather than contributing uniform gains. CPT improves downstream performance by aligning models with biological language. SFT consistently increases ID performance but causes OOD performance to peak early and decline as models fit the training distribution. RL, when applied to strong SFT checkpoints with aligned rewards, improves OOD performance and partially recovers generalization. These results show that biological reasoning does not improve monotonically with additional supervision or compute. Instead, performance depends on how training stages are composed. Under fixed post-training budgets, the strongest ID-OOD trade-off comes from brief SFT, larger RL allocations, and asymmetric adaptation capacity across stages.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 44 of its 97 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

44 of 97 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026scPilot: Large Language Model Reasoning Toward Automated Single-Cell Analysis and Discovery12 Feb
  2. 2025Unleashing Scientific Reasoning for Bio-experimental Protocol Generation via Structured Component-based Reward Mechanism17 Oct
  3. 2025Gene-R1: Reasoning with Data-Augmented Lightweight LLMs for Gene Set Analysis11 Sep
  4. 2025Training a Scientific Reasoning Model for Chemistry4 Jun
  5. 2025BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Model29 May
  6. 2025Toward Scientific Reasoning in LLMs: Training from Expert Discussions via Reinforcement Learning26 May

Other references · 38

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2020Scaling Laws for Neural Language Modelscited by 6,411
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  7. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  8. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  9. 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,734
  10. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  11. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  12. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,104
26 more
  1. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
  2. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
  3. 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
  4. 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 288
  5. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
  6. 2024When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Methodcited by 201
  7. 2023Continual Pre-training of Language Modelscited by 194
  8. 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 156
  9. 2023DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomecited by 139
  10. 2023Continual Pre-Training of Large Language Models: How to (re)warm your model?cited by 135
  11. 2024Simple and Scalable Strategies to Continually Pre-train Large Language Modelscited by 122
  12. 2025The Art of Scaling Reinforcement Learning Compute for LLMscited by 91
  13. 2025AI-Researcher: Autonomous Scientific Innovationcited by 88
  14. 2024Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Modelscited by 69
  15. 2025MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoningcited by 56
  16. 2024D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Modelscited by 39
  17. 2025The Coverage Principle: How Pre-Training Enables Post-Trainingcited by 25
  18. 2025LoongRL: Reinforcement Learning for Advanced Reasoning over Long Contextscited by 25
  19. 2025EvoLM: In Search of Lost Language Model Training Dynamicscited by 16
  20. 2025Training Dynamics Impact Post-Training Quantization Robustnesscited by 13
  21. 2025Reshaping Reasoning in LLMs: A Theoretical Analysis of RL Training Dynamics through Pattern Selectioncited by 11
  22. 2025SCI-Verifier: Scientific Verifier with Thinkingcited by 6
  23. 2025VCWorld: A Biological World Model for Virtual Cell Simulationcited by 6
  24. 2025CoT-Evo: Evolutionary Distillation of Chain-of-Thought for Scientific Reasoningcited by 5
  25. 2026Helix: Evolutionary Reinforcement Learning for Open-Ended Scientific Problem Solvingcited by 1
  26. 2026PhageBench: Can LLMs Understand Raw Bacteriophage Genomes?cited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026BioAlchemy: Distilling Biological Literature into Reasoning-Ready Reinforcement Learning Training Data
  2. 2026PertMind: Eliciting Emergent Biological Reasoning in LLM via Reinforcement Learning on Cellular Perturbation Data
  3. 2025SynthPert: Enhancing LLM Biological Reasoning via Synthetic Reasoning Traces for Cellular Perturbation Prediction
  4. 2025On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models
  5. 2026BioBridge: Bridging Proteins and Language for Enhanced Biological Reasoning with LLMs
  6. 2026Post-Reasoning: Improving the Performance of Non-Thinking Models at No Cost
  7. 2026SciHorizon-GENE: Benchmarking LLM for Life Sciences Inference from Gene Knowledge to Functional Understanding
  8. 2025BioMedGPT-Mol: Multi-task Learning for Molecular Understanding and Generation