SciReasoner: Laying the Scientific Reasoning Ground Across Disciplines
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
We present a scientific reasoning foundation model that aligns natural language with heterogeneous scientific representations. The model is pretrained on a 206B-token corpus spanning scientific text, pure sequences, and sequence-text pairs, then aligned via SFT on 40M instructions, annealed cold-start bootstrapping to elicit long-form chain-of-thought, and reinforcement learning with task-specific reward shaping, which instills deliberate scientific reasoning. It supports four capability families, covering up to 103 tasks across workflows: (i) faithful translation between text and scientific formats, (ii) text/knowledge extraction, (iii) property prediction, (iv) property classification, (v) unconditional and conditional sequence generation and design. Compared with specialist systems, our approach broadens instruction coverage, improves cross-domain generalization, and enhances fidelity. We detail data curation and training and show that cross-discipline learning strengthens transfer and downstream reliability. The model, instruct tuning datasets and the evaluation code are open-sourced at https://huggingface.co/SciReason and https://github.com/open-sciencelab/SciReason.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 139 references that are in the map. First posted on arXiv 25 Sep 2025.
Builds on
46 of 139 references.
References · 46
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2025Qwen3 Technical Reportcited by 8,820
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2023Instruction Tuning with GPT-4cited by 686
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
34 more
- 2023MultiModal-GPT: A Vision and Language Model for Dialogue with Humanscited by 255
- 2023DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomecited by 143
- 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 133
- 2024Liger Kernel: Efficient Triton Kernels for LLM Trainingcited by 130
- 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 128
- 2024ChemLLM: A Chemical Large Language Modelcited by 106
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 102
- 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
- 2024BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuningcited by 54
- 2025Intern-S1: A Scientific Multimodal Foundation Modelcited by 53
- 2025GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoningcited by 41
- 2025BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Modelcited by 37
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
- 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoningcited by 34
- 2021INTERN: A New Learning Paradigm Towards General Visioncited by 33
- 2024OphCLIP: Hierarchical Retrieval-Augmented Learning for Ophthalmic Surgical Video-Language Pretrainingcited by 29
- 2020Is Transfer Learning Necessary for Protein Landscape Prediction?cited by 28
- 2024GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AIcited by 24
- 2023A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and Modelscited by 23
- 2025ChemMLLM: Chemical Multimodal Large Language Modelcited by 17
- 2025OmniEarth-Bench: Towards Holistic Evaluation of Earth's Six Spheres and Cross-Spheres Interactions with Multimodal Observational Earth Datacited by 14
- 2025A Foundation Model for Spatial Proteomicscited by 12
- 2024Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Modelscited by 10
- 2025Ophora: A Large-Scale Data-Driven Text-Guided Ophthalmic Surgical Video Generation Modelcited by 10
- 2019ncRNA Classification with Graph Convolutional Networkscited by 8
- 2025RadarQA: Multi-modal Quality Analysis of Weather Radar Forecastscited by 8
- 2025Chem3DLLM: 3D Multimodal Large Language Models for Chemistrycited by 7
- 2023Toward Understanding BERT-Like Pre-Training for DNA Foundation Modelscited by 4
- 2024MuMu-LLaMA: Multi-modal Music Understanding and Generation via Large Language Modelscited by 4
- 2025UniGenX: a unified generative foundation model that couples sequence, structure and function to accelerate scientific design across proteins, molecules and materialscited by 4
- 2025Unified Medical Image Tokenizer for Autoregressive Synthesis and Understandingcited by 4
- 2024COMET: Benchmark for Comprehensive Biological Multi-omics Evaluation Tasks and Language Modelscited by 3
- 2024SFM-Protein: Integrative Co-evolutionary Pre-training for Advanced Protein Sequence Representationcited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 9.
11 papers.
- 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoningcited by 5
- 2026SciDataCopilot: An Agentic Data Preparation Framework for AGI-driven Scientific Discoverycited by 4
- 2026Intern-S2-Preview: Scientific Agentic Foundation Modelcited by 4
- 2025ARCHE: A Novel Task to Evaluate LLMs on Latent Reasoning Chain Extractioncited by 3
- 2025SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligencecited by 3
- 2026BioMatrix: Towards a Comprehensive Biological Foundation Model Spanning the Modality Matrix of Sequences, Structures, and Languagecited by 1
- 2026ED-DiT: Physics-Guided Diffusion Pretraining for Transferable Molecular Representations from Electron Densitycited by 1
- 2026Sci-CoE: Co-evolving Scientific Reasoning LLMs via Geometric Consensus with Sparse Supervisioncited by 0
- 2026Deciphering Scientific Reasoning Steps from Outcome Data for Molecule Optimizationcited by 0
- 2026TheBioCollection: Unified Pre-Training Scale LLM Corpus for Biologycited by 0
- 2026Elucidating the Space of Enzymatic Reaction: A Unified Benchmark and Pretrained Modelcited by 0
- 2026Elucidating the Space of Enzymatic Reaction: A Unified Benchmark and Pretrained Model8 Oct 2026
- 2026Intern-S2-Preview: Scientific Agentic Foundation Model13 Aug 2026
- 2026ED-DiT: Physics-Guided Diffusion Pretraining for Transferable Molecular Representations from Electron Density4 Aug 2026
- 2026TheBioCollection: Unified Pre-Training Scale LLM Corpus for Biology9 Jul 2026
- 2026BioMatrix: Towards a Comprehensive Biological Foundation Model Spanning the Modality Matrix of Sequences, Structures, and Language20 Jun 2026
- 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning10 Jun 2026
- 2026Deciphering Scientific Reasoning Steps from Outcome Data for Molecule Optimization13 Mar 2026
- 2026Sci-CoE: Co-evolving Scientific Reasoning LLMs via Geometric Consensus with Sparse Supervision12 Feb 2026
- 2026SciDataCopilot: An Agentic Data Preparation Framework for AGI-driven Scientific Discovery9 Feb 2026
- 2025SciEvalKit: An Open-source Evaluation Toolkit for Scientific General Intelligence26 Dec 2025
- 2025ARCHE: A Novel Task to Evaluate LLMs on Latent Reasoning Chain Extraction16 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026SciR: A Controllable Benchmark for Scientific Reasoning in LLMs
- 2025Demystifying Scientific Problem-Solving in LLMs by Probing Knowledge and Reasoning
- 2026WildSci: Advancing Scientific Reasoning from In-the-Wild Literature
- 2026SciIF: Benchmarking Scientific Instruction Following Towards Rigorous Scientific Intelligence
- 2025OmniScience: A Domain-Specialized LLM for Scientific Reasoning and Discovery
- 2026SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation
- 2024SciInstruct: a Self-Reflective Instruction Annotated Dataset for Training Scientific Language Models
- 2026Improving Data and Reward Design for Scientific Reasoning in Large Language Models