mlsanityData to 14 Oct 2026

SciReasoner: Laying the Scientific Reasoning Ground Across Disciplines

arXiv 2509.21320 ↗First posted 25 Sep 2025cs.CLcited by 11

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

We present a scientific reasoning foundation model that aligns natural language with heterogeneous scientific representations. The model is pretrained on a 206B-token corpus spanning scientific text, pure sequences, and sequence-text pairs, then aligned via SFT on 40M instructions, annealed cold-start bootstrapping to elicit long-form chain-of-thought, and reinforcement learning with task-specific reward shaping, which instills deliberate scientific reasoning. It supports four capability families, covering up to 103 tasks across workflows: (i) faithful translation between text and scientific formats, (ii) text/knowledge extraction, (iii) property prediction, (iv) property classification, (v) unconditional and conditional sequence generation and design. Compared with specialist systems, our approach broadens instruction coverage, improves cross-domain generalization, and enhances fidelity. We detail data curation and training and show that cross-discipline learning strengthens transfer and downstream reliability. The model, instruct tuning datasets and the evaluation code are open-sourced at https://huggingface.co/SciReason and https://github.com/open-sciencelab/SciReason.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 139 references that are in the map. First posted on arXiv 25 Sep 2025.

Builds on

46 of 139 references.

References · 46

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2020Scaling Laws for Neural Language Modelscited by 6,586
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  8. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  9. 2024DeepSeek-V3 Technical Reportcited by 811
  10. 2022Galactica: A Large Language Model for Sciencecited by 744
  11. 2023Instruction Tuning with GPT-4cited by 686
  12. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
34 more
  1. 2023MultiModal-GPT: A Vision and Language Model for Dialogue with Humanscited by 255
  2. 2023DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomecited by 143
  3. 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 133
  4. 2024Liger Kernel: Efficient Triton Kernels for LLM Trainingcited by 130
  5. 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 128
  6. 2024ChemLLM: A Chemical Large Language Modelcited by 106
  7. 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 102
  8. 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
  9. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
  10. 2024BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuningcited by 54
  11. 2025Intern-S1: A Scientific Multimodal Foundation Modelcited by 53
  12. 2025GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoningcited by 41
  13. 2025BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Modelcited by 37
  14. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
  15. 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoningcited by 34
  16. 2021INTERN: A New Learning Paradigm Towards General Visioncited by 33
  17. 2024OphCLIP: Hierarchical Retrieval-Augmented Learning for Ophthalmic Surgical Video-Language Pretrainingcited by 29
  18. 2020Is Transfer Learning Necessary for Protein Landscape Prediction?cited by 28
  19. 2024GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AIcited by 24
  20. 2023A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and Modelscited by 23
  21. 2025ChemMLLM: Chemical Multimodal Large Language Modelcited by 17
  22. 2025OmniEarth-Bench: Towards Holistic Evaluation of Earth's Six Spheres and Cross-Spheres Interactions with Multimodal Observational Earth Datacited by 14
  23. 2025A Foundation Model for Spatial Proteomicscited by 12
  24. 2024Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Modelscited by 10
  25. 2025Ophora: A Large-Scale Data-Driven Text-Guided Ophthalmic Surgical Video Generation Modelcited by 10
  26. 2019ncRNA Classification with Graph Convolutional Networkscited by 8
  27. 2025RadarQA: Multi-modal Quality Analysis of Weather Radar Forecastscited by 8
  28. 2025Chem3DLLM: 3D Multimodal Large Language Models for Chemistrycited by 7
  29. 2023Toward Understanding BERT-Like Pre-Training for DNA Foundation Modelscited by 4
  30. 2024MuMu-LLaMA: Multi-modal Music Understanding and Generation via Large Language Modelscited by 4
  31. 2025UniGenX: a unified generative foundation model that couples sequence, structure and function to accelerate scientific design across proteins, molecules and materialscited by 4
  32. 2025Unified Medical Image Tokenizer for Autoregressive Synthesis and Understandingcited by 4
  33. 2024COMET: Benchmark for Comprehensive Biological Multi-omics Evaluation Tasks and Language Modelscited by 3
  34. 2024SFM-Protein: Integrative Co-evolutionary Pre-training for Advanced Protein Sequence Representationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 9.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SciR: A Controllable Benchmark for Scientific Reasoning in LLMs
  2. 2025Demystifying Scientific Problem-Solving in LLMs by Probing Knowledge and Reasoning
  3. 2026WildSci: Advancing Scientific Reasoning from In-the-Wild Literature
  4. 2026SciIF: Benchmarking Scientific Instruction Following Towards Rigorous Scientific Intelligence
  5. 2025OmniScience: A Domain-Specialized LLM for Scientific Reasoning and Discovery
  6. 2026SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation
  7. 2024SciInstruct: a Self-Reflective Instruction Annotated Dataset for Training Scientific Language Models
  8. 2026Improving Data and Reward Design for Scientific Reasoning in Large Language Models