mlsanityData to 7 Oct 2026

S1-Omni: A Unified Multimodal Reasoning Model for Scientific Understanding, Prediction, and Generation

arXiv 2607.15686 ↗First posted 17 Jul 2026cs.AIcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

We present S1-Omni, a unified multimodal reasoning model for scientific understanding, prediction, and generation. AI for Science (AI4S) has advanced significantly through domain-specific models, tool-augmented LLMs, and scientific language models. However, model capabilities remain highly fragmented, limiting the joint modeling of heterogeneous data, scientific laws, and expert knowledge. S1-Omni addresses this gap by consolidating these capabilities into a single, coherent scientific reasoning model. The architecture of S1-Omni is built upon three core components: unified representation of scientific data, natural-world knowledge alignment, and decoding for domain-specific tasks. First, S1-Omni maps natural-language instructions and scientific objects, including CIF, SMILES, protein sequences, spectra, and scientific images, into a shared representation space. Second, it incorporates scientific laws and expert knowledge into data construction and training, enabling the model to reason from scientific evidence. Third, it performs task-specific decoding to support a broad range of applications, including property prediction, spectrum-to-molecular generation, protein site and structure prediction, and scientific image generation and editing. S1-Omni is trained on S1-Omni-Corpus, which covers 200 scientific tasks and contains millions of reasoning samples, and is evaluated on over 60 scientific benchmarks. It outperforms GPT-5.5 and Gemini-3.1-Pro on most benchmarks and matches or surpasses domain-specific models on several benchmarks. Overall, S1-Omni provides a practical path toward unified scientific modeling.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 96 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

32 of 96 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026S1-VL: Scientific Multimodal Reasoning Model with Thinking-with-Images23 Apr

Other references · 31

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  4. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  5. 2025Qwen-Image Technical Reportcited by 973
  6. 2025OpenAI GPT-5 System Cardcited by 910
  7. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
  8. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  9. 2025Qwen2.5-Omni Technical Reportcited by 704
  10. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
  11. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  12. 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
19 more
  1. 2024AlphaFold Meets Flow Matching for Generating Protein Ensemblescited by 105
  2. 2023EigenFold: Generative Protein Structure Prediction with Diffusion Modelscited by 63
  3. 2023Learning Joint 2D & 3D Diffusion Models for Complete Molecule Generationcited by 27
  4. 2025PiFlow: Principle-Aware Scientific Discovery with Multi-Agent Collaborationcited by 25
  5. 2025Investigating Text Insulation and Attention Mechanisms for Complex Visual Text Generationcited by 22
  6. 2024Uni-Mol2: Exploring Molecular Pretraining Model at Scalecited by 20
  7. 2025SimpleFold: Folding Proteins is Simpler than You Thinkcited by 16
  8. 2025Chem-R: Learning to Reason as a Chemistcited by 16
  9. 2025Reasoning-Enhanced Large Language Models for Molecular Property Predictioncited by 9
  10. 2026Proteo-R1: Reasoning Foundation Models for De Novo Protein Designcited by 6
  11. 2025DiffSpectra: Molecular Structure Elucidation from Spectra using Diffusion Modelscited by 5
  12. 2025Why Registration Quality Matters: Enhancing sCT Synthesis with IMPACT-Based Registrationcited by 4
  13. 2024Improving Paratope and Epitope Prediction by Multi-Modal Contrastive Learning and Interaction Informativeness Estimationcited by 3
  14. 2025BOOM: Benchmarking Out-Of-distribution Molecular Property Predictions of Machine Learning Modelscited by 3
  15. 2025TechImage-Bench: Rubric-Based Evaluation for Technical Image Generationcited by 2
  16. 2025Omni-Weather: A Unified Multimodal Model for Weather Radar Understanding and Generationcited by 2
  17. 2026Speaking the Language of Science: Toward a General-Purpose Generative Foundation Model for the Natural Sciencescited by 2
  18. 2026S1-Omni-Image: A Unified Model for Scientific Image Understanding, Generation, and Editingcited by 2
  19. 2026BioMatrix: Towards a Comprehensive Biological Foundation Model Spanning the Modality Matrix of Sequences, Structures, and Languagecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025OmniScience: A Domain-Specialized LLM for Scientific Reasoning and Discovery
  2. 2026SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation
  3. 2024Probing the limitations of multimodal language models for chemistry and materials research
  4. 2025SciReasoner: Laying the Scientific Reasoning Ground Across Disciplines
  5. 2025Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tables
  6. 2026Bolek: A Multimodal Language Model for Molecular Reasoning
  7. 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning
  8. 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discovery