mlsanityData to 14 Oct 2026

S1-VL: Scientific Multimodal Reasoning Model with Thinking-with-Images

arXiv 2604.21409 ↗First posted 23 Apr 2026cs.CVcited by 5

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

We present S1-VL, a multimodal reasoning model for scientific domains that natively supports two complementary reasoning paradigms: Scientific Reasoning, which relies on structured chain-of-thought, and Thinking-with-Images, which enables the model to actively manipulate images through Python code execution during reasoning. In the Thinking-with-Images mode, the model generates and executes image-processing code in a sandbox environment, obtains intermediate visual results, and continues reasoning in a multi-turn iterative manner. This design is particularly effective for challenging scenarios such as high-resolution scientific chart interpretation, microscopic image understanding, and geometry-assisted reasoning. To construct the training data, we collect scientific multimodal datasets spanning six disciplines: mathematics, physics, chemistry, astronomy, geography, and biology. We further develop a six-dimensional quality filtering framework for reasoning trajectories. To mitigate redundant, ineffective, and erroneous visual operations commonly found in existing datasets, we propose a multi-stage filtering pipeline together with an adaptive data routing strategy. This strategy converts samples with low visual information gain into pure Reasoning-mode data, enabling the model to learn when image operations are truly necessary. S1-VL is trained through a four-stage progressive pipeline: scientific multimodal SFT, Thinking-with-Images cold-start SFT, and two stages of reinforcement learning with SAPO. We build S1-VL-32B on top of Qwen3-VL-32B-Thinking and evaluate it on 13 benchmarks. Experimental results show that S1-VL-32B achieves state-of-the-art performance on all five Thinking-with-Images benchmarks, including HRBench-4K, HRBench-8K, MME-RealWorld-CN, MME-RealWorld-Lite, and V*, and outperforms compared systems on scientific reasoning benchmarks such as Physics and VRSBench.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 52 references that are in the map. First posted on arXiv 23 Apr 2026.

Builds on

27 of 52 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025V-Thinker: Interactive Thinking with Images6 Nov
  2. 2025Thyme: Think Beyond Images15 Aug
  3. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
  4. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  5. 2025Visual Agentic Reinforcement Fine-Tuning20 May
  6. 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thought8 Apr
  7. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
  8. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  9. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  10. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct

Other references · 17

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  6. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  7. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  8. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  9. 2025Seed1.5-VL Technical Reportcited by 373
  10. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  11. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
  12. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 215
5 more
  1. 2025Soft Adaptive Policy Optimizationcited by 96
  2. 2025Intern-S1: A Scientific Multimodal Foundation Modelcited by 53
  3. 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 50
  4. 2025Skywork-R1V4: Toward Agentic Multimodal Intelligence through Interleaved Thinking with Images and DeepResearchcited by 27
  5. 2025Multiplicity is an Inevitable and Inherent Challenge in Multimodal Learningcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation
  2. 2025CSVQA: A Chinese Multimodal Benchmark for Evaluating STEM Reasoning Capabilities of VLMs
  3. 2025SCI-Reason: A Dataset with Chain-of-Thought Rationales for Complex Multimodal Reasoning in Academic Areas
  4. 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utility
  5. 2026TVI-CoT: Text-Visual Interleaved Chain-of-Thought Reasoning for Multimodal Understanding
  6. 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning
  7. 2025VGR: Visual Grounded Reasoning
  8. 2025ChainV: Atomic Visual Hints Make Multimodal Reasoning Shorter and Better