mlsanityData to 7 Oct 2026

Intern-S2-Preview: Scientific Agentic Foundation Model

arXiv 2608.13505 ↗First posted 13 Aug 2026cs.LG cs.CL cs.CVcited by 3

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Scientific discovery increasingly requires AI systems that can reason over scientific evidence of heterogeneous modalities, interact with scientific tools and environments, and sustain progress across long task horizons. We present Intern-S2-Preview, a series of scientific agentic foundation models designed to support multimodal scientific understanding, reasoning, generation, and long-horizon tasks. The training pipeline begins with scientific multimodal pre-training over rendered scientific documents, interleaved image-text data, and diverse scientific corpora. Starting from the pretrained checkpoint, we apply a unified post-training pipeline consisting of supervised fine-tuning, scalable multi-task reinforcement learning (RL), black- and white-box agentic RL, and on-policy distillation. This pipeline is supported by practical techniques that improve rollout and training stability and efficiency, including partial rollout with off-policy correction, adaptive length regularization, online speculative decoding, robust multi-task optimization, and trace-aware experience assembly for agentic tasks. At the architecture level, Intern-S2-Preview-397B extends time series modelling from efficient long-sequence understanding to numerical forecasting, while Memory Decoder is studied as a separate memory-augmented path for rapid scientific specialization without modifying the frozen 397B backbone. Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings. The time series modules improve scientific signal understanding and forecasting on SciTS, while the separate Intern-MemDec-4B extension improves the Biology-Instructions average score from 56.92 to 60.32 without modifying the frozen 397B backbone.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 89 of its 103 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

89 of 103 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026SciExplore: Evaluating Autonomous Agents from Scientific Navigation to Information Integration23 Jul
  2. 2026ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research28 May
  3. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug

Other references · 86

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Let's Verify Step by Stepcited by 3,598
  4. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  5. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  6. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  7. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  8. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
  9. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  10. 2023Accelerating Large Language Model Decoding with Speculative Samplingcited by 975
  11. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  12. 2025OpenAI GPT-5 System Cardcited by 910
38 more
  1. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  2. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
  3. 2022Galactica: A Large Language Model for Sciencecited by 736
  4. 2024Chronos: Learning the Language of Time Seriescited by 712
  5. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  6. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 564
  7. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  8. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
  9. 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 483
  10. 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 463
  11. 2025Muon is Scalable for LLM Trainingcited by 381
  12. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learningcited by 381
  13. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
  14. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
  15. 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruningcited by 278
  16. 2025Reasoning with Exploration: An Entropy Perspectivecited by 277
  17. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
  18. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
  19. 2025AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoningcited by 234
  20. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
  21. 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agentscited by 140
  22. 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 131
  23. 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 115
  24. 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 105
  25. 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Modelscited by 97
  26. 2025Agent Lightning: Train ANY AI Agents with Reinforcement Learningcited by 94
  27. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 93
  28. 2023T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Stepcited by 91
  29. 2025Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routerscited by 67
  30. 2024MindSearch: Mimicking Human Minds Elicits Deep AI Searchercited by 65
  31. 2026MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Trainingcited by 60
  32. 2025Just Enough Thinking: Efficient Reasoning with Adaptive Length Penalties Reinforcement Learningcited by 51
  33. 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?cited by 50
  34. 2025SimpleQA Verified: A Reliable Factuality Benchmark to Measure Parametric Knowledgecited by 44
  35. 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 36
  36. 2025THOUGHTTERMINATOR: Benchmarking, Calibrating, and Mitigating Overthinking in Reasoning Modelscited by 34
  37. 2026On Data Engineering for Scaling LLM Terminal Capabilitiescited by 34
  38. 2026Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 32

50 most cited of 86 All 86 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Intern-S1: A Scientific Multimodal Foundation Model
  2. 2026InternAgent-1.5: A Unified Agentic Framework for Long-Horizon Autonomous Scientific Discovery
  3. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
  4. 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning
  5. 2026SciResearcher: Scaling Deep Research Agents for Frontier Scientific Reasoning
  6. 2026AIBuildAI-2: A Knowledge-Enhanced Agent for Automatically Building AI Models
  7. 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discovery
  8. 2025DeepEyesV2: Toward Agentic Multimodal Model