Intern-S2-Preview: Scientific Agentic Foundation Model
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Scientific discovery increasingly requires AI systems that can reason over scientific evidence of heterogeneous modalities, interact with scientific tools and environments, and sustain progress across long task horizons. We present Intern-S2-Preview, a series of scientific agentic foundation models designed to support multimodal scientific understanding, reasoning, generation, and long-horizon tasks. The training pipeline begins with scientific multimodal pre-training over rendered scientific documents, interleaved image-text data, and diverse scientific corpora. Starting from the pretrained checkpoint, we apply a unified post-training pipeline consisting of supervised fine-tuning, scalable multi-task reinforcement learning (RL), black- and white-box agentic RL, and on-policy distillation. This pipeline is supported by practical techniques that improve rollout and training stability and efficiency, including partial rollout with off-policy correction, adaptive length regularization, online speculative decoding, robust multi-task optimization, and trace-aware experience assembly for agentic tasks. At the architecture level, Intern-S2-Preview-397B extends time series modelling from efficient long-sequence understanding to numerical forecasting, while Memory Decoder is studied as a separate memory-augmented path for rapid scientific specialization without modifying the frozen 397B backbone. Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings. The time series modules improve scientific signal understanding and forecasting on SciTS, while the separate Intern-MemDec-4B extension improves the Biology-Instructions average score from 56.92 to 60.32 without modifying the frozen 397B backbone.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 89 of its 103 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
89 of 103 references.
Closest ancestors · 3
Same direction, newest first
- 2026SciExplore: Evaluating Autonomous Agents from Scientific Navigation to Information Integration23 Jul
- 2026ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research28 May
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug
Other references · 86
- 2023GPT-4 Technical Reportcited by 18,132
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Let's Verify Step by Stepcited by 3,598
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2023Accelerating Large Language Model Decoding with Speculative Samplingcited by 975
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2025OpenAI GPT-5 System Cardcited by 910
38 more
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 564
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 483
- 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 463
- 2025Muon is Scalable for LLM Trainingcited by 381
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learningcited by 381
- 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
- 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruningcited by 278
- 2025Reasoning with Exploration: An Entropy Perspectivecited by 277
- 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
- 2025AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoningcited by 234
- 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
- 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agentscited by 140
- 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 131
- 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 115
- 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 105
- 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Modelscited by 97
- 2025Agent Lightning: Train ANY AI Agents with Reinforcement Learningcited by 94
- 2024UniTS: A Unified Multi-Task Time Series Modelcited by 93
- 2023T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Stepcited by 91
- 2025Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routerscited by 67
- 2024MindSearch: Mimicking Human Minds Elicits Deep AI Searchercited by 65
- 2026MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Trainingcited by 60
- 2025Just Enough Thinking: Efficient Reasoning with Adaptive Length Penalties Reinforcement Learningcited by 51
- 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?cited by 50
- 2025SimpleQA Verified: A Reliable Factuality Benchmark to Measure Parametric Knowledgecited by 44
- 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 36
- 2025THOUGHTTERMINATOR: Benchmarking, Calibrating, and Mitigating Overthinking in Reasoning Modelscited by 34
- 2026On Data Engineering for Scaling LLM Terminal Capabilitiescited by 34
- 2026Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 32
50 most cited of 86 All 86 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Intern-S1: A Scientific Multimodal Foundation Model
- 2026InternAgent-1.5: A Unified Agentic Framework for Long-Horizon Autonomous Scientific Discovery
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
- 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning
- 2026SciResearcher: Scaling Deep Research Agents for Frontier Scientific Reasoning
- 2026AIBuildAI-2: A Knowledge-Enhanced Agent for Automatically Building AI Models
- 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discovery
- 2025DeepEyesV2: Toward Agentic Multimodal Model