Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
also in 1 more
Abstract (arXiv)
We introduce Step 3.5 Flash, a sparse Mixture-of-Experts (MoE) model that bridges frontier-level agentic intelligence and computational efficiency. We focus on what matters most when building agents: sharp reasoning and fast, reliable execution. Step 3.5 Flash pairs a 196B-parameter foundation with 11B active parameters for efficient inference. It is optimized with interleaved 3:1 sliding-window/full attention and Multi-Token Prediction (MTP-3) to reduce the latency and cost of multi-round agentic interactions. To reach frontier-level intelligence, we design a scalable reinforcement learning framework that combines verifiable signals with preference feedback, while remaining stable under large-scale off-policy training, enabling consistent self-improvement across mathematics, code, and tool use. Step 3.5 Flash demonstrates strong performance across agent, coding, and math tasks, achieving 85.4% on IMO-AnswerBench, 86.4% on LiveCodeBench-v6 (2024.08-2025.05), 88.2% on tau2-Bench, 69.0% on BrowseComp (with context management), and 51.0% on Terminal-Bench 2.0, comparable to frontier models such as GPT-5.2 xHigh and Gemini 3.0 Pro. By redefining the efficiency frontier, Step 3.5 Flash provides a high-density foundation for deploying sophisticated agents in real-world industrial environments.
Key facts. Cited by 36 papers in the map (data through 13 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. First posted on arXiv 11 Feb 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 36.
36 papers.
Sort:
By area:
- 2026Kimi K3: Open Frontier Intelligencecited by 122
- 2026JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Draftingcited by 13
- 2026Prefill-as-a-Service: KVCache of Next-Generation Models Could Go Cross-Datacentercited by 11
- 2026Seeing with You: Perception-Reasoning Coevolution for Multimodal Reasoningcited by 9
- 2026Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routerscited by 9
- 2026OneReason Technical Reportcited by 8
- 2026KAT-Coder-V2 Technical Reportcited by 7
- 2026Training with Harnesses: On-Policy Harness Self-Distillation for Complex Reasoningcited by 7
- 2026Loop the Loopies!cited by 7
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
- 2026Rethinking the Role of Efficient Attention in Hybrid Architecturescited by 5
- 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agentscited by 4
24 more
- 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoningcited by 4
- 2026Mach-Mind-4-Flash Technical Reportcited by 4
- 2026Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigmscited by 4
- 2026CODA: Difficulty-Aware Compute Allocation for Adaptive Reasoningcited by 3
- 2026Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctnesscited by 3
- 2026SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Researchcited by 3
- 2026QED-Nano: Teaching a Tiny Model to Prove Hard Theoremscited by 2
- 2026Attention Editing: A Versatile Framework for Cross-Architecture Attention Conversioncited by 2
- 2026CONSCIENTIA: Can LLM Agents Learn to Strategize? Emergent Deception and Trust in a Multi-Agent NYC Simulationcited by 2
- 2026The Cancellation Hypothesis in Critic-Free RL: From Outcome Rewards to Token Creditscited by 2
- 2026Data-Constrained Language Model Pretraining: Improved Regularization and Scaling Lawscited by 2
- 2026Harness-IF: Evaluating Instruction Following Across Instruction Surfaces in Coding Agentscited by 2
- 2026MathDuels: A Self-Play Benchmark That Growscited by 1
- 2026Beyond Trajectory Imitation: Strategy-Guided Policy Optimization for LLM Reasoningcited by 1
- 2026Enhancing Mixture-of-Experts Specialization via Cluster-Aware Upcyclingcited by 0
- 2026Knowledge Index of Noah's Arkcited by 0
- 2026ShopX: A Foundation Model for Intent-to-Item Fulfillment in Agentic Shoppingcited by 0
- 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Modelscited by 0
- 2026UMoE:Unlocking Every Expert in Domain-Specific Trainingcited by 0
- 2026K-EXAONE 2.0 Technical Reportcited by 0
- 2026Benchmarking Composable Compression Techniques in Mixture-of-Experts LLMscited by 0
- 2026Looped Transformers as Optimizerscited by 0
- 2026Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?cited by 0
- 2026Rethinking Self-Distillation for Multi-Teacher Capability Mergingcited by 0
- 2026Rethinking Self-Distillation for Multi-Teacher Capability Merging3 Oct 2026
- 2026Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?30 Sep 2026
- 2026Looped Transformers as Optimizers29 Sep 2026
- 2026Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigms27 Aug 2026
- 2026Benchmarking Composable Compression Techniques in Mixture-of-Experts LLMs22 Aug 2026
- 2026Harness-IF: Evaluating Instruction Following Across Instruction Surfaces in Coding Agents12 Aug 2026
- 2026K-EXAONE 2.0 Technical Report5 Aug 2026
- 2026Kimi K3: Open Frontier Intelligence27 Jul 2026
- 2026Loop the Loopies!17 Jul 2026
- 2026UMoE:Unlocking Every Expert in Domain-Specific Training13 Jul 2026
- 2026Mach-Mind-4-Flash Technical Report10 Jul 2026
- 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Models10 Jul 2026
24 more
- 2026ShopX: A Foundation Model for Intent-to-Item Fulfillment in Agentic Shopping30 Jun 2026
- 2026Beyond Trajectory Imitation: Strategy-Guided Policy Optimization for LLM Reasoning23 Jun 2026
- 2026JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting16 Jun 2026
- 2026Rethinking the Role of Efficient Attention in Hybrid Architectures13 Jun 2026
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI12 Jun 2026
- 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning10 Jun 2026
- 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents10 Jun 2026
- 2026SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Research8 Jun 2026
- 2026Data-Constrained Language Model Pretraining: Improved Regularization and Scaling Laws5 Jun 2026
- 2026OneReason Technical Report4 Jun 2026
- 2026Knowledge Index of Noah's Ark3 Jun 2026
- 2026Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers18 May 2026
- 2026Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctness11 May 2026
- 2026Training with Harnesses: On-Policy Harness Self-Distillation for Complex Reasoning9 May 2026
- 2026The Cancellation Hypothesis in Critic-Free RL: From Outcome Rewards to Token Credits9 May 2026
- 2026MathDuels: A Self-Play Benchmark That Grows23 Apr 2026
- 2026Prefill-as-a-Service: KVCache of Next-Generation Models Could Go Cross-Datacenter16 Apr 2026
- 2026Enhancing Mixture-of-Experts Specialization via Cluster-Aware Upcycling15 Apr 2026
- 2026CONSCIENTIA: Can LLM Agents Learn to Strategize? Emergent Deception and Trust in a Multi-Agent NYC Simulation10 Apr 2026
- 2026Attention Editing: A Versatile Framework for Cross-Architecture Attention Conversion7 Apr 2026
- 2026QED-Nano: Teaching a Tiny Model to Prove Hard Theorems6 Apr 2026
- 2026Seeing with You: Perception-Reasoning Coevolution for Multimodal Reasoning30 Mar 2026
- 2026KAT-Coder-V2 Technical Report29 Mar 2026
- 2026CODA: Difficulty-Aware Compute Allocation for Adaptive Reasoning9 Mar 2026
- 2026Kimi K3: Open Frontier Intelligencecited by 122
- 2026KAT-Coder-V2 Technical Reportcited by 7
- 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoningcited by 4
- 2026Mach-Mind-4-Flash Technical Reportcited by 4
- 2026SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Researchcited by 3
- 2026CONSCIENTIA: Can LLM Agents Learn to Strategize? Emergent Deception and Trust in a Multi-Agent NYC Simulationcited by 2
- 2026Harness-IF: Evaluating Instruction Following Across Instruction Surfaces in Coding Agentscited by 2
- 2026ShopX: A Foundation Model for Intent-to-Item Fulfillment in Agentic Shoppingcited by 0
- 2026Harness-IF: Evaluating Instruction Following Across Instruction Surfaces in Coding Agents12 Aug 2026
- 2026Kimi K3: Open Frontier Intelligence27 Jul 2026
- 2026Mach-Mind-4-Flash Technical Report10 Jul 2026
- 2026ShopX: A Foundation Model for Intent-to-Item Fulfillment in Agentic Shopping30 Jun 2026
- 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning10 Jun 2026
- 2026SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Research8 Jun 2026
- 2026CONSCIENTIA: Can LLM Agents Learn to Strategize? Emergent Deception and Trust in a Multi-Agent NYC Simulation10 Apr 2026
- 2026KAT-Coder-V2 Technical Report29 Mar 2026
- 2026Seeing with You: Perception-Reasoning Coevolution for Multimodal Reasoningcited by 9
- 2026OneReason Technical Reportcited by 8
- 2026Training with Harnesses: On-Policy Harness Self-Distillation for Complex Reasoningcited by 7
- 2026Rethinking the Role of Efficient Attention in Hybrid Architecturescited by 5
- 2026CODA: Difficulty-Aware Compute Allocation for Adaptive Reasoningcited by 3
- 2026Beyond Trajectory Imitation: Strategy-Guided Policy Optimization for LLM Reasoningcited by 1
- 2026Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?cited by 0
- 2026Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?30 Sep 2026
- 2026Beyond Trajectory Imitation: Strategy-Guided Policy Optimization for LLM Reasoning23 Jun 2026
- 2026Rethinking the Role of Efficient Attention in Hybrid Architectures13 Jun 2026
- 2026OneReason Technical Report4 Jun 2026
- 2026Training with Harnesses: On-Policy Harness Self-Distillation for Complex Reasoning9 May 2026
- 2026Seeing with You: Perception-Reasoning Coevolution for Multimodal Reasoning30 Mar 2026
- 2026CODA: Difficulty-Aware Compute Allocation for Adaptive Reasoning9 Mar 2026
- 2026Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routerscited by 9
- 2026Loop the Loopies!cited by 7
- 2026Enhancing Mixture-of-Experts Specialization via Cluster-Aware Upcyclingcited by 0
- 2026UMoE:Unlocking Every Expert in Domain-Specific Trainingcited by 0
- 2026K-EXAONE 2.0 Technical Reportcited by 0
- 2026Benchmarking Composable Compression Techniques in Mixture-of-Experts LLMscited by 0
- 2026Benchmarking Composable Compression Techniques in Mixture-of-Experts LLMs22 Aug 2026
- 2026K-EXAONE 2.0 Technical Report5 Aug 2026
- 2026Loop the Loopies!17 Jul 2026
- 2026UMoE:Unlocking Every Expert in Domain-Specific Training13 Jul 2026
- 2026Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers18 May 2026
- 2026Enhancing Mixture-of-Experts Specialization via Cluster-Aware Upcycling15 Apr 2026
- 2026MathDuels: A Self-Play Benchmark That Growscited by 1
- 2026MathDuels: A Self-Play Benchmark That Grows23 Apr 2026
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
- 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agentscited by 4
- 2026Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigmscited by 4
- 2026Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctnesscited by 3
- 2026QED-Nano: Teaching a Tiny Model to Prove Hard Theoremscited by 2
- 2026Attention Editing: A Versatile Framework for Cross-Architecture Attention Conversioncited by 2
- 2026The Cancellation Hypothesis in Critic-Free RL: From Outcome Rewards to Token Creditscited by 2
- 2026Data-Constrained Language Model Pretraining: Improved Regularization and Scaling Lawscited by 2
- 2026Knowledge Index of Noah's Arkcited by 0
- 2026Looped Transformers as Optimizerscited by 0
- 2026Looped Transformers as Optimizers29 Sep 2026
- 2026Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigms27 Aug 2026
- 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI12 Jun 2026
- 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents10 Jun 2026
- 2026Data-Constrained Language Model Pretraining: Improved Regularization and Scaling Laws5 Jun 2026
- 2026Knowledge Index of Noah's Ark3 Jun 2026
- 2026Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctness11 May 2026
- 2026The Cancellation Hypothesis in Critic-Free RL: From Outcome Rewards to Token Credits9 May 2026
- 2026Attention Editing: A Versatile Framework for Cross-Architecture Attention Conversion7 Apr 2026
- 2026QED-Nano: Teaching a Tiny Model to Prove Hard Theorems6 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026LongCat-Flash-Thinking-2601 Technical Report
- 2025Introducing LongCat-Flash-Thinking: A Technical Report
- 2026JoyAI-LLM Flash: Advancing Mid-Scale LLMs with Token Efficiency
- 2025INTELLECT-3: Technical Report
- 2026LongCat-Flash-Prover: Advancing Native Formal Reasoning via Agentic Tool-Integrated Reinforcement Learning
- 2025LongCat-Flash Technical Report
- 2026Structuring MoE Expert Selection for Agentic Reinforcement Learning
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models