mlsanityData to 13 Oct 2026

Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters

arXiv 2602.10604 ↗First posted 11 Feb 2026cs.CL cs.AIcited by 36

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

also in 1 more
Abstract (arXiv)

We introduce Step 3.5 Flash, a sparse Mixture-of-Experts (MoE) model that bridges frontier-level agentic intelligence and computational efficiency. We focus on what matters most when building agents: sharp reasoning and fast, reliable execution. Step 3.5 Flash pairs a 196B-parameter foundation with 11B active parameters for efficient inference. It is optimized with interleaved 3:1 sliding-window/full attention and Multi-Token Prediction (MTP-3) to reduce the latency and cost of multi-round agentic interactions. To reach frontier-level intelligence, we design a scalable reinforcement learning framework that combines verifiable signals with preference feedback, while remaining stable under large-scale off-policy training, enabling consistent self-improvement across mathematics, code, and tool use. Step 3.5 Flash demonstrates strong performance across agent, coding, and math tasks, achieving 85.4% on IMO-AnswerBench, 86.4% on LiveCodeBench-v6 (2024.08-2025.05), 88.2% on tau2-Bench, 69.0% on BrowseComp (with context management), and 51.0% on Terminal-Bench 2.0, comparable to frontier models such as GPT-5.2 xHigh and Gemini 3.0 Pro. By redefining the efficiency frontier, Step 3.5 Flash provides a high-density foundation for deploying sophisticated agents in real-world industrial environments.

Key facts. Cited by 36 papers in the map (data through 13 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. First posted on arXiv 11 Feb 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 36.

36 papers.

Sort:

By area:

  1. 2026Kimi K3: Open Frontier Intelligencecited by 122
  2. 2026JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Draftingcited by 13
  3. 2026Prefill-as-a-Service: KVCache of Next-Generation Models Could Go Cross-Datacentercited by 11
  4. 2026Seeing with You: Perception-Reasoning Coevolution for Multimodal Reasoningcited by 9
  5. 2026Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routerscited by 9
  6. 2026OneReason Technical Reportcited by 8
  7. 2026KAT-Coder-V2 Technical Reportcited by 7
  8. 2026Training with Harnesses: On-Policy Harness Self-Distillation for Complex Reasoningcited by 7
  9. 2026Loop the Loopies!cited by 7
  10. 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
  11. 2026Rethinking the Role of Efficient Attention in Hybrid Architecturescited by 5
  12. 2026FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agentscited by 4
24 more
  1. 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoningcited by 4
  2. 2026Mach-Mind-4-Flash Technical Reportcited by 4
  3. 2026Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigmscited by 4
  4. 2026CODA: Difficulty-Aware Compute Allocation for Adaptive Reasoningcited by 3
  5. 2026Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctnesscited by 3
  6. 2026SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Researchcited by 3
  7. 2026QED-Nano: Teaching a Tiny Model to Prove Hard Theoremscited by 2
  8. 2026Attention Editing: A Versatile Framework for Cross-Architecture Attention Conversioncited by 2
  9. 2026CONSCIENTIA: Can LLM Agents Learn to Strategize? Emergent Deception and Trust in a Multi-Agent NYC Simulationcited by 2
  10. 2026The Cancellation Hypothesis in Critic-Free RL: From Outcome Rewards to Token Creditscited by 2
  11. 2026Data-Constrained Language Model Pretraining: Improved Regularization and Scaling Lawscited by 2
  12. 2026Harness-IF: Evaluating Instruction Following Across Instruction Surfaces in Coding Agentscited by 2
  13. 2026MathDuels: A Self-Play Benchmark That Growscited by 1
  14. 2026Beyond Trajectory Imitation: Strategy-Guided Policy Optimization for LLM Reasoningcited by 1
  15. 2026Enhancing Mixture-of-Experts Specialization via Cluster-Aware Upcyclingcited by 0
  16. 2026Knowledge Index of Noah's Arkcited by 0
  17. 2026ShopX: A Foundation Model for Intent-to-Item Fulfillment in Agentic Shoppingcited by 0
  18. 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Modelscited by 0
  19. 2026UMoE:Unlocking Every Expert in Domain-Specific Trainingcited by 0
  20. 2026K-EXAONE 2.0 Technical Reportcited by 0
  21. 2026Benchmarking Composable Compression Techniques in Mixture-of-Experts LLMscited by 0
  22. 2026Looped Transformers as Optimizerscited by 0
  23. 2026Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?cited by 0
  24. 2026Rethinking Self-Distillation for Multi-Teacher Capability Mergingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026LongCat-Flash-Thinking-2601 Technical Report
  2. 2025Introducing LongCat-Flash-Thinking: A Technical Report
  3. 2026JoyAI-LLM Flash: Advancing Mid-Scale LLMs with Token Efficiency
  4. 2025INTELLECT-3: Technical Report
  5. 2026LongCat-Flash-Prover: Advancing Native Formal Reasoning via Agentic Tool-Integrated Reinforcement Learning
  6. 2025LongCat-Flash Technical Report
  7. 2026Structuring MoE Expert Selection for Agentic Reinforcement Learning
  8. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models