Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Model
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
We present Nanbeige4.2-3B, a compact general agentic model with 3B non-embedding parameters. It delivers strong performance across code-agent, office-agent, and complex tool-use tasks while maintaining highly competitive reasoning capabilities in mathematics, coding, and science. Nanbeige4.2-3B is pretrained from scratch on 28T tokens with a Looped Transformer that reuses the layer stack to increase capacity without adding parameters. For SFT data and trajectory construction, we expand the diversity of executable environments, task assets, and agentic scaffolds through real-world deployment and large-scale synthesis. Our RL pipeline applies mixed-mode RLHF over Think and Non-Think responses to improve overall model quality and reduce failure cases, length-controlled reasoning RL to balance accuracy and reasoning efficiency, and agentic RL with outcome and process rewards to stabilize long-horizon training. Extensive evaluations show that Nanbeige4.2-3B outperforms larger models, including Qwen3.5-9B and Gemma4-12B, across diverse agentic benchmarks while remaining competitive on reasoning and alignment tasks. Performance with OpenClaw further supports its use as a compact local personal assistant.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 34 references that are in the map. First posted on arXiv 24 Jul 2026.
Builds on
28 of 34 references.
Closest ancestors · 3
Same direction, newest first
- 2026Tmax: A simple recipe for terminal agents22 Jun
- 2026ClawGym: A Scalable Framework for Building Effective Claw Agents29 Apr
- 2026AgentIF-OneDay: A Task-level Instruction-Following Benchmark for General AI Agents in Daily Scenarios28 Jan
Other references · 25
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
- 2026Gemma 4 Technical Reportcited by 187
- 2025Generalizing Verifiable Instruction Followingcited by 178
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 172
- 2025Scaling Latent Reasoning via Looped Language Modelscited by 145
13 more
- 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 142
- 2025Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computationcited by 120
- 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 115
- 2025ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agentscited by 80
- 2025Towards Robust Mathematical Reasoningcited by 67
- 2026MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Serverscited by 46
- 2026OfficeQA Pro: An Enterprise Benchmark for End-to-End Grounded Reasoningcited by 37
- 2026DeepResearch Bench II: Diagnosing Deep Research Agents via Rubrics from Expert Reportscited by 33
- 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Datasetcited by 27
- 2025Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Modelscited by 6
- 2026IQuest-Coder-V1 Technical Reportcited by 6
- 2026Nanbeige4.1-3B: A Small General Model that Reasons, Aligns, and Actscited by 5
- 2026VibeThinker-3B: Exploring the Frontier of Verifiable Reasoning in Small Language Modelscited by 1
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026LoopSpec: Pipelined Self-Speculative Decoding for Looped Transformerscited by 2
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harnesscited by 1
- 2026Nanbeige4.2-3B on Apple Silicon: Fixing Deployment Bugs and Decreasing Looped Transformer Memory Overheadcited by 0
- 2026WaveFront Decoding: Parallelized Self-Speculative Decoding for Looped Language Modelscited by 0
- 2026Quantizing Looped Transformers: Feedback Exposure and Calibration Blindnesscited by 0
- 2026Looping Beyond Twice: A Scalable Recipe for Looped Mixture-of-Expertscited by 0
- 2026Universal interpolation for deep residual self-attention networkscited by 0
- 2026Enabling Dynamic Computation in Looped LMscited by 0
- 2026From Chain-of-Thought to Loops: Non-Autoregressive Latent Reasoning via Looped Transformerscited by 0
- 2026From Chain-of-Thought to Loops: Non-Autoregressive Latent Reasoning via Looped Transformers8 Oct 2026
- 2026Enabling Dynamic Computation in Looped LMs6 Oct 2026
- 2026Universal interpolation for deep residual self-attention networks1 Oct 2026
- 2026Looping Beyond Twice: A Scalable Recipe for Looped Mixture-of-Experts1 Oct 2026
- 2026Quantizing Looped Transformers: Feedback Exposure and Calibration Blindness25 Sep 2026
- 2026WaveFront Decoding: Parallelized Self-Speculative Decoding for Looped Language Models19 Sep 2026
- 2026LoopSpec: Pipelined Self-Speculative Decoding for Looped Transformers15 Sep 2026
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness8 Sep 2026
- 2026Nanbeige4.2-3B on Apple Silicon: Fixing Deployment Bugs and Decreasing Looped Transformer Memory Overhead14 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Agentic Proposing: Enhancing Large Language Model Reasoning via Compositional Skill Synthesis
- 2026From Atomic to Agentic: Towards Interpretable Evaluation of LLMs' Agentic Mathematical Capabilities
- 2026MAVEN: Improving Generalization in Agentic Tool Calling
- 2025AgentCoMa: A Compositional Benchmark Mixing Commonsense and Mathematical Reasoning in Real-World Scenarios
- 2025Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents
- 2024Sibyl: Simple yet Effective Agent Framework for Complex Real-world Reasoning
- 2025AgentFrontier: Expanding the Capability Frontier of LLM Agents with ZPD-Guided Data Synthesis