mlsanityData to 7 Oct 2026

SAGE-32B: Agentic Reasoning via Iterative Distillation

arXiv 2601.04237 ↗First posted 4 Jan 2026cs.AI cs.CL cs.LGcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

We demonstrate SAGE-32B, a 32 billion parameter language model that focuses on agentic reasoning and long range planning tasks. Unlike chat models that aim for general conversation fluency, SAGE-32B is designed to operate in an agentic loop, emphasizing task decomposition, tool usage, and error recovery. The model is initialized from the Qwen2.5-32B pretrained model and fine tuned using Iterative Distillation, a two stage training process that improves reasoning performance through rigorously tested feedback loops. SAGE-32B also introduces an inverse reasoning approach, which uses a meta cognition head to forecast potential failures in the planning process before execution. On agentic reasoning benchmarks including MMLU-Pro, AgentBench, and MATH-500, SAGE-32B achieves higher success rates in multi tool usage scenarios compared to similarly sized baseline models, while remaining competitive on standard reasoning evaluations. Model weights are publicly released at https://huggingface.co/sagea-ai/sage-reasoning-32b

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 13 of its 21 references that are in the map. First posted on arXiv 4 Jan 2026.

Builds on

13 of 21 references.

References · 13

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  5. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  6. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  7. 2020GLU Variants Improve Transformercited by 1,724
  8. 2019Root Mean Square Layer Normalizationcited by 1,425
  9. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  10. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  11. 2023Landmark Attention: Random-Access Infinite Context Length for Transformerscited by 206
  12. 2018Supervising strong learners by amplifying weak expertscited by 139
1 more
  1. 2024The Rosetta Paradox: Domain-Specific Performance Inversions in Large Language Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents
  2. 2026SAGE: Multi-Agent Self-Evolution for LLM Reasoning
  3. 2025AlphaApollo: A System for Deep Agentic Reasoning
  4. 2026Don't Overthink, Don't Underthink: Toward Adaptive Reasoning in Agentic AI
  5. 2025Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools
  6. 2026Self-Adapting Group of Experts for Multi-Agent Reasoning
  7. 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems
  8. 2026Latent-DARM: Bridging Discrete Diffusion And Autoregressive Models For Reasoning