a1: Steep Test-time Scaling Law via Environment Augmented Generation
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large Language Models (LLMs) have made remarkable breakthroughs in reasoning, yet continue to struggle with hallucinations, logical errors, and inability to self-correct during complex multi-step tasks. Current approaches like chain-of-thought prompting offer limited reasoning capabilities that fail when precise step validation is required. We propose Environment Augmented Generation (EAG), a framework that enhances LLM reasoning through: (1) real-time environmental feedback validating each reasoning step, (2) dynamic branch exploration for investigating alternative solution paths when faced with errors, and (3) experience-based learning from successful reasoning trajectories. Unlike existing methods, EAG enables deliberate backtracking and strategic replanning through tight integration of execution feedback with branching exploration. Our a1-32B model achieves state-of-the-art performance among similar-sized models across all benchmarks, matching larger models like o1 on competition mathematics while outperforming comparable models by up to 24.4 percentage points. Analysis reveals EAG's distinctive scaling pattern: initial token investment in environment interaction yields substantial long-term performance dividends, with advantages amplifying proportionally to task complexity. EAG's theoretical framework demonstrates how environment interactivity and systematic branch exploration together establish a new paradigm for reliable machine reasoning, particularly for problems requiring precise multi-step calculation and logical verification.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 76 of its 100 references that are in the map. First posted on arXiv 20 Apr 2025.
Builds on
76 of 100 references.
Closest ancestors · 6
Same direction, newest first
- 2025START: Self-taught Reasoner with Tools6 Mar
- 2025s1: Simple test-time scaling31 Jan
- 2024O1 Replication Journey: A Strategic Progress Report -- Part 18 Oct
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar
- 2022Large Language Models Can Self-Improve20 Oct
Other references · 70
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Let's Verify Step by Stepcited by 3,789
38 more
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2023Reasoning with Language Model is Planning with World Modelcited by 861
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2023Instruction Tuning with GPT-4cited by 686
- 2024Executable Code Actions Elicit Better LLM Agentscited by 564
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2025LIMO: Less is More for Reasoningcited by 498
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 406
- 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 393
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 388
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
- 2024Quiet-STaR: Language Models Can Teach Themselves to Think Before Speakingcited by 301
- 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 282
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
- 2022TALM: Tool Augmented Language Modelscited by 197
- 2023Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoningcited by 178
- 2023Foundation Models for Decision Making: Problems, Methods, and Opportunitiescited by 164
- 2022Language Models of Code are Few-Shot Commonsense Learnerscited by 160
- 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 156
- 2024Orca-Math: Unlocking the potential of SLMs in Grade School Mathcited by 151
- 2023RestGPT: Connecting Large Language Models with Real-World RESTful APIscited by 135
- 2025ReMA: Learning to Meta-think for LLMs with Multi-Agent Reinforcement Learningcited by 79
- 2024ToolGen: Unified Tool Retrieval and Calling via Generationcited by 74
- 2024LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and Locatingcited by 72
- 2022Code4Struct: Code Generation for Few-Shot Event Structure Predictioncited by 70
- 2023PanGu-Coder2: Boosting Large Language Models for Code with Ranking Feedbackcited by 69
- 2025RedStar: Does Scaling Long-CoT Data Unlock Better Slow-Reasoning Systems?cited by 60
- 2024Context-DPO: Aligning Language Models for Context-Faithfulnesscited by 50
- 2024GeoEval: Benchmark for Evaluating LLMs and Multi-Modal Models on Geometry Problem-Solvingcited by 45
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2025: 9; 2026: 4.
13 papers.
Sort:
By area:
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
- 2025Plan and Budget: Effective and Efficient Test-Time Scaling on Reasoning Large Language Modelscited by 32
- 2025Scaling over Scaling: Exploring Test-Time Scaling Plateau in Large Reasoning Modelscited by 11
- 2025ContextNav: Towards Agentic Multimodal In-Context Learningcited by 10
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoningcited by 9
- 2025Focusing by Contrastive Attention: Enhancing VLMs' Visual Reasoningcited by 8
- 2025Large Language Models as Computable Approximations to Solomonoff Inductioncited by 6
- 2026Gated Differentiable Working Memory for Long-Context Language Modelingcited by 6
- 2026VideoStir: Understanding Long Videos via Spatio-Temporally Structured and Intent-Aware RAGcited by 6
- 2025AdaptFlow: Adaptive Workflow Optimization via Meta-Learningcited by 5
- 2025WarriorMath: Enhancing the Mathematical Ability of Large Language Models with a Defect-aware Frameworkcited by 1
- 2025A2R2: Advancing Img2LaTeX Conversion via Visual Reasoning with Attention-Guided Refinementcited by 0
- 2026VideoStir: Understanding Long Videos via Spatio-Temporally Structured and Intent-Aware RAG7 Apr 2026
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning30 Jan 2026
- 2026Emerging from Ground: Addressing Intent Deviation in Tool-Using Agents via Deriving Real Calls into Virtual Trajectories21 Jan 2026
- 2026Gated Differentiable Working Memory for Long-Context Language Modeling19 Jan 2026
- 2025ContextNav: Towards Agentic Multimodal In-Context Learning6 Oct 2025
- 2025Focusing by Contrastive Attention: Enhancing VLMs' Visual Reasoning8 Sep 2025
- 2025AdaptFlow: Adaptive Workflow Optimization via Meta-Learning11 Aug 2025
- 2025WarriorMath: Enhancing the Mathematical Ability of Large Language Models with a Defect-aware Framework2 Aug 2025
- 2025A2R2: Advancing Img2LaTeX Conversion via Visual Reasoning with Attention-Guided Refinement28 Jul 2025
- 2025A Survey of Context Engineering for Large Language Models17 Jul 2025
- 2025Scaling over Scaling: Exploring Test-Time Scaling Plateau in Large Reasoning Models26 May 2025
- 2025Plan and Budget: Effective and Efficient Test-Time Scaling on Reasoning Large Language Models22 May 2025
1 more
- 2025Plan and Budget: Effective and Efficient Test-Time Scaling on Reasoning Large Language Modelscited by 32
- 2025Scaling over Scaling: Exploring Test-Time Scaling Plateau in Large Reasoning Modelscited by 11
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoningcited by 9
- 2025Focusing by Contrastive Attention: Enhancing VLMs' Visual Reasoningcited by 8
- 2025A2R2: Advancing Img2LaTeX Conversion via Visual Reasoning with Attention-Guided Refinementcited by 0
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning30 Jan 2026
- 2025Focusing by Contrastive Attention: Enhancing VLMs' Visual Reasoning8 Sep 2025
- 2025A2R2: Advancing Img2LaTeX Conversion via Visual Reasoning with Attention-Guided Refinement28 Jul 2025
- 2025Scaling over Scaling: Exploring Test-Time Scaling Plateau in Large Reasoning Models26 May 2025
- 2025Plan and Budget: Effective and Efficient Test-Time Scaling on Reasoning Large Language Models22 May 2025
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
- 2025Large Language Models as Computable Approximations to Solomonoff Inductioncited by 6
- 2026Gated Differentiable Working Memory for Long-Context Language Modelingcited by 6
- 2025WarriorMath: Enhancing the Mathematical Ability of Large Language Models with a Defect-aware Frameworkcited by 1
- 2026Gated Differentiable Working Memory for Long-Context Language Modeling19 Jan 2026
- 2025WarriorMath: Enhancing the Mathematical Ability of Large Language Models with a Defect-aware Framework2 Aug 2025
- 2025A Survey of Context Engineering for Large Language Models17 Jul 2025
- 2025Large Language Models as Computable Approximations to Solomonoff Induction21 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025Prompting Test-Time Scaling Is A Strong LLM Reasoning Data Augmentation
- 2025Rethinking the Unsolvable: When In-Context Search Meets Test-Time Scaling
- 2025ARise: Towards Knowledge-Augmented Reasoning via Risk-Adaptive Search
- 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs
- 2025Log-Augmented Generation: Scaling Test-Time Reasoning with Reusable Computation
- 2025Think Twice: Enhancing LLM Reasoning by Scaling Multi-round Test-time Thinking
- 2026LLMs Improving LLMs: Agentic Discovery for Test-Time Scaling
- 2025Revisiting Test-Time Scaling: A Survey and a Diversity-Aware Method for Efficient Reasoning