mlsanityData to 14 Oct 2026

a1: Steep Test-time Scaling Law via Environment Augmented Generation

arXiv 2504.14597 ↗First posted 20 Apr 2025cs.CLcited by 13

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large Language Models (LLMs) have made remarkable breakthroughs in reasoning, yet continue to struggle with hallucinations, logical errors, and inability to self-correct during complex multi-step tasks. Current approaches like chain-of-thought prompting offer limited reasoning capabilities that fail when precise step validation is required. We propose Environment Augmented Generation (EAG), a framework that enhances LLM reasoning through: (1) real-time environmental feedback validating each reasoning step, (2) dynamic branch exploration for investigating alternative solution paths when faced with errors, and (3) experience-based learning from successful reasoning trajectories. Unlike existing methods, EAG enables deliberate backtracking and strategic replanning through tight integration of execution feedback with branching exploration. Our a1-32B model achieves state-of-the-art performance among similar-sized models across all benchmarks, matching larger models like o1 on competition mathematics while outperforming comparable models by up to 24.4 percentage points. Analysis reveals EAG's distinctive scaling pattern: initial token investment in environment interaction yields substantial long-term performance dividends, with advantages amplifying proportionally to task complexity. EAG's theoretical framework demonstrates how environment interactivity and systematic branch exploration together establish a new paradigm for reliable machine reasoning, particularly for problems requiring precise multi-step calculation and logical verification.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 76 of its 100 references that are in the map. First posted on arXiv 20 Apr 2025.

Builds on

76 of 100 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025START: Self-taught Reasoner with Tools6 Mar
  2. 2025s1: Simple test-time scaling31 Jan
  3. 2024O1 Replication Journey: A Strategic Progress Report -- Part 18 Oct
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
  5. 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar
  6. 2022Large Language Models Can Self-Improve20 Oct

Other references · 70

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  9. 2024Qwen2.5 Technical Reportcited by 4,942
  10. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  11. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  12. 2023Let's Verify Step by Stepcited by 3,789
38 more
  1. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  2. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  3. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  4. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  5. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
  6. 2022Solving math word problems with process- and outcome-based feedbackcited by 901
  7. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
  8. 2023Reasoning with Language Model is Planning with World Modelcited by 861
  9. 2024DeepSeek-V3 Technical Reportcited by 811
  10. 2023Instruction Tuning with GPT-4cited by 686
  11. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  12. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
  13. 2025LIMO: Less is More for Reasoningcited by 498
  14. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
  15. 2024AFlow: Automating Agentic Workflow Generationcited by 432
  16. 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 406
  17. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 393
  18. 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 388
  19. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
  20. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
  21. 2024Quiet-STaR: Language Models Can Teach Themselves to Think Before Speakingcited by 301
  22. 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 282
  23. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
  24. 2022TALM: Tool Augmented Language Modelscited by 197
  25. 2023Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoningcited by 178
  26. 2023Foundation Models for Decision Making: Problems, Methods, and Opportunitiescited by 164
  27. 2022Language Models of Code are Few-Shot Commonsense Learnerscited by 160
  28. 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 156
  29. 2024Orca-Math: Unlocking the potential of SLMs in Grade School Mathcited by 151
  30. 2023RestGPT: Connecting Large Language Models with Real-World RESTful APIscited by 135
  31. 2025ReMA: Learning to Meta-think for LLMs with Multi-Agent Reinforcement Learningcited by 79
  32. 2024ToolGen: Unified Tool Retrieval and Calling via Generationcited by 74
  33. 2024LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and Locatingcited by 72
  34. 2022Code4Struct: Code Generation for Few-Shot Event Structure Predictioncited by 70
  35. 2023PanGu-Coder2: Boosting Large Language Models for Code with Ranking Feedbackcited by 69
  36. 2025RedStar: Does Scaling Long-CoT Data Unlock Better Slow-Reasoning Systems?cited by 60
  37. 2024Context-DPO: Aligning Language Models for Context-Faithfulnesscited by 50
  38. 2024GeoEval: Benchmark for Evaluating LLMs and Multi-Modal Models on Geometry Problem-Solvingcited by 45

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 4.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Prompting Test-Time Scaling Is A Strong LLM Reasoning Data Augmentation
  2. 2025Rethinking the Unsolvable: When In-Context Search Meets Test-Time Scaling
  3. 2025ARise: Towards Knowledge-Augmented Reasoning via Risk-Adaptive Search
  4. 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs
  5. 2025Log-Augmented Generation: Scaling Test-Time Reasoning with Reusable Computation
  6. 2025Think Twice: Enhancing LLM Reasoning by Scaling Multi-round Test-time Thinking
  7. 2026LLMs Improving LLMs: Agentic Discovery for Test-Time Scaling
  8. 2025Revisiting Test-Time Scaling: A Survey and a Diversity-Aware Method for Efficient Reasoning