mlsanityData to 14 Oct 2026

Computer Environments Elicit General Agentic Intelligence in LLMs

arXiv 2601.16206 ↗First posted 22 Jan 2026cs.CL cs.AIcited by 11

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Agentic intelligence in large language models (LLMs) requires not only model intrinsic capabilities but also interactions with external environments. Equipping LLMs with computers now represents a prevailing trend. However, the computer environment's intrinsic value has not been systematically investigated, particularly its potential to elicit general capabilities. Here we introduce LLM-in-Sandbox, which virtualizes the computer as a code sandbox with only basic functionalities, and demonstrate that this minimal setting elicits computer-based meta-capabilities for general task solving: external resource access, file management, and code execution. Without additional training, strong models achieve substantial gains (up to 15.5%) across mathematics, physics, chemistry, biomedicine, long-context understanding, and instruction following, while reducing token consumption by up to 8 times. Furthermore, we develop LLM-in-Sandbox-RL to train models exclusively on non-agentic data within the sandbox, empowering weaker models to harness the environment and internalize these interactions. Our results demonstrate that computer environments elicit general intelligence, yield efficiency gains, and can be harnessed through training, serving as a promising foundation for generalist agents.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 26 of its 41 references that are in the map. First posted on arXiv 22 Jan 2026.

Builds on

26 of 41 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun

Other references · 25

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  7. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  8. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  9. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  10. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  11. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  12. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
13 more
  1. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  2. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  3. 2025OpenAI GPT-5 System Cardcited by 989
  4. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  5. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  6. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 336
  7. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
  8. 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 263
  9. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
  10. 2025Generalizing Verifiable Instruction Followingcited by 194
  11. 2024ChemLLM: A Chemical Large Language Modelcited by 106
  12. 2024Instruction Pre-Training: Language Models are Supervised Multitask Learnerscited by 63
  13. 2025UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Modelscited by 48

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMs
  2. 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agents
  3. 2023The Rise and Potential of Large Language Model Based Agents: A Survey
  4. 2024Enhancing the General Agent Capabilities of Low-Parameter LLMs through Tuning and Multi-Branch Reasoning
  5. 2023AgentBench: Evaluating LLMs as Agents
  6. 2025Procedural Memory Is Not All You Need: Bridging Cognitive Gaps in LLM-Based Agents
  7. 2023Brain in a Vat: On Missing Pieces Towards Artificial General Intelligence in Large Language Models
  8. 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users