Coding Agents are Effective Long-Context Processors
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Large Language Models (LLMs) have demonstrated remarkable progress in scaling to access massive contexts. However, the access is via the latent and uninterpretable attention mechanisms, and LLMs fail to effective process long context, exhibiting significant performance degradation as context length increases. In this work, we study whether long-context processing can be externalized from latent attention into explicit, executable interactions, by allowing coding agents to organize text in file systems and manipulate it using its native tools. We evaluate off-the-shelf frontier coding agents as the general interface for tasks that require processing long contexts, including long-context reasoning, retrieval-augmented generation, and open-domain question answering with large-scale corpus contains up to three trillion tokens. Across multiple benchmarks, these agents outperform published state-of-the-art by 17.3% on average. We attribute this efficacy to two key factors: native tool proficiency, which enables agents to leverage executable code and terminal commands rather than passive semantic queries, and file system familiarity, which allows them to navigate massive text corpora as directory structures. These findings suggest that delegating long-context processing to coding agents offers an effective alternative to semantic search or context window scaling, opening new directions for long-context processing in LLMs.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 47 of its 52 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
47 of 52 references.
Closest ancestors · 1
Same direction, newest first
Other references · 46
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
- 2025OpenAI GPT-5 System Cardcited by 910
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
34 more
- 2024Scaling and evaluating sparse autoencoderscited by 530
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
- 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 278
- 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 253
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
- 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
- 2025Open Problems in Mechanistic Interpretabilitycited by 173
- 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
- 2025Context Length Alone Hurts LLM Performance Despite Perfect Retrievalcited by 118
- 2024Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approachcited by 117
- 2023Retrieval meets Long Context Large Language Modelscited by 114
- 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 95
- 2025Recursive Language Modelscited by 94
- 2025Gemini Embedding: Generalizable Embeddings from Geminicited by 93
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2023At Which Training Stage Does Code Data Help LLMs Reasoning?cited by 82
- 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scalecited by 61
- 2024MASAI: Modular Architecture for Software-engineering AI Agentscited by 49
- 2025Chain-of-Retrieval Augmented Generationcited by 48
- 2025Oolong: Evaluating Long Context Reasoning and Aggregation Capabilitiescited by 33
- 2024Unveiling the Impact of Coding Data Instruction Fine-Tuning on Large Language Models Reasoningcited by 31
- 2025The Geometry of Reasoning: Flowing Logics in Representation Spacecited by 21
- 2026Memory Matters More: Event-Centric Memory as a Logic Map for Agent Searching and Reasoningcited by 17
- 2025DynamicRAG: Leveraging Outputs of Large Language Model as Feedback for Dynamic Reranking in Retrieval-Augmented Generationcited by 14
- 2025When Refusals Fail: Unstable Safety Mechanisms in Long-Context LLM Agentscited by 13
- 2026AtomMem : Learnable Dynamic Agentic Memory with Atomic Memory Operationcited by 13
- 2025ReSeek: A Self-Correcting Framework for Search Agents with Instructive Rewardscited by 10
- 2025LooGLE v2: Are LLMs Ready for Real World Long Dependency Challenges?cited by 8
- 2025Single-Pass Document Scanning for Question Answeringcited by 6
- 2025Interact-RAG: Reason and Interact with the Corpus, Beyond Black-Box Retrievalcited by 6
- 2024Which Programming Language and What Features at Pre-training Stage Affect Downstream Logical Inference Performance?cited by 5
- 2025On Code-Induced Reasoning in LLMscited by 5
- 2025Code-enabled language models can outperform reasoning models on diverse taskscited by 4
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026SkillFlow:Benchmarking Lifelong Skill Discovery and Evolution for Autonomous Agentscited by 19
- 2026LongMemEval-V2: Evaluating Long-Term Agent Memory Toward Experienced Colleaguescited by 17
- 2026Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editablecited by 12
- 2026PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoningcited by 9
- 2026Rethinking Agentic Search with Pi-Serini: Is Lexical Retrieval Sufficient?cited by 8
- 2026Towards Retrieving Interaction Spaces for Agentic Searchcited by 6
- 2026Recursive Agent Harnessescited by 4
- 2026Mergeable Model-Side Aggregation States for Long-Context Language Modelscited by 1
- 2026When and How Context Rot Appears in Coding Agents: A White-Box Study of Agent Skills in Code Auditingcited by 0
- 2026Hi-Q: Hierarchical Evidence-guided Query Refinement for Multi-Hop Question Answeringcited by 0
- 2026LongHarness Bench: Stress-Testing Language Model Harnesses for Long-Context Reasoningcited by 0
- 2026LongHarness Bench: Stress-Testing Language Model Harnesses for Long-Context Reasoning29 Sep 2026
- 2026Hi-Q: Hierarchical Evidence-guided Query Refinement for Multi-Hop Question Answering31 Aug 2026
- 2026Mergeable Model-Side Aggregation States for Long-Context Language Models29 Jul 2026
- 2026PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning22 Jul 2026
- 2026When and How Context Rot Appears in Coding Agents: A White-Box Study of Agent Skills in Code Auditing20 Jul 2026
- 2026Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editable14 Jul 2026
- 2026Recursive Agent Harnesses11 Jun 2026
- 2026Towards Retrieving Interaction Spaces for Agentic Search5 Jun 2026
- 2026LongMemEval-V2: Evaluating Long-Term Agent Memory Toward Experienced Colleagues12 May 2026
- 2026Rethinking Agentic Search with Pi-Serini: Is Lexical Retrieval Sufficient?11 May 2026
- 2026SkillFlow:Benchmarking Lifelong Skill Discovery and Evolution for Autonomous Agents19 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2024Chain of Agents: Large Language Models Collaborating on Long-Context Tasks
- 2025Graph of Agents: Principled Long Context Modeling by Emergent Multi-Agent Collaboration
- 2025Long Context Scaling: Divide and Conquer via Multi-Agent Question-driven Collaboration
- 2024LongAgent: Scaling Language Models to 128k Context through Multi-Agent Collaboration
- 2025Tree of Agents: Improving Long-Context Capabilities of Large Language Models through Multi-Perspective Reasoning
- 2024GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models
- 2023Walking Down the Memory Maze: Beyond Context Limit through Interactive Reading
- 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception