mlsanityData to 7 Oct 2026

Coding Agents are Effective Long-Context Processors

arXiv 2603.20432 ↗First posted 20 Mar 2026cs.CL cs.AIcited by 11

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large Language Models (LLMs) have demonstrated remarkable progress in scaling to access massive contexts. However, the access is via the latent and uninterpretable attention mechanisms, and LLMs fail to effective process long context, exhibiting significant performance degradation as context length increases. In this work, we study whether long-context processing can be externalized from latent attention into explicit, executable interactions, by allowing coding agents to organize text in file systems and manipulate it using its native tools. We evaluate off-the-shelf frontier coding agents as the general interface for tasks that require processing long contexts, including long-context reasoning, retrieval-augmented generation, and open-domain question answering with large-scale corpus contains up to three trillion tokens. Across multiple benchmarks, these agents outperform published state-of-the-art by 17.3% on average. We attribute this efficacy to two key factors: native tool proficiency, which enables agents to leverage executable code and terminal commands rather than passive semantic queries, and file system familiarity, which allows them to navigate massive text corpora as directory structures. These findings suggest that delegating long-context processing to coding agents offers an effective alternative to semantic search or context window scaling, opening new directions for long-context processing in LLMs.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 47 of its 52 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

47 of 52 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Putting It All into Context: Simplifying Agents with LCLMs12 May

Other references · 46

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  4. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  5. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  6. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  7. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
  8. 2025OpenAI GPT-5 System Cardcited by 910
  9. 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
  10. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  11. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  12. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
34 more
  1. 2024Scaling and evaluating sparse autoencoderscited by 530
  2. 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
  3. 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
  4. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 278
  5. 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 253
  6. 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
  7. 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
  8. 2025Open Problems in Mechanistic Interpretabilitycited by 173
  9. 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
  10. 2025Context Length Alone Hurts LLM Performance Despite Perfect Retrievalcited by 118
  11. 2024Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approachcited by 117
  12. 2023Retrieval meets Long Context Large Language Modelscited by 114
  13. 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 95
  14. 2025Recursive Language Modelscited by 94
  15. 2025Gemini Embedding: Generalizable Embeddings from Geminicited by 93
  16. 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
  17. 2023At Which Training Stage Does Code Data Help LLMs Reasoning?cited by 82
  18. 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scalecited by 61
  19. 2024MASAI: Modular Architecture for Software-engineering AI Agentscited by 49
  20. 2025Chain-of-Retrieval Augmented Generationcited by 48
  21. 2025Oolong: Evaluating Long Context Reasoning and Aggregation Capabilitiescited by 33
  22. 2024Unveiling the Impact of Coding Data Instruction Fine-Tuning on Large Language Models Reasoningcited by 31
  23. 2025The Geometry of Reasoning: Flowing Logics in Representation Spacecited by 21
  24. 2026Memory Matters More: Event-Centric Memory as a Logic Map for Agent Searching and Reasoningcited by 17
  25. 2025DynamicRAG: Leveraging Outputs of Large Language Model as Feedback for Dynamic Reranking in Retrieval-Augmented Generationcited by 14
  26. 2025When Refusals Fail: Unstable Safety Mechanisms in Long-Context LLM Agentscited by 13
  27. 2026AtomMem : Learnable Dynamic Agentic Memory with Atomic Memory Operationcited by 13
  28. 2025ReSeek: A Self-Correcting Framework for Search Agents with Instructive Rewardscited by 10
  29. 2025LooGLE v2: Are LLMs Ready for Real World Long Dependency Challenges?cited by 8
  30. 2025Single-Pass Document Scanning for Question Answeringcited by 6
  31. 2025Interact-RAG: Reason and Interact with the Corpus, Beyond Black-Box Retrievalcited by 6
  32. 2024Which Programming Language and What Features at Pre-training Stage Affect Downstream Logical Inference Performance?cited by 5
  33. 2025On Code-Induced Reasoning in LLMscited by 5
  34. 2025Code-enabled language models can outperform reasoning models on diverse taskscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Chain of Agents: Large Language Models Collaborating on Long-Context Tasks
  2. 2025Graph of Agents: Principled Long Context Modeling by Emergent Multi-Agent Collaboration
  3. 2025Long Context Scaling: Divide and Conquer via Multi-Agent Question-driven Collaboration
  4. 2024LongAgent: Scaling Language Models to 128k Context through Multi-Agent Collaboration
  5. 2025Tree of Agents: Improving Long-Context Capabilities of Large Language Models through Multi-Perspective Reasoning
  6. 2024GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models
  7. 2023Walking Down the Memory Maze: Beyond Context Limit through Interactive Reading
  8. 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception