mlsanityData to 14 Oct 2026

Evaluating Memory Condensation Strategies for Coding Agents in Data-Driven Scientific Discovery

arXiv 2605.18854 ↗First posted 13 May 2026cs.LGcited by 1

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Coding agents accumulate extensive context during long-running tasks, yet fixed context windows force practitioners to choose between truncation and task failure. While numerous memory condensation strategies have been proposed, from simple sliding windows to LLM-generated summaries, no systematic comparison exists to guide strategy selection, especially in scientific discovery tasks. We evaluate eight memory condensation strategies using GPT-4o on sixty DiscoveryBench tasks spanning six scientific domains (480 total evaluations). We find that no condenser significantly alters hypothesis quality, while LLM-based condensers increase token costs by 24-94 percent, and masking tool-call outputs achieves an 8.6 percent net savings. We also observe that the optimal condenser for data-driven scientific discovery varies by scientific domain and task length.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 21 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

15 of 21 references.

References · 15

  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  2. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  3. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
  4. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  5. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
  6. 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 237
  7. 2025A Survey of Context Engineering for Large Language Modelscited by 126
  8. 2023Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memorycited by 64
  9. 2025CostBench: Evaluating Multi-Turn Cost-Optimal Planning and Adaptation in Dynamic Environments for LLM Tool-Use Agentscited by 33
  10. 2026Don't Break the Cache: An Evaluation of Prompt Caching for Long-Horizon Agentic Taskscited by 19
  11. 2025Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compressioncited by 16
  12. 2026AgentLongBench: A Controllable Long Benchmark For Long-Contexts Agents via Environment Rolloutscited by 9
3 more
  1. 2025Towards a Standard, Enterprise-Relevant Agentic AI Benchmark: Lessons from 5.5 billion tokens' worth of agentic AI evaluationscited by 3
  2. 2026Cost and Accuracy of Long-Term Memory in Distributed Multi-Agent Systems Based on Large Language Modelscited by 2
  3. 2026MemoryRewardBench: Benchmarking Reward Models for Long-Term Memory Management in Large Language Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentDiscover: Autonomous Discovery with Minimal Search Scaffolding
  2. 2026Scaling Discovery Requires Forgetting
  3. 2026SciNav: A General Agent Framework for Scientific Coding Tasks
  4. 2026ProjectionBench: Evaluating Scientific Hypothesis Generation in LLMs Under Progressive Information Disclosure
  5. 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics
  6. 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
  7. 2026NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers?
  8. 2026Memory Is Not Always Needed: Characterizing Conditional Memory in Scientific Reasoning