mlsanityData to 7 Oct 2026

Structurally Aligned Subtask-Level Memory for Software Engineering Agents

arXiv 2602.21611 ↗First posted 25 Feb 2026cs.SE cs.AIcited by 11

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Large Language Models (LLMs) have demonstrated significant potential as autonomous software engineering (SWE) agents. Recent work has further explored augmenting these agents with memory mechanisms to support long-horizon reasoning. However, these approaches typically operate at a coarse instance granularity, treating the entire problem-solving episode as the atomic unit of storage and retrieval. We empirically demonstrate that instance-level memory suffers from a fundamental granularity mismatch, resulting in misguided retrieval when tasks with similar surface descriptions require distinct reasoning logic at specific stages. To address this, we propose Structurally Aligned Subtask-Level Memory, a method that aligns memory storage, retrieval, and updating with the agent's functional decomposition. Extensive experiments on SWE-bench Verified demonstrate that our method consistently outperforms both vanilla agents and strong instance-level memory baselines across diverse backbones, improving mean Pass@1 over the vanilla agent by +4.7 pp on average (e.g., +6.8 pp on Gemini 2.5 Pro). Performance gains grow with more interaction steps, showing that leveraging past experience benefits long-horizon reasoning in complex software engineering tasks.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 36 of its 48 references that are in the map. First posted on arXiv 25 Feb 2026.

Builds on

36 of 48 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025BOAD: Discovering Hierarchical Software Engineering Agents via Bandit Optimization29 Dec
  2. 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?17 Nov
  3. 2025Unified Software Engineering Agent as AI Software Engineer17 Jun
  4. 2025Code Researcher: Deep Research Agent for Large Systems Code and Commit History27 May
  5. 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement26 Oct
  6. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
  7. 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul
  8. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May

Other references · 28

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2021Program Synthesis with Large Language Modelscited by 3,509
  5. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  6. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  7. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  8. 2021Measuring Coding Challenge Competence With APPScited by 879
  9. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  10. 2023Cognitive Architectures for Language Agentscited by 422
  11. 2023RepoBench: Benchmarking Repository-Level Code Auto-Completion Systemscited by 346
  12. 2025Memory in the Age of AI Agentscited by 285
16 more
  1. 2024AutoCodeRover: Autonomous Program Improvementcited by 272
  2. 2025MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attentioncited by 248
  3. 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 196
  4. 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 165
  5. 2025Context Length Alone Hurts LLM Performance Despite Perfect Retrievalcited by 118
  6. 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behaviorcited by 95
  7. 2024DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositoriescited by 71
  8. 2025SWE-Exp: Experience-Driven Software Issue Resolutioncited by 64
  9. 2025FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementationcited by 57
  10. 2025EXPEREPAIR: Dual-Memory Enhanced LLM-based Repository-Level Program Repaircited by 34
  11. 2024TRAD: Enhancing LLM Agents with Step-Wise Thought Retrieval and Aligned Decisioncited by 23
  12. 2025Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memorycited by 19
  13. 2025Improving Code Localization with Repository Memorycited by 19
  14. 2025SEDM: Scalable Self-Evolving Distributed Memory for Agentscited by 16
  15. 2025SWE-Bench-CL: Continual Learning for Coding Agentscited by 12
  16. 2025Towards Efficient Agents: A Co-Design of Inference Architecture and Systemcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Knowledge to Noise: CTIM-Rover and the Pitfalls of Episodic Memory in Software Engineering Agents
  2. 2026Towards Structured, State-Aware, and Execution-Grounded Reasoning for Software Engineering Agents
  3. 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
  4. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory
  5. 2026Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads
  6. 2026Weighted Memory Tree: Remembering What Matters for Long-Horizon LLM Agents
  7. 2026MemGym: a Long-Horizon Memory Environment for LLM Agents
  8. 2025Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectories