TALM: Dynamic Tree-Structured Multi-Agent Framework with Long-Term Memory for Scalable Code Generation
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Agentic code generation requires large language models (LLMs) capable of complex context management and multi-step reasoning. Prior multi-agent frameworks attempt to address these challenges through collaboration, yet they often suffer from rigid workflows and high reasoning recovery costs. To overcome these limitations, we propose TALM (Tree-Structured Multi-Agent Framework with Long-Term Memory), a dynamic framework that integrates structured task decomposition, localized re-reasoning, and long-term memory mechanisms. TALM employs an extensible tree-based collaboration structure. The parent-child relationships, when combined with a divide-and-conquer strategy, enhance reasoning flexibility and enable efficient error correction across diverse task scopes. Furthermore, a long-term memory module enables semantic querying and integration of prior knowledge, supporting implicit self-improvement through experience reuse. Experimental results on HumanEval, BigCodeBench, and ClassEval benchmarks demonstrate that TALM consistently delivers strong reasoning performance and high token efficiency, highlighting its robustness and practical utility in complex code generation tasks.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 24 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
19 of 24 references.
Closest ancestors · 3
Same direction, newest first
- 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solving18 May
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
- 2023ChatDev: Communicative Agents for Software Development16 Jul
Other references · 16
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2023LooGLE: Can Long-Context Language Models Understand Long Contexts?cited by 202
4 more
- 2023ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generationcited by 168
- 2024Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Modelscited by 152
- 2023Self-planning Code Generation with Large Language Modelscited by 124
- 2024TDAG: A Multi-Agent Framework based on Dynamic Task Decomposition and Agent Generationcited by 51
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Code as Agent Harnesscited by 47
- 2026Graph-based Agent Memory: Taxonomy, Techniques, and Applicationscited by 25
- 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agentscited by 12
- 2026Evaluating Memory Structure in LLM Agentscited by 12
- 2026ReusStdFlow: A Standardized Reusability Framework for Dynamic Workflow Construction in Agentic AIcited by 0
- 2026Code as Agent Harness18 May 2026
- 2026ReusStdFlow: A Standardized Reusability Framework for Dynamic Workflow Construction in Agentic AI16 Feb 2026
- 2026Evaluating Memory Structure in LLM Agents11 Feb 2026
- 2026Graph-based Agent Memory: Taxonomy, Techniques, and Applications5 Feb 2026
- 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agents29 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025MapCoder-Lite: Distilling Multi-Agent Coding into a Single Small LLM
- 2025Guided Code Generation with LLMs: A Multi-Agent Framework for Complex Code Tasks
- 2024Tree-of-Code: A Tree-Structured Exploring Framework for End-to-End Code Generation and Execution in Complex Task Handling
- 2024CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models
- 2025RA-Gen: A Controllable Code Generation Framework Using ReAct for Multi-Agent Task Execution
- 2025Tree of Agents: Improving Long-Context Capabilities of Large Language Models through Multi-Perspective Reasoning
- 2024Self-Organized Agents: A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimization
- 2026Learning What to Retain: Gated-Memory Routing for Efficient Collaboration in Multi-Agent LLM Systems