Agent4cs: A Multi-agent System for Code Summarization in Large Hierarchical Codebases
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Understanding large, complex codebases, especially those with obfuscated structures and incomplete documentation, remains a significant challenge. Existing code summarization solutions often rely on a single language model or coding assistant like Claude Code, and treat source code as flat text, underutilizing the rich interdependencies and hierarchical information within a repository. To address these shortcomings, we propose Agent4cs - a multi-agent framework that summarizes large codebases in a bottom-up fashion, where a summarization agent focuses on producing robust summaries; a keyword-extraction agent proactively identifies critical information from subfolders; and a quality-assurance agent iteratively refines the outputs for readability, coherence, and completeness. Evaluated on 7 frontier models, Agent4cs improves semantic consistency across all folder levels by average 8% compared to two structured prompting baselines with code segments. Furthermore, extensive evaluation on real-world datasets demonstrates up to 38% gains in normalized keyword coverage rate over the same baselines.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 33 of its 55 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
33 of 55 references.
Closest ancestors · 1
Same direction, newest first
Other references · 32
- 2017Attention Is All You Needcited by 59,932
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2025Qwen3 Technical Reportcited by 8,195
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Gemma 3 Technical Reportcited by 1,686
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
- 2020A Transformer-based Approach for Source Code Summarizationcited by 129
20 more
- 2022Few-shot training LLMs for project-specific code-summarizationcited by 128
- 2018Improving Automatic Source Code Summarization via Deep Reinforcement Learningcited by 99
- 2020Retrieval-Augmented Generation for Code Summarization via Hybrid GNNcited by 89
- 2020Improved Code Summarization via a Graph Neural Networkcited by 79
- 2023Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization)cited by 72
- 2021On the Evaluation of Neural Code Summarizationcited by 47
- 2023Automatic Code Summarization via ChatGPT: How Far Are We?cited by 34
- 2023Distilled GPT for Source Code Summarizationcited by 30
- 2024CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding?cited by 29
- 2023Evaluating Code Summarization Techniques: A New Metric and an Empirical Characterizationcited by 21
- 2024Analyzing the Performance of Large Language Models on Code Summarizationcited by 19
- 2025On the Effectiveness of LLM-as-a-judge for Code Generation and Summarizationcited by 17
- 2022An Extractive-and-Abstractive Framework for Source Code Summarizationcited by 15
- 2024Can Large Language Models Serve as Evaluators for Code Summarization?cited by 12
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarizationcited by 6
- 2024FsPONER: Few-shot Prompt Optimization for Named Entity Recognition in Domain-specific Scenarioscited by 6
- 2025Hierarchical Repository-Level Code Summarization for Business Applications Using Local LLMscited by 6
- 2025Bridging the Prototype-Production Gap: A Multi-Agent System for Notebooks Transformationcited by 6
- 2023Abstract Syntax Tree for Programming Language Understanding and Representation: How Far Are We?cited by 5
- 2025Code-Craft: Hierarchical Graph-Based Code Summarization for Enhanced Context Retrievalcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025CodeVisionary: An Agent-based Framework for Evaluating Large Language Models in Code Generation
- 2023AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation
- 2024Self-Organized Agents: A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimization
- 2026Agent Retrieval Bench: Evaluating Repository Context Retrieval for Coding Agents
- 2026CORE-Bench: A Comprehensive Benchmark for Code Retrieval in the Era of Agentic Coding
- 2026Code Broker: A Multi-Agent System for Automated Code Quality Assessment
- 2025DocAgent: A Multi-Agent System for Automated Code Documentation Generation
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges