mlsanityData to 7 Oct 2026

Experiential Co-Learning of Software-Developing Agents

arXiv 2312.17025 ↗First posted 28 Dec 2023cs.CL cs.AI cs.LGcited by 57

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Recent advancements in large language models (LLMs) have brought significant changes to various domains, especially through LLM-driven autonomous agents. A representative scenario is in software development, where LLM agents demonstrate efficient collaboration, task division, and assurance of software quality, markedly reducing the need for manual involvement. However, these agents frequently perform a variety of tasks independently, without benefiting from past experiences, which leads to repeated mistakes and inefficient attempts in multi-step task execution. To this end, we introduce Experiential Co-Learning, a novel LLM-agent learning framework in which instructor and assistant agents gather shortcut-oriented experiences from their historical trajectories and use these past experiences for future task execution. The extensive experiments demonstrate that the framework enables agents to tackle unseen software-developing tasks more effectively. We anticipate that our insights will guide LLM agents towards enhanced autonomy and contribute to their evolutionary growth in cooperative learning. The code and data are available at https://github.com/OpenBMB/ChatDev.

Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 43 of its 62 references that are in the map. First posted on arXiv 28 Dec 2023.

Builds on

43 of 62 references.

Closest ancestors · 7

Same direction, newest first

  1. 2023Agents: An Open-source Framework for Autonomous Language Agents14 Sep
  2. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  3. 2023ExpeL: LLM Agents Are Experiential Learners20 Aug
  4. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate14 Aug
  5. 2023BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents11 Aug
  6. 2023TPTU: Large Language Model-based AI Agents for Task Planning and Tool Usage7 Aug
  7. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  7. 2020Scaling Laws for Neural Language Modelscited by 6,411
  8. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  9. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  10. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  11. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  12. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
24 more
  1. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  2. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  3. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  4. 2023Large Language Models are not Fair Evaluatorscited by 1,050
  5. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  6. 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
  7. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 347
  8. 2023Large Language Models are Effective Text Rankers with Pairwise Ranking Promptingcited by 302
  9. 2023Large Language Models as Tool Makerscited by 293
  10. 2023Role-Play with Large Language Modelscited by 290
  11. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
  12. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
  13. 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 226
  14. 2023Large Language Models as General Pattern Machinescited by 196
  15. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 195
  16. 2023LM vs LM: Detecting Factual Errors via Cross Examinationcited by 155
  17. 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Warscited by 143
  18. 2023Avalon's Game of Thoughts: Battle Against Deception through Recursive Contemplationcited by 102
  19. 2023MetaAgents: Large Language Model Based Agents for Decision-Making on Teamingcited by 85
  20. 2023Humanoid Agents: Platform for Simulating Human-like Generative Agentscited by 73
  21. 2023LASER: LLM Agent with State-Space Exploration for Web Navigationcited by 66
  22. 2023GameGPT: Multi-agent Collaborative Framework for Game Developmentcited by 41
  23. 2017Agile Software Development Methods: Review and Analysiscited by 18
  24. 2023DesignGPT: Multi-Agent Collaboration in Designcited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 29; 2025: 19; 2026: 9.

57 papers.

Sort:

By area:

  1. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
  2. 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 291
  3. 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 235
  4. 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 173
  5. 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
  6. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
  7. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  8. 2024Small LLMs Are Weak Tool Learners: A Multi-LLM Agentcited by 92
  9. 2024Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligencecited by 80
  10. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 76
  11. 2024Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulationcited by 69
  12. 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 64
38 more
  1. 2025SWE-Exp: Experience-Driven Software Issue Resolutioncited by 64
  2. 2024Learning to Use Tools via Cooperative and Interactive Agentscited by 54
  3. 2025A Survey on the Optimization of Large Language Model-based Agentscited by 45
  4. 2024Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Studycited by 40
  5. 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent Systemcited by 40
  6. 2025TxGemma: Efficient and Agentic LLMs for Therapeuticscited by 40
  7. 2024VillagerAgent: A Graph-Based Multi-Agent Framework for Coordinating Complex Task Dependencies in Minecraftcited by 34
  8. 2024Benchmarking Data Science Agentscited by 30
  9. 2024Multi-Agent Collaboration via Cross-Team Orchestrationcited by 30
  10. 2024LAMBDA: A Large Model Based Data Agentcited by 30
  11. 2025MDTeamGPT: A Self-Evolving LLM-based Multi-Agent Framework for Multi-Disciplinary Team Medical Consultationcited by 25
  12. 2024Hierarchical Auto-Organizing System for Open-Ended Multi-Agent Navigationcited by 24
  13. 2024Reinforcement Learning from Multi-role Debates as Feedback for Bias Mitigation in LLMscited by 22
  14. 2024Do We Really Need a Complex Agent System? Distill Embodied Agent into a Single Modelcited by 19
  15. 2025Improving Code Localization with Repository Memorycited by 19
  16. 2025Attack the Messages, Not the Agents: A Multi-round Adaptive Stealthy Tampering Framework for LLM-MAScited by 17
  17. 2024Iterative Experience Refinement of Software-Developing Agentscited by 16
  18. 2024Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineeringcited by 16
  19. 2025Coarse-to-Fine Grounded Memory for LLM Agent Planningcited by 16
  20. 2024Autonomous Agents for Collaborative Task under Information Asymmetrycited by 15
  21. 2025SAMULE: Self-Learning Agents Enhanced by Multi-level Reflectioncited by 15
  22. 2024MobA: Multifaceted Memory-Enhanced Adaptive Planning for Efficient Mobile Task Automationcited by 14
  23. 2024Preemptive Detection and Correction of Misaligned Actions in LLM Agentscited by 9
  24. 2025Stochastic Self-Organization in Multi-Agent Systemscited by 9
  25. 2024MindScope: Exploring cognitive biases in large language models through Multi-Agent Systemscited by 5
  26. 2024Multi-Party Supervised Fine-tuning of Language Models for Multi-Party Dialogue Generationcited by 5
  27. 2025Document Intelligence in the Era of Large Language Models: A Surveycited by 5
  28. 2024StarWhisper Telescope: An AI framework for automating end-to-end astronomical observationscited by 4
  29. 2025Cross-Task Experiential Learning on LLM-based Multi-Agent Collaborationcited by 4
  30. 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectivescited by 4
  31. 2026Your Code Agent Can Grow Alongside You with Structured Memorycited by 4
  32. 2024BMW Agents -- A Framework For Task Automation Through Multi-Agent Collaborationcited by 3
  33. 2025Co-Saving: Resource Aware Multi-Agent Collaboration for Software Developmentcited by 3
  34. 2026Solvita: Enhancing Large Language Models for Competitive Programming via Agentic Evolutioncited by 3
  35. 2026LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Reviewcited by 2
  36. 2024Think-on-Process: Dynamic Process Generation for Collaborative Development of Multi-Agent Systemcited by 1
  37. 2024Concept Matching with Agent for Out-of-Distribution Detectioncited by 0
  38. 2024Improving Performance of Commercially Available AI Products in a Multi-Agent Configurationcited by 0

50 most cited of 57 All 57 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Agents in Software Engineering: Survey, Landscape, and Vision
  2. 2026Experiential Reflective Learning for Self-Improving LLM Agents
  3. 2024Empowering Large Language Model Agents through Action Learning
  4. 2026Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report
  5. 2024CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technology
  6. 2026Unified Context Evolution for LLM Agents
  7. 2024Kolb-Based Experiential Learning for Generalist Agents with Human-Level Kaggle Data Science Performance
  8. 2025Multi-Agent Language Models: Advancing Cooperation, Coordination, and Adaptation