mlsanityData to 7 Oct 2026

CORRECT: COndensed eRror RECognition via knowledge Transfer in multi-agent systems

arXiv 2509.24088 ↗First posted 28 Sep 2025cs.MAcited by 14

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Multi-agent systems (MAS) are increasingly capable of tackling complex real-world tasks, yet their reliance on inter-agent coordination, tool use, and long-horizon reasoning makes error recognition particularly challenging. Minor errors can propagate across agents, escalating into task failures while producing long, intertwined execution trajectories that impose significant costs for both human developers and automated systems to debug and analyze. Our key insight is that, despite surface differences in failure trajectories (e.g., logs), MAS errors often recur with similar structural patterns. This paper presents CORRECT, the first lightweight, training-free framework that leverages an online cache of distilled error schemata to recognize and transfer knowledge of failure structures across new requests. This cache-based reuse allows LLMs to perform targeted error localization at inference time, avoiding the need for expensive retraining while adapting to dynamic MAS deployments in subseconds. To support rigorous study in this domain, we also introduce CORRECT-Error, a large-scale dataset of over 2,000 annotated trajectories collected through a novel error-injection pipeline guided by real-world distributions, and further validated through human evaluation to ensure alignment with natural failure patterns. Experiments across seven diverse MAS applications show that CORRECT improves step-level error localization up to 19.8% over existing advances while at near-zero overhead, substantially narrowing the gap between automated and human-level error recognition.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 36 of its 44 references that are in the map. First posted on arXiv 28 Sep 2025.

Builds on

36 of 44 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Who is Introducing the Failure? Automatically Attributing Failures of Multi-Agent Systems via Spectrum Analysis17 Sep
  2. 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems30 Apr
  3. 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
  4. 2025Interactive Debugging and Steering of Multi-Agent AI Systems3 Mar
  5. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
  6. 2023ChatDev: Communicative Agents for Software Development16 Jul

Other references · 30

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  6. 2024Qwen2.5 Technical Reportcited by 4,713
  7. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  8. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  9. 2024GPT-4o System Cardcited by 4,467
  10. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  11. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  12. 2023Let's Verify Step by Stepcited by 3,598
18 more
  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  2. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  3. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  4. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  5. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  6. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  7. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  8. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  9. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
  10. 2023Instruction Tuning with GPT-4cited by 676
  11. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 584
  12. 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 270
  13. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 221
  14. 2025SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoningcited by 80
  15. 2023ReAcTable: Enhancing ReAct for Table Question Answeringcited by 76
  16. 2025Single-agent or Multi-agent Systems? Why Not Both?cited by 28
  17. 2025Step-wise Adaptive Integration of Supervised Fine-tuning and Reinforcement Learning for Task-Specific LLMscited by 25
  18. 2025IC-Cache: Efficient Large Language Model Serving via In-context Cachingcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 12.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systems
  2. 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems
  3. 2026Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Training
  4. 2025Where LLM Agents Fail and How They can Learn From Failures
  5. 2026StepFinder: A Temporal Semantic Framework for Failure Attribution in Multi-Agent Systems
  6. 2025Aegis: Automated Error Generation and Attribution for Multi-Agent Systems
  7. 2026Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systems
  8. 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories