The Rise of Agentic Testing: Multi-Agent Systems for Robust Software Quality Assurance
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Software testing has progressed toward intelligent automation, yet current AI-based test generators still suffer from static, single-shot outputs that frequently produce invalid, redundant, or non-executable tests due to the lack of execution aware feedback. This paper introduces an agentic multi-model testing framework a closed-loop, self-correcting system in which a Test Generation Agent, an Execution and Analysis Agent, and a Review and Optimization Agent collaboratively generate, execute, analyze, and refine tests until convergence. By using sandboxed execution, detailed failure reporting, and iterative regeneration or patching of failing tests, the framework autonomously improves test quality and expands coverage. Integrated into a CI/CD-compatible pipeline, it leverages reinforcement signals from coverage metrics and execution outcomes to guide refinement. Empirical evaluations on microservice based applications show up to a 60% reduction in invalid tests, 30% coverage improvement, and significantly reduced human effort compared to single-model baselines demonstrating that multi-agent, feedback-driven loops can evolve software testing into an autonomous, continuously learning quality assurance ecosystem for self-healing, high-reliability codebases.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 1 of its 27 references that are in the map. First posted on arXiv 5 Jan 2026.
Builds on
1 of 27 references.
References · 1
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026AINTMA: Agentic AI Architecture for Autonomous Test Management with Generative Intelligence, Secure Cloud Communication and Adaptive Quality Analytics
- 2025Agentic RAG for Software Testing with Hybrid Vector-Graph and Multi-Agent Orchestration
- 2026Beyond Test Presence: Assessing the Quality and Robustness of Agent-Generated Tests in Open-Source Projects
- 2026Beyond Component Testing: Validating Agentic AI Systems
- 2025Agentic Program Repair from Test Failures at Scale: A Neuro-symbolic approach with static analysis and test execution feedback
- 2026Practical Limits of Autonomous Test Repair: A Multi-Agent Case Study with LLM-Driven Discovery and Self-Correction
- 2026Grounding AI Agents in Contracts: An Empirical Evaluation of Spec-Driven Test Generation
- 2026AI Assurance: A Comprehensive Testing Strategy for Enterprise AI Systems