ConCovUp: Effective Agent-Based Test Driver Generation for Concurrency Testing
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Concurrency testing is essential to improve the reliability and security of multi-threaded programs. Dynamic analysis tools, such as TSan, depend on high-quality test drivers that reach critical shared-memory interactions at runtime. However, current testing practices predominantly focus on sequential logic, leaving a gap in automated concurrent test generation. Recently, large language models (LLMs) have shown promise in generating sequential tests, but they struggle to produce effective concurrent tests without a deep understanding of concurrency semantics. This paper presents ConCovUp, a multi-agent framework that combines LLMs with program analysis. ConCovUp grounds test generation in static analysis to extract shared memory accesses and their calling contexts. To trigger hard-to-reach accesses, it introduces an LLM-driven backward tracing approach, leveraging the model's semantic reasoning to deduce concrete inputs that satisfy complex path constraints, and iteratively refines the generated tests via dynamic execution feedback. Our evaluation on nine real-world C/C++ libraries shows that ConCovUp improves average Shared Memory Access Pair Coverage (SMAP Coverage) from 36.6% to 68.1% over the general Claude Code agent baseline.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 42 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
9 of 42 references.
References · 9
- 2023ChatUniTest: A Framework for LLM-Based Test Generationcited by 94
- 2024HITS: High-coverage LLM-based Unit Test Generation via Method Slicingcited by 37
- 2024CoverUp: Effective High Coverage Test Generation for Pythoncited by 36
- 2024ASTER: Natural and Multi-language Unit Test Generation with LLMscited by 9
- 2025Validating Network Protocol Parsers with Traceable RFC Document Interpretationcited by 7
- 2023Beware of the Unexpected: Bimodal Taint Analysiscited by 5
- 2025Fray: An Efficient General-Purpose Concurrency Testing Platform for the JVM (Extended Version)cited by 1
- 2025Efficient Timestamping for Sampling-based Race Detectioncited by 1
- 2025Dynamic Race Detection With O(1) Samplescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025HPCAgentTester: A Multi-Agent LLM Approach for Enhanced HPC Unit Test Generation
- 2026Hybrid Concolic Testing with Large Language Models for Guided Path Exploration
- 2026VibeCheck: Assessing the Quality of LLM-Generated Unit Tests: A Multi-agent Empirical Study across Heterogeneous Repositories
- 2026Verified Detection and Prevention of Concurrency Anomalies in Multi-Agent Large Language Model Systems
- 2026LiveFMBench: Unveiling the Power and Limits of Agentic Workflows in Specification Generation
- 2025LLM4VV: Evaluating Cutting-Edge LLMs for Generation and Evaluation of Directive-Based Parallel Programming Model Compiler Tests ↗
- 2026Rethinking Code Performance Benchmarks for LLMs
- 2026ConFL: Explainable Concurrent Fault Localization via Hierarchy-Guided LLM Reasoning