Code Health in LLM-Based Test Generation: Effectiveness and Token Efficiency
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Coding agents powered by Large Language Models (LLMs) are now prominent in software engineering. Previous work has shown that AI tools perform better on high-quality source code that is easy to maintain. In this study, we investigate how the effectiveness of LLM-generated unit tests varies across maintainability levels measured by CodeScene's CodeHealth (CH). We assess test effectiveness using traditional coverage metrics and mutation score across Python, Java, and C++. Moreover, we study how code with different levels of CH translates into input tokens using common industrial tokenizers. Our results suggest that CH provides a weak but consistent signal of LLM-generated test effectiveness and is negatively correlated with input-token count. These findings provide further evidence for a relationship between maintainability and LLM-based software development.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. First posted on arXiv 19 Aug 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents
- 2025AI-Generated Code Is Not Reproducible (Yet): An Empirical Study of Dependency Gaps in LLM-Based Coding Agents
- 2025Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol
- 2026Tokenomics: Quantifying Where Tokens Are Used in Agentic Software Engineering
- 2024The Potential of LLMs in Automating Software Testing: From Generation to Reporting
- 2025ImpossibleBench: Measuring LLMs' Propensity of Exploiting Test Cases
- 2026TAM-Eval: Evaluating LLMs for Automated Unit Test Maintenance
- 2025Challenges in Testing Large Language Model Based Software: A Faceted Taxonomy