A Survey on What Developers Think About Testing
Not on the map. Why?
Abstract (arXiv)
Software is infamous for its poor quality and frequent occurrence of bugs. While there is no doubt that thorough testing is an appropriate answer to ensure sufficient quality, the poor state of software generally suggests that developers may not always engage as thoroughly with testing as they should. This observation aligns with the prevailing belief that developers simply do not like writing tests. In order to determine the truth of this belief, we conducted a comprehensive survey with 21 questions aimed at (1) assessing developers' current engagement with testing and (2) identifying factors influencing their inclination toward testing; that is, whether they would actually like to test more but are inhibited by their work environment, or whether they would really prefer to test even less if given the choice. Drawing on 284 responses from professional software developers, we uncover reasons that positively and negatively impact developers' motivation to test. Notably, reasons for motivation to write more tests encompass not only a general pursuit of software quality but also personal satisfaction. However, developers nevertheless perceive testing as mundane and tend to prioritize other tasks. One approach emerging from the responses to mitigate these negative factors is by providing better recognition for developers' testing efforts.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 3 Sep 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 3.
4 papers.
- 2024SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agentscited by 133
- 2026SWE-Tester: Training Open-Source LLMs for Issue Reproduction in Real-World Repositoriescited by 4
- 2026Inferring Code Correctness from Specificationcited by 0
- 2026DPIAgent: Divide, Protocol, Isolate for Agentic Reproduction Test Generationcited by 0
- 2026DPIAgent: Divide, Protocol, Isolate for Agentic Reproduction Test Generation24 Aug 2026
- 2026Inferring Code Correctness from Specification28 May 2026
- 2026SWE-Tester: Training Open-Source LLMs for Issue Reproduction in Real-World Repositories20 Jan 2026
- 2024SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents18 Jun 2024