AI-Driven Test Case Generation from Natural Language Requirements: A Survey of Techniques and Research Gaps
Not on the map. Why?
Abstract (arXiv)
Software testing is critical for verifying that systems meet specified requirements, yet remains among the most time-consuming and expensive activities in development. Requirements-based test generation allows test cases to be derived early from requirements artifacts, but generating them directly from natural language is challenging due to inherent ambiguity and imprecision. Recent advances in AI, natural language processing (NLP), and large language models (LLMs) have made automating this pipeline increasingly feasible, while introducing new risks including hallucination, reduced traceability, and inconsistent evaluation. This survey addresses four research questions: what AI and NLP techniques have been proposed for generating test cases from natural language requirements; what tools and frameworks support these approaches; how generated test cases are evaluated; and what research gaps remain. Following Kitchenham and Charters' systematic review guidelines, we searched major scholarly databases spanning 2000-2025 and, after applying strict inclusion criteria, identified 21 primary studies. The literature is organized into three evolutionary eras, revealing that no existing approach simultaneously satisfies six key quality dimensions: automation, ambiguity handling, domain applicability, traceability, evaluation thoroughness, and hallucination control. The survey makes three main contributions: a three-era evolutionary synthesis of AI-based test generation; a six-criteria gap analysis showing no current approach fully addresses all quality dimensions; and four actionable research guidelines targeting hallucination, traceability, complexity sensitivity, and compliance.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 58 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
11 of 58 references.
References · 11
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 329
- 2023Software Testing with Large Language Models: Survey, Landscape, and Visioncited by 163
- 2024Generating Test Scenarios from NL Requirements using Retrieval-Augmented LLMs: An Industrial Studycited by 9
- 2024Enhancing Large Language Models for Text-to-Testcase Generationcited by 7
- 2024PyTester: Deep Reinforcement Learning for Text-to-Testcase Generationcited by 6
- 2025Unlocking the Potential of Generative AI through Neuro-Symbolic Architectures: Benefits and Limitationscited by 6
- 2018NLP-assisted software testing: A systematic mapping of the literaturecited by 4
- 2025Requirements-Based Test Generation: A Comprehensive Surveycited by 4
- 2022Automatic Creation of Acceptance Tests by Extracting Conditionals from Requirements: NLP Approach and Case Studycited by 3
- 2025From Requirements to Test Cases: An NLP-Based Approach for High-Performance ECU Test Case Automationcited by 2
- 2019Seamless Object-Oriented Requirementscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.