Technique to Baseline QE Artefact Generation Aligned to Quality Metrics
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are transforming Quality Engineering (QE) by automating the generation of artefacts such as requirements, test cases, and Behavior Driven Development (BDD) scenarios. However, ensuring the quality of these outputs remains a challenge. This paper presents a systematic technique to baseline and evaluate QE artefacts using quantifiable metrics. The approach combines LLM-driven generation, reverse generation , and iterative refinement guided by rubrics technique for clarity, completeness, consistency, and testability. Experimental results across 12 projects show that reverse-generated artefacts can outperform low-quality inputs and maintain high standards when inputs are strong. The framework enables scalable, reliable QE artefact validation, bridging automation with accountability.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 4 of its 7 references that are in the map. First posted on arXiv 18 Nov 2025.
Builds on
4 of 7 references.
References · 4
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2020Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Taskscited by 136
- 2024Automatic Generation of Benchmarks and Reliable LLM Judgment for Code Taskscited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Two Truths and A Lie? Benchmarking Off-the-Shelf LLMs for Requirements Quality Assessment: Performance, False Alarms, and Misses ↗
- 2025LLM-as-a-Judge for Software Engineering: Literature Review, Vision, and the Road Ahead ↗
- 2026QUARE: Quality-Aware Requirements Analysis through Multi-Agent Dialectical Negotiation
- 2026When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications
- 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Data
- 2026Quality Metrics for LLM-Generated Asset Administration Shells: A Perturbation-Based Evaluation Approach
- 2026A Large-Scale Empirical Study of Quality Assurance Practices and Gaps in AI Agents
- 2024Quality Matters: Evaluating Synthetic Data for Tool-Using LLMs