mlsanityData to 14 Oct 2026

A Blueprint for AI-Driven Software Quality: Integrating LLMs with Established Standards

arXiv 2505.13766 ↗First posted 19 May 2025cs.SE cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Software Quality Assurance (SQA) is critical for delivering reliable, secure, and efficient software products. The Software Quality Assurance Process aims to provide assurance that work products and processes comply with predefined provisions and plans. Recent advancements in Large Language Models (LLMs) present new opportunities to enhance existing SQA processes by automating tasks like requirement analysis, code review, test generation, and compliance checks. Simultaneously, established standards such as ISO/IEC 12207, ISO/IEC 25010, ISO/IEC 5055, ISO 9001/ISO/IEC 90003, CMMI, and TMM provide structured frameworks for ensuring robust quality practices. This paper surveys the intersection of LLM-based SQA methods and these recognized standards, highlighting how AI-driven solutions can augment traditional approaches while maintaining compliance and process maturity. We first review the foundational software quality standards and the technical fundamentals of LLMs in software engineering. Next, we explore various LLM-based SQA applications, including requirement validation, defect detection, test generation, and documentation maintenance. We then map these applications to key software quality frameworks, illustrating how LLMs can address specific requirements and metrics within each standard. Empirical case studies and open-source initiatives demonstrate the practical viability of these methods. At the same time, discussions on challenges (e.g., data privacy, model bias, explainability) underscore the need for deliberate governance and auditing. Finally, we propose future directions encompassing adaptive learning, privacy-focused deployments, multimodal analysis, and evolving standards for AI-driven software quality.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 127 of its 253 references that are in the map. First posted on arXiv 19 May 2025.

Builds on

127 of 253 references.

References · 127

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2019Advances and Open Problems in Federated Learningcited by 3,046
  6. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
  7. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  8. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
  9. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
  10. 2017Lifelong Learning with Dynamically Expandable Networkscited by 694
  11. 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 384
  12. 2022A Systematic Evaluation of Large Language Models of Codecited by 363
38 more
  1. 2017DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Carscited by 251
  2. 2024OpenCoder: The Open Cookbook for Top-Tier Code Large Language Modelscited by 130
  3. 2025LlamaFirewall: An open source guardrail system for building secure AI agentscited by 127
  4. 2023Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Studycited by 116
  5. 2024IRIS: LLM-Assisted Static Analysis for Detecting Security Vulnerabilitiescited by 103
  6. 2023LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarkscited by 97
  7. 2024CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environmentscited by 71
  8. 2023ChatGPT Prompt Patterns for Improving Code Quality, Refactoring, Requirements Elicitation, and Software Designcited by 66
  9. 2024(A)I Am Not a Lawyer, But...: Engaging Legal Experts towards Responsible LLM Policies for Legal Advicecited by 63
  10. 2023Understanding the Effectiveness of Large Language Models in Detecting Security Vulnerabilitiescited by 59
  11. 2023How Effective Are Neural Networks for Fixing Security Vulnerabilitiescited by 52
  12. 2023Data-Juicer: A One-Stop Data Processing System for Large Language Modelscited by 52
  13. 2024LLM-Based Test-Driven Interactive Code Generation: User Study and Empirical Evaluationcited by 49
  14. 2024A Performance Study of LLM-Generated Code on Leetcodecited by 49
  15. 2023LLaMA-Reviewer: Advancing Code Review Automation with Large Language Models through Parameter-Efficient Fine-Tuningcited by 47
  16. 2023On the Effectiveness of Large Language Models in Domain-Specific Code Generationcited by 44
  17. 2023A New Era in Software Security: Towards Self-Healing Software via Large Language Models and Formal Verificationcited by 42
  18. 2023Advancing Requirements Engineering through Generative AI: Assessing the Role of LLMscited by 42
  19. 2024Finetuning Large Language Models for Vulnerability Detectioncited by 40
  20. 2024TESTEVAL: Benchmarking Large Language Models for Test Case Generationcited by 40
  21. 2025UXAgent: An LLM Agent-Based Usability Testing Framework for Web Designcited by 40
  22. 2023Large Language Models as Data Preprocessorscited by 34
  23. 2023Using Large Language Models to Generate, Validate, and Apply User Intent Taxonomiescited by 34
  24. 2023Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Modelscited by 28
  25. 2024Search-Based LLMs for Code Optimizationcited by 28
  26. 2024Process Modeling With Large Language Modelscited by 26
  27. 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMscited by 25
  28. 2025Mutation-Guided LLM-based Test Generation at Metacited by 25
  29. 2024COMPL-AI Framework: A Technical Interpretation and LLM Benchmarking Suite for the EU Artificial Intelligence Actcited by 24
  30. 2024Fine-Tuning and Prompt Engineering for Large Language Models-based Code Review Automationcited by 23
  31. 2024Generating Automatic Feedback on UI Mockups with Large Language Modelscited by 23
  32. 2023LLM for SoC Security: A Paradigm Shiftcited by 22
  33. 2024AI-powered Code Review with LLMs: Early Resultscited by 22
  34. 2024A Case Study of LLM for Automated Vulnerability Repair: Assessing Impact of Reasoning and Patch Validation Feedbackcited by 22
  35. 2024Requirements are All You Need: From Requirements to Code with LLMscited by 22
  36. 2024On Evaluating the Efficiency of Source Code Generated by LLMscited by 21
  37. 2024UICrit: Enhancing Automated Design Evaluation with a UICritique Datasetcited by 21
  38. 2023Abstractions, Scenarios, and Prompt Definitions for Process Mining with LLMs: A Case Studycited by 20

50 most cited of 127 All 127 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Iterative Audit Convergence in LLM-Managed Multi-Agent Systems: A Case Study in Prompt-Engineering Quality Assurancecited by 0