mlsanityData to 14 Oct 2026

AI-Assisted Requirements Engineering: An Empirical Evaluation Relative to Expert Judgment

arXiv 2604.15222 ↗First posted 16 Apr 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Artificial Intelligence is increasingly introduced into systems engineering activities, particularly within requirements engineering, where quality assessment and validation remain heavily dependent on expert judgment. While recent AI tools demonstrate promising capabilities in analyzing and generating requirements, their role within formal systems engineering processes-and their alignment with established INCOSE criteria-remains insufficiently understood. This paper investigates the extent to which AI-based tools can support systems engineers in evaluating requirement quality, without replacing professional expertise. The research adopts a structured systems engineering methodology to compare AI-assisted requirement evaluation with human expert assessment. A controlled study was conducted in which system requirements were evaluated against established INCOSE ``good requirement'' criteria by both experienced systems engineers and an AI-based assessment tool. The evaluation focused on consistency, completeness, clarity, and testability, examining not only accuracy but also the decision logic underlying each assessment. Results indicate that AI tools can provide consistent and rapid preliminary assessments, particularly for syntactic and structural quality attributes. However, expert judgment remains essential for contextual interpretation, ambiguity resolution, and trade-off reasoning. Rather than positioning AI as a replacement for systems engineers, the findings support its role as a decision-support mechanism within the RE lifecycle. From a systems engineering perspective, this study contributes empirical evidence on how AI can be integrated into RE workflows while preserving traceability, accountability, and engineering consistency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 23 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

7 of 23 references.

References · 7

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 183
  3. 2021Software Engineering for AI-Based Systems: A Surveycited by 69
  4. 2024AI Hallucinations: A Misnomer Worth Clarifyingcited by 34
  5. 2023How many words does ChatGPT know? The answer is ChatWordscited by 6
  6. 2022Management and Detection System for Medical Surgical Equipmentcited by 3
  7. 2022Digital Twin in Safety-Critical Robotics Applications: Opportunities and Challengescited by 1

Built on by

Not cited yet.