Model-Driven Requirements Configuration with Three-Valued Uncertainty Scoring
Not on the map. Why?
Abstract (arXiv)
Context: Large Language Models (LLMs) offer natural-language flexibility for automated requirements elicitation but frequently generate structurally invalid requirements and logical inconsistencies, lacking formal correctness guarantees. Objectives: This study aims to eliminate logical inconsistencies and enforce structural conformance in LLM-generated requirements while quantifying the LLM's pre-validation decision uncertainty within a formal domain model. Methods: We present a neuro-symbolic multi-agent architecture that operationalizes the Object-Oriented Method for Requirements Authoring and Management (OOMRAM) lattice. The LLM acts as a non-deterministic heuristic for lattice traversal, while a deterministic symbolic validator enforces all structural constraints. We introduce a three-valued (T, I, F) -- Truth, Indeterminacy, Falsity -- framework to classify and score the LLM's requirement decisions before and after validation. Results: Evaluated across 37 natural-language project visions in eleven application families, the system completely eliminated structural inconsistencies in 35 out of 37 cases (94.6%), with the remaining two containing only 6 unresolved structural errors (0.39% of decisions) due to iteration limits. Three-valued analysis revealed that 24.7% of all decisions are indeterminate -- structurally valid but discretionary choices not explicitly mandated by the stakeholder. Conclusion: Offloading structural integrity to a deterministic symbolic layer successfully guarantees structural conformance, while the three-valued classification provides a formal way to measure neural uncertainty, facilitating safe LLM deployment in formal requirements engineering.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 35 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
12 of 35 references.
References · 12
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
- 2020Neurosymbolic AI: The 3rd Wavecited by 253
- 2024Reducing hallucination in structured outputs via Retrieval-Augmented Generationcited by 92
- 2024LLM Hallucinations in Practical Code Generation: Phenomena, Mechanism, and Mitigationcited by 92
- 2024De-Hallucinator: Mitigating LLM Hallucinations in Code Generation Tasks via Iterative Groundingcited by 14
- 2025Multi-Agent Debate Strategies to Enhance Requirements Engineering with Large Language Modelscited by 8
- 2025Towards Formal Verification of LLM-Generated Code from Natural Language Promptscited by 8
- 2024Leveraging Graph-RAG and Prompt Engineering to Enhance LLM-Based Automated Requirement Traceability and Compliance Checkscited by 6
- 2025Integrating Symbolic Execution with LLMs for Automated Generation of Program Specificationscited by 4
- 2025LLM-Enhanced Symbolic Control for Safety-Critical Applicationscited by 3
- 2026TraceLLM: Leveraging Large Language Models with Prompt Engineering for Enhanced Requirements Traceabilitycited by 3
Built on by
Not cited yet.