mlsanityData to 7 Oct 2026

Model-Driven Requirements Configuration with Three-Valued Uncertainty Scoring

arXiv 2607.26220 ↗First posted 28 Jul 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Context: Large Language Models (LLMs) offer natural-language flexibility for automated requirements elicitation but frequently generate structurally invalid requirements and logical inconsistencies, lacking formal correctness guarantees. Objectives: This study aims to eliminate logical inconsistencies and enforce structural conformance in LLM-generated requirements while quantifying the LLM's pre-validation decision uncertainty within a formal domain model. Methods: We present a neuro-symbolic multi-agent architecture that operationalizes the Object-Oriented Method for Requirements Authoring and Management (OOMRAM) lattice. The LLM acts as a non-deterministic heuristic for lattice traversal, while a deterministic symbolic validator enforces all structural constraints. We introduce a three-valued (T, I, F) -- Truth, Indeterminacy, Falsity -- framework to classify and score the LLM's requirement decisions before and after validation. Results: Evaluated across 37 natural-language project visions in eleven application families, the system completely eliminated structural inconsistencies in 35 out of 37 cases (94.6%), with the remaining two containing only 6 unresolved structural errors (0.39% of decisions) due to iteration limits. Three-valued analysis revealed that 24.7% of all decisions are indeterminate -- structurally valid but discretionary choices not explicitly mandated by the stakeholder. Conclusion: Offloading structural integrity to a deterministic symbolic layer successfully guarantees structural conformance, while the three-valued classification provides a formal way to measure neural uncertainty, facilitating safe LLM deployment in formal requirements engineering.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 35 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

12 of 35 references.

References · 12

  1. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  2. 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
  3. 2020Neurosymbolic AI: The 3rd Wavecited by 253
  4. 2024Reducing hallucination in structured outputs via Retrieval-Augmented Generationcited by 92
  5. 2024LLM Hallucinations in Practical Code Generation: Phenomena, Mechanism, and Mitigationcited by 92
  6. 2024De-Hallucinator: Mitigating LLM Hallucinations in Code Generation Tasks via Iterative Groundingcited by 14
  7. 2025Multi-Agent Debate Strategies to Enhance Requirements Engineering with Large Language Modelscited by 8
  8. 2025Towards Formal Verification of LLM-Generated Code from Natural Language Promptscited by 8
  9. 2024Leveraging Graph-RAG and Prompt Engineering to Enhance LLM-Based Automated Requirement Traceability and Compliance Checkscited by 6
  10. 2025Integrating Symbolic Execution with LLMs for Automated Generation of Program Specificationscited by 4
  11. 2025LLM-Enhanced Symbolic Control for Safety-Critical Applicationscited by 3
  12. 2026TraceLLM: Leveraging Large Language Models with Prompt Engineering for Enhanced Requirements Traceabilitycited by 3

Built on by

Not cited yet.