Structural Quality Gaps in Practitioner AI Governance Prompts: An Empirical Study Using a Five-Principle Evaluation Framework
Not on the map. Why?
Abstract (arXiv)
AI governance programmes increasingly rely on natural language prompts to constrain and direct AI agent behaviour. These prompts function as executable specifications: they define the agent's mandate, scope, and quality criteria. Despite this role, no systematic framework exists for evaluating whether a governance prompt is structurally complete. We introduce a five-principle evaluation framework grounded in computability theory, proof theory, and Bayesian epistemology, and apply it to an empirical corpus of 34 publicly available AGENTS.md governance files sourced from GitHub. Our evaluation reveals that 37% of evaluated file-model pairs score below the structural completeness threshold, with data classification and assessment rubric criteria most frequently absent. These results suggest that practitioner-authored governance prompts exhibit consistent structural patterns that automated static analysis could detect and remediate. We discuss implications for requirements engineering practice in AI-assisted development contexts, identify a previously undocumented artefact classification gap in the AGENTS.md convention, and propose directions for tool support.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 7 of its 18 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
7 of 18 references.
References · 7
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2025FASTRIC: Prompt Specification Language for Verifiable LLM Interactionscited by 1
- 2026The Specification as Quality Gate: Three Hypotheses on AI-Assisted Code Reviewcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.