Evaluating 5W3H Structured Prompting for Intent Alignment in Human-AI Interaction
Not on the map. Why?
Abstract (arXiv)
Natural language prompts often suffer from intent transmission loss: the gap between what users actually need and what they communicate to AI systems. We evaluate PPS (Prompt Protocol Specification), a 5W3H-based framework for structured intent representation in human-AI interaction. In a controlled three-condition study across 60 tasks in three domains (business, technical, and travel), three large language models (DeepSeek-V3, Qwen-Max, and Kimi), and three prompt conditions - (A) simple prompts, (B) raw PPS JSON, and (C) natural-language-rendered PPS - we collect 540 AI-generated outputs evaluated by an LLM judge. We introduce goal_alignment, a user-intent-centered evaluation dimension, and find that rendered PPS outperforms both simple prompts and raw JSON on this metric. PPS gains are task-dependent: gains are large in high-ambiguity business analysis tasks but reverse in low-ambiguity travel planning. We also identify a measurement asymmetry in standard LLM evaluation, where unconstrained prompts can inflate constraint adherence scores and mask the practical value of structured prompting. A preliminary retrospective survey (N = 20) further suggests a 66.1% reduction in follow-up prompts required, from 3.33 to 1.13 rounds. These findings suggest that structured intent representations can improve alignment and usability in human-AI interaction, especially in tasks where user intent is inherently ambiguous.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 5 of its 13 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
5 of 13 references.
References · 5
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 606
- 2023Role-Play with Large Language Modelscited by 294
- 2021Reframing Instructional Prompts to GPTk's Languagecited by 176
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 123
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Does Structured Intent Representation Generalize? A Cross-Language, Cross-Model Empirical Study of 5W3H Promptingcited by 3
- 2026Structured Intent as a Protocol-Like Communication Layer: Cross-Model Robustness, Framework Comparison, and the Weak-Model Compensation Effectcited by 2
- 2026Dimension-Level Intent Fidelity Evaluation for Large Language Models: Evidence from Structured Prompt Ablationcited by 1
- 2026Intent Signal Theory: A Computational Framework for Intent-State Control in Human-AI Interactioncited by 0
- 2026Intent Signal Theory: A Computational Framework for Intent-State Control in Human-AI Interaction24 May 2026
- 2026Dimension-Level Intent Fidelity Evaluation for Large Language Models: Evidence from Structured Prompt Ablation14 May 2026
- 2026Structured Intent as a Protocol-Like Communication Layer: Cross-Model Robustness, Framework Comparison, and the Weak-Model Compensation Effect31 Mar 2026
- 2026Does Structured Intent Representation Generalize? A Cross-Language, Cross-Model Empirical Study of 5W3H Prompting26 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2024Beyond Prompts: Learning from Human Communication for Enhanced AI Intent Alignment
- 2025Implicature in Interaction: Understanding Implicature Improves Alignment in Human-LLM Interaction
- 2026Interactive Task Alignment as a POMDP
- 2025What Makes a Good Natural Language Prompt?
- 2025PromptTailor: Multi-turn Intent-Aligned Prompt Synthesis for Lightweight LLMs
- 2026Beyond Oracle Communication: Benchmarking Interactive Intent Alignment Under Miscommunication and Evolving User Intent
- 2025Evaluating AI Alignment in LLMs: Output Analysis of Value Priorities Across 75 Models with Human Benchmarking
- 2025From Literal to Liberal: A Meta-Prompting Framework for Eliciting Human-Aligned Exception Handling in Large Language Models