mlsanityData to 7 Oct 2026

Less Back-and-Forth: A Comparative Study of Structured Prompting

arXiv 2605.20149 ↗First posted 19 May 2026cs.CL cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are widely used for open-ended tasks, but underspecified prompts can lead to low-quality answers and additional interaction. This paper studies whether structured prompt design improves response quality while reducing user effort. We compare three prompt conditions: a raw prompt, a checklist-improved prompt, and a clarifying-question prompt. We evaluate these conditions across four task types--summarization, planning, explanation, and coding--using three LLM systems: ChatGPT, Claude, and Grok. Each output is scored with a unified rubric covering task completion, correctness, compliance, and clarity. Checklist-improved prompts achieved the highest mean rubric score, 7.50 out of 8, compared with 5.67 for raw prompts and 6.67 for clarifying-question prompts. Checklist prompts also produced the best quality-effort tradeoff, using fewer average tokens than both raw and clarifying prompts. These results suggest that a simple prompt checklist can improve LLM responses while reducing unnecessary interaction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 18 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

10 of 18 references.

References · 10

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  3. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
  4. 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Costcited by 108
  5. 2023EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteriacited by 73
  6. 2023Unleashing the potential of prompt engineering for large language modelscited by 72
  7. 2024What Should We Engineer in Prompts? Training Humans in Requirement-Driven LLM Usecited by 24
  8. 2024Do Advanced Language Models Eliminate the Need for Prompt Engineering in Software Engineering?cited by 19
  9. 2024Exploring Prompt Engineering Practices in the Enterprisecited by 11
  10. 2025Prompt Engineering and the Effectiveness of Large Language Models in Enhancing Human Productivitycited by 2

Built on by

Not cited yet.