mlsanityData to 14 Oct 2026

Prompt Architecture Determines Reasoning Quality: A Variable Isolation Study on the Car Wash Problem

arXiv 2602.21814 ↗First posted 25 Feb 2026cs.AI cs.CLcited by 3

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

Abstract (arXiv)

Large language models consistently fail the "car wash problem," a viral reasoning benchmark requiring implicit physical constraint inference. We present a variable isolation study (n=20 per condition, 6 conditions, 120 total trials) examining which prompt architecture layers in a production system enable correct reasoning. Using Claude 3.5 Sonnet with controlled hyperparameters (temperature 0.7, top_p 1.0), we find that the STAR (Situation-Task-Action-Result) reasoning framework alone raises accuracy from 0% to 85% (p=0.001, Fisher's exact test, odds ratio 13.22). Adding user profile context via vector database retrieval provides a further 10 percentage point gain, while RAG context contributes an additional 5 percentage points, achieving 100% accuracy in the full-stack condition. These results suggest that structured reasoning scaffolds -- specifically, forced goal articulation before inference -- matter substantially more than context injection for implicit constraint reasoning tasks.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 4 of its 7 references that are in the map. First posted on arXiv 25 Feb 2026.

Builds on

4 of 7 references.

Closest ancestors · 2

Same direction, newest first

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan

Other references · 2

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Batched Contextual Reinforcement: A Task-Scaling Law for Efficient Reasoning
  2. 2025Attentive Reasoning Queries: A Systematic Method for Optimizing Instruction-Following in Large Language Models
  3. 2026Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning
  4. 2026Think Through a Bottleneck: Hourglass Reasoning for Rigorous Induction
  5. 2024A NotSo Simple Way to Beat Simple Bench
  6. 2023ART: Automatic multi-step reasoning and tool-use for large language models
  7. 2025BRAID: Bounded Reasoning for Autonomous Inference and Decisions
  8. 2026Compliance vs. Sensibility: On the Reasoning Controllability in Large Language Models