mlsanityData to 7 Oct 2026

Presupposition and Reasoning in Conditionals: A Theory-Based Study of Humans and LLMs

arXiv 2605.18352 ↗First posted 18 May 2026cs.CLcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Presupposition projection in conditionals is central to theories of meaning and pragmatics, yet it remains largely unevaluated in large language models. We address this gap through a parallel behavioral study comparing human judgments and LLM predictions on a normed dataset of conditional sentences that controls the relation between the antecedent and the projected presupposition. We collect likelihood ratings from 120 participants and four LLMs under matched contextual conditions. Results show that humans integrate probabilistic and pragmatic cues in their judgment, whereas LLMs show variable alignment with human patterns. Using a linguistically motivated checklist within an LLM-as-a-Judge framework, we further evaluate model reasoning. We observe models that best match human ratings often lack coherent pragmatic reasoning, while models with stronger reasoning produce less human-like judgments. These findings suggest that LLMs' performance on such tasks may result from surface pattern matching rather than pragmatic competence. Our findings highlight the importance of benchmarks grounded in linguistic theory for comparing humans and models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 4 of its 46 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

4 of 46 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025THiNK: Can Large Language Models Think-aloud?26 May

Other references · 3

  1. 2025Let's CONFER: A Dataset for Evaluating Natural Language Inference Models on CONditional InFERence and Presuppositioncited by 3
  2. 2026ClaimDB: A Fact Verification Benchmark over Large Structured Datacited by 3
  3. 2026Do Language Models Know Theo Has a Wife? Investigating the Proviso Problemcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Tracing the ongoing emergence of human-like reasoning in Large Language Models
  2. 2026Evaluation of Deontic Conditional Reasoning in Large Language Models: The Case of Wason's Selection Task
  3. 2025Position: On the Methodological Pitfalls of Evaluating Base LLMs for Reasoning
  4. 2026Reasoning as Pattern Matching: Shared Mechanisms in Human and LLM Everyday Reasoning
  5. 2024Conditional and Modal Reasoning in Large Language Models
  6. 2026Language Statistics and False Belief Reasoning: Evidence from 41 Open-Weight LMs
  7. 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey
  8. 2026Plausibility as Commonsense Reasoning: Humans Succeed, Large Language Models Do not