mlsanityData to 7 Oct 2026

Can ChatGPT Make Explanatory Inferences? Benchmarks for Abductive Reasoning

arXiv 2404.18982 ↗First posted 29 Apr 2024cs.AIcited by 6

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Explanatory inference is the creation and evaluation of hypotheses that provide explanations, and is sometimes known as abduction or abductive inference. Generative AI is a new set of artificial intelligence models based on novel algorithms for generating text, images, and sounds. This paper proposes a set of benchmarks for assessing the ability of AI programs to perform explanatory inference, and uses them to determine the extent to which ChatGPT, a leading generative AI model, is capable of making explanatory inferences. Tests on the benchmarks reveal that ChatGPT performs creative and evaluative inferences in many domains, although it is limited to verbal and visual modalities. Claims that ChatGPT and similar models are incapable of explanation, understanding, causal reasoning, meaning, and creativity are rebutted.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 6 of its 41 references that are in the map. First posted on arXiv 29 Apr 2024.

Builds on

6 of 41 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Emergent Analogical Reasoning in Large Language Models19 Dec

Other references · 5

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  3. 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
  4. 2023A Theory for Emergence of Complex Skills in Language Modelscited by 111
  5. 2023Comparing Machines and Children: Using Developmental Psychology Experiments to Assess the Strengths and Weaknesses of LaMDA Responsescited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 1.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Wiring the 'Why': A Unified Taxonomy and Survey of Abductive Reasoning in LLMs
  2. 2022Explanatory Paradigms in Neural Networks
  3. 2022AbductionRules: Training Transformers to Explain Unexpected Inputs
  4. 2023Advancing Abductive Reasoning in Knowledge Graphs through Complex Logical Hypothesis Generation
  5. 2024ConvoSense: Overcoming Monotonous Commonsense Inferences for Conversational AI
  6. 2025DixitWorld: Evaluating Multimodal Abductive Reasoning in Vision-Language Models with Multi-Agent Dixit Gameplay
  7. 2025GEAR: A General Evaluation Framework for Abductive Reasoning
  8. 2026Abductive Reasoning with Syllogistic Forms in Large Language Models