mlsanityData to 7 Oct 2026

Wiring the 'Why': A Unified Taxonomy and Survey of Abductive Reasoning in LLMs

arXiv 2604.08016 ↗First posted 9 Apr 2026cs.AI cs.LGcited by 5

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Regardless of its foundational role in human discovery and sense-making, abductive reasoning--the inference of the most plausible explanation for an observation--has been relatively underexplored in Large Language Models (LLMs). Despite the rapid advancement of LLMs, the exploration of abductive reasoning and its diverse facets has thus far been disjointed rather than cohesive. This paper presents the first survey of abductive reasoning in LLMs, tracing its trajectory from philosophical foundations to contemporary AI implementations. To address the widespread conceptual confusion and disjointed task definitions prevalent in the field, we establish a unified two-stage definition that formally categorizes prior work. This definition disentangles abduction into Hypothesis Generation, where models bridge epistemic gaps to produce candidate explanations, and Hypothesis Selection, where the generated candidates are evaluated and the most plausible explanation is chosen. Building upon this foundation, we present a comprehensive taxonomy of the literature, categorizing prior work based on their abductive tasks, datasets, underlying methodologies, and evaluation strategies. In order to ground our framework empirically, we conduct a compact benchmark study of current LLMs on abductive tasks, together with targeted comparative analyses across model sizes, model families, evaluation styles, and the distinct generation-versus-selection task typologies. Moreover, by synthesizing recent empirical results, we examine how LLM performance on abductive reasoning relates to deductive and inductive tasks, providing insights into their broader reasoning capabilities. Our analysis reveals critical gaps in current approaches--from static benchmark design and narrow domain coverage to narrow training frameworks and limited mechanistic understanding of abductive processes...

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 72 of its 108 references that are in the map. First posted on arXiv 9 Apr 2026.

Builds on

72 of 108 references.

Closest ancestors · 22

Same direction, newest first

  1. 2026Graph of States: Solving Abductive Tasks with Large Language Models22 Mar
  2. 2026AILS-NTUA at SemEval-2026 Task 12: Graph-Based Retrieval and Reflective Prompting for Abductive Event Reasoning4 Mar
  3. 2026From We to Me: Theory Informed Narrative Shift with Abductive Reasoning10 Feb
  4. 2025From Hypothesis to Premises: LLM-based Backward Logical Reasoning with Selective Symbolic Translation3 Dec
  5. 2025Deductive Logic in Language Models: Horizontal vs Vertical Reasoning10 Oct
  6. 2025GEAR: A General Evaluation Framework for Abductive Reasoning28 Sep
  7. 2025From Reasoning to Learning: A Survey on Hypothesis Discovery and Rule Learning with Large Language Models28 May
  8. 2025Controllable Logical Hypothesis Generation for Abductive Reasoning in Knowledge Graphs27 May
  9. 2025LogiDynamics: Unraveling the Dynamics of Inductive, Abductive and Deductive Logical Inferences in LLM Reasoning16 Feb
  10. 2025WHODUNIT: Evaluation benchmark for culprit detection in mystery stories11 Feb
  11. 2024A Implies B: Circuit Analysis in LLMs for Propositional Logical Reasoning6 Nov
  12. 2024IFAR: Multi-Perspective and Multi-Level Causal Discovery with LLMs9 Sep
10 more
  1. 2024DetectiveQA: Evaluating Long-Context Reasoning on Detective Novels4 Sep
  2. 2024Assessing the Reasoning Capabilities of LLMs in the context of Evidence-based Claim Verification16 Feb
  3. 2023Advancing Abductive Reasoning in Knowledge Graphs through Complex Logical Hypothesis Generation25 Dec
  4. 2023UNcommonsense Reasoning: Abductive Reasoning about Uncommon Situations14 Nov
  5. 2023MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning24 Oct
  6. 2023Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models2 Oct
  7. 2023Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond16 Jun
  8. 2023Abductive Commonsense Reasoning Exploiting Mutually Exclusive Explanations24 May
  9. 2022True Detective: A Deep Abductive Reasoning Benchmark Undoable for GPT-3 and Challenging for GPT-420 Dec
  10. 2022AbductionRules: Training Transformers to Explain Unexpected Inputs23 Mar

Other references · 50

  1. 2023Let's Verify Step by Stepcited by 3,598
  2. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  4. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  5. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  6. 2022In-context Learning and Induction Headscited by 930
  7. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  8. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
  9. 2018e-SNLI: Natural Language Inference with Natural Language Explanationscited by 468
  10. 2020ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Languagecited by 309
  11. 2019Abductive Commonsense Reasoningcited by 300
  12. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 298
38 more
  1. 2020Transformers as Soft Reasoners over Languagecited by 265
  2. 2020Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequencescited by 133
  3. 2024AtP*: An efficient and scalable method for localizing LLM behaviour to componentscited by 100
  4. 2022DDXPlus: A New Dataset For Automatic Medical Diagnosiscited by 87
  5. 2024DebugBench: Evaluating Debugging Capability of Large Language Modelscited by 74
  6. 2020Back to the Future: Unsupervised Backprop-based Decoding for Counterfactual and Abductive Commonsense Reasoningcited by 65
  7. 2024LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Playcited by 65
  8. 2025Steering Large Language Model Activations in Sparse Spacescited by 58
  9. 2022e-CARE: a New Dataset for Exploring Explainable Causal Reasoningcited by 47
  10. 2023Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoningcited by 44
  11. 2022The Abduction of Sherlock Holmes: A Dataset for Visual Abductive Reasoningcited by 38
  12. 2024Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluationcited by 33
  13. 2022Visual Abductive Reasoningcited by 30
  14. 2023Leveraging Medical Knowledge Graphs Into Large Language Models for Diagnosis Prediction: Design and Application Studycited by 29
  15. 2024Doing Experiments and Revising Rules with Natural Language and Probabilistic Reasoningcited by 23
  16. 2023The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Codecited by 21
  17. 2025ER-Reason: A Benchmark Dataset for LLM Clinical Reasoning in the Emergency Roomcited by 21
  18. 2024IDEA: Enhancing the Rule Learning Ability of Large Language Model Agent through Induction, Deduction, and Abductioncited by 20
  19. 2024Reasoning Like a Doctor: Improving Medical Dialogue Systems via Diagnostic Reasoning Process Alignmentcited by 17
  20. 2023How well do SOTA legal reasoning models support abductive reasoning?cited by 13
  21. 2023Self-Consistent Narrative Prompts on Abductive Natural Language Inferencecited by 11
  22. 2025In-situ graph reasoning and knowledge expansion using Graph-PReFLexORcited by 11
  23. 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Modelscited by 11
  24. 2020Social Commonsense Reasoning with Multi-Head Knowledge Attentioncited by 10
  25. 2024Epistemology of Language Models: Do Language Models Have Holistic Knowledge?cited by 9
  26. 2024Black Swan: Abductive and Defeasible Video Reasoning in Unpredictable Eventscited by 9
  27. 2025Abductive Inference in Retrieval-Augmented Language Models: Generating and Validating Missing Premisescited by 9
  28. 2020L2R2: Leveraging Ranking for Abductive Reasoningcited by 8
  29. 2023Active Reasoning in an Open-World Environmentcited by 8
  30. 2025Unifying Deductive and Abductive Reasoning in Knowledge Graphs with Masked Diffusion Modelcited by 8
  31. 2025Evaluating the Logical Reasoning Abilities of Large Reasoning Modelscited by 7
  32. 2020Abduction and Argumentation for Explainable Machine Learning: A Position Surveycited by 6
  33. 2025Beyond Brainstorming: What Drives High-Quality Scientific Ideas? Lessons from Multi-Agent Collaborationcited by 6
  34. 2024Inference to the Best Explanation in Large Language Modelscited by 5
  35. 2025DixitWorld: Evaluating Multimodal Abductive Reasoning in Vision-Language Models with Multi-Agent Dixit Gameplaycited by 4
  36. 2020ExplanationLP: Abductive Reasoning for Explainable Science Question Answeringcited by 3
  37. 2024PARADISE: Evaluating Implicit Planning Skills of Language Models with Procedural Warnings and Tips Datasetcited by 3
  38. 2026AbductiveMLLM: Boosting Visual Abductive Reasoning Within MLLMscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Abductive Reasoning with Syllogistic Forms in Large Language Models
  2. 2026Don't Let Me Ask for It: LLMs Show Deficiencies in Active Multi-Turn Information Acquisition for Abductive Inference
  3. 2025What Kind of Reasoning (if any) is an LLM actually doing? On the Stochastic Nature and Abductive Appearance of Large Language Models
  4. 2026Abductive Reasoning with Probabilistic Commonsense
  5. 2025Do Language Models Follow Occam's Razor? An Evaluation of Parsimony in Inductive and Abductive Reasoning
  6. 2025Abductive Computational Systems: Creative Abduction and Future Directions
  7. 2024An Incomplete Loop: Deductive, Inductive, and Abductive Reasoning in Language Models
  8. 2024Conditional and Modal Reasoning in Large Language Models