mlsanityData to 7 Oct 2026

Towards Learning Abductive Reasoning using VSA Distributed Representations

arXiv 2406.19121 ↗First posted 27 Jun 2024cs.LG cs.AI cs.SCcited by 9

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

We introduce the Abductive Rule Learner with Context-awareness (ARLC), a model that solves abstract reasoning tasks based on Learn-VRF. ARLC features a novel and more broadly applicable training objective for abductive reasoning, resulting in better interpretability and higher accuracy when solving Raven's progressive matrices (RPM). ARLC allows both programming domain knowledge and learning the rules underlying a data distribution. We evaluate ARLC on the I-RAVEN dataset, showcasing state-of-the-art accuracy across both in-distribution and out-of-distribution (unseen attribute-rule pairs) tests. ARLC surpasses neuro-symbolic and connectionist baselines, including large language models, despite having orders of magnitude fewer parameters. We show ARLC's robustness to post-programming training by incrementally learning from examples on top of programmed knowledge, which only improves its performance and does not result in catastrophic forgetting of the programmed solution. We validate ARLC's seamless transfer learning from a 2x2 RPM constellation to unseen constellations. Our code is available at https://github.com/IBM/abductive-rule-learner-with-context-awareness.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 32 of its 48 references that are in the map. First posted on arXiv 27 Jun 2024.

Builds on

32 of 48 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024Using Counterfactual Tasks to Evaluate the Generality of Analogical Reasoning in Large Language Models14 Feb
  2. 2023Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks5 Jul
  3. 2023Large Language Models Are Not Strong Abstract Reasoners31 May
  4. 2023In-Context Analogical Reasoning with Pre-Trained Language Models28 May
  5. 2022Emergent Analogical Reasoning in Large Language Models19 Dec
  6. 2022Knowledge-based Analogical Reasoning in Neuro-symbolic Latent Spaces19 Sep

Other references · 26

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Emergent Abilities of Large Language Modelscited by 2,483
  3. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
  4. 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 369
  5. 2018Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understandingcited by 304
  6. 2020On the Binding Problem in Artificial Neural Networkscited by 230
  7. 2019RAVEN: A Dataset for Relational and Analogical Visual rEasoNingcited by 225
  8. 2021Abstraction and Analogy-Making in Artificial Intelligencecited by 103
  9. 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformationscited by 98
  10. 2020Stratified Rule-Aware Network for Abstract Visual Reasoningcited by 72
  11. 2022A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matricescited by 64
  12. 2020The Scattering Compositional Learner: Discovering Objects, Attributes, Relationships in Analogical Reasoningcited by 46
14 more
  1. 2020Scale-Localized Abstract Reasoningcited by 45
  2. 2021Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Executioncited by 43
  3. 2020Visual Concept-Metaconcept Learningcited by 39
  4. 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matricescited by 37
  5. 2019Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solvingcited by 34
  6. 2018Learning to Reason with Third-Order Tensor Productscited by 27
  7. 2022Are Deep Neural Networks SMARTer than Second Graders?cited by 24
  8. 2022FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual Relationscited by 20
  9. 2023Abstract Visual Reasoning Enabled by Languagecited by 15
  10. 2022Evaluating Understanding on Conceptual Abstraction Benchmarkscited by 13
  11. 2024Probabilistic Abduction for Visual Abstract Reasoning via Learning Rules in Vector-symbolic Architecturescited by 9
  12. 2018Cognitive Deficit of Deep Learning in Numerositycited by 4
  13. 2023Factorizers for Distributed Sparse Block Codescited by 4
  14. 2013Context-Dependent Similaritycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 3.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Curriculum Abductive Learning
  2. 2026CEDAR-GRPO: Process-Aware Reinforcement Learning for General Abductive Reasoning in LLMs
  3. 2026Wiring the 'Why': A Unified Taxonomy and Survey of Abductive Reasoning in LLMs
  4. 2023Abductive Commonsense Reasoning Exploiting Mutually Exclusive Explanations
  5. 2025GEAR: A General Evaluation Framework for Abductive Reasoning
  6. 2025Consistency-based Abductive Reasoning over Perceptual Errors of Multiple Pre-trained Models in Novel Environments
  7. 2022AbductionRules: Training Transformers to Explain Unexpected Inputs
  8. 2026Abductive Reasoning with Probabilistic Commonsense