Towards Learning Abductive Reasoning using VSA Distributed Representations
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
We introduce the Abductive Rule Learner with Context-awareness (ARLC), a model that solves abstract reasoning tasks based on Learn-VRF. ARLC features a novel and more broadly applicable training objective for abductive reasoning, resulting in better interpretability and higher accuracy when solving Raven's progressive matrices (RPM). ARLC allows both programming domain knowledge and learning the rules underlying a data distribution. We evaluate ARLC on the I-RAVEN dataset, showcasing state-of-the-art accuracy across both in-distribution and out-of-distribution (unseen attribute-rule pairs) tests. ARLC surpasses neuro-symbolic and connectionist baselines, including large language models, despite having orders of magnitude fewer parameters. We show ARLC's robustness to post-programming training by incrementally learning from examples on top of programmed knowledge, which only improves its performance and does not result in catastrophic forgetting of the programmed solution. We validate ARLC's seamless transfer learning from a 2x2 RPM constellation to unseen constellations. Our code is available at https://github.com/IBM/abductive-rule-learner-with-context-awareness.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 32 of its 48 references that are in the map. First posted on arXiv 27 Jun 2024.
Builds on
32 of 48 references.
Closest ancestors · 6
Same direction, newest first
- 2024Using Counterfactual Tasks to Evaluate the Generality of Analogical Reasoning in Large Language Models14 Feb
- 2023Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks5 Jul
- 2023Large Language Models Are Not Strong Abstract Reasoners31 May
- 2023In-Context Analogical Reasoning with Pre-Trained Language Models28 May
- 2022Emergent Analogical Reasoning in Large Language Models19 Dec
- 2022Knowledge-based Analogical Reasoning in Neuro-symbolic Latent Spaces19 Sep
Other references · 26
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
- 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 369
- 2018Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understandingcited by 304
- 2020On the Binding Problem in Artificial Neural Networkscited by 230
- 2019RAVEN: A Dataset for Relational and Analogical Visual rEasoNingcited by 225
- 2021Abstraction and Analogy-Making in Artificial Intelligencecited by 103
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformationscited by 98
- 2020Stratified Rule-Aware Network for Abstract Visual Reasoningcited by 72
- 2022A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matricescited by 64
- 2020The Scattering Compositional Learner: Discovering Objects, Attributes, Relationships in Analogical Reasoningcited by 46
14 more
- 2020Scale-Localized Abstract Reasoningcited by 45
- 2021Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Executioncited by 43
- 2020Visual Concept-Metaconcept Learningcited by 39
- 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matricescited by 37
- 2019Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solvingcited by 34
- 2018Learning to Reason with Third-Order Tensor Productscited by 27
- 2022Are Deep Neural Networks SMARTer than Second Graders?cited by 24
- 2022FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual Relationscited by 20
- 2023Abstract Visual Reasoning Enabled by Languagecited by 15
- 2022Evaluating Understanding on Conceptual Abstraction Benchmarkscited by 13
- 2024Probabilistic Abduction for Visual Abstract Reasoning via Learning Rules in Vector-symbolic Architecturescited by 9
- 2018Cognitive Deficit of Deep Learning in Numerositycited by 4
- 2023Factorizers for Distributed Sparse Block Codescited by 4
- 2013Context-Dependent Similaritycited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 3.
9 papers.
- 2024Towards Learning to Reason: Comparing LLMs with Neuro-Symbolic on Arithmetic Relations in Abstract Reasoningcited by 7
- 2025Can Large Reasoning Models do Analogical Reasoning under Perceptual Uncertainty?cited by 5
- 2024Unsupervised Cognitioncited by 2
- 2025Systematic Abductive Reasoning via Diverse Relation Representations in Vector-symbolic Architecturecited by 1
- 2025NSFlow: An End-to-End FPGA Framework with Scalable Dataflow Architecture for Neuro-Symbolic AIcited by 1
- 2025FactorHD: A Hyperdimensional Computing Model for Multi-Object Multi-Class Representation and Factorizationcited by 1
- 2026HypoAgent: An Agentic Framework for Interactive Abductive Hypothesis Generation over Knowledge Graphscited by 0
- 2026Gram-Space: Structure-Preserving Codebook Compression for Memory-Efficient Neuro-Symbolic AIcited by 0
- 2026Think-Verify-Revise: Neuro-Symbolic Visual Reasoning with Vision-Language Models and Dynamic Logic Tensor Networkscited by 0
- 2026Think-Verify-Revise: Neuro-Symbolic Visual Reasoning with Vision-Language Models and Dynamic Logic Tensor Networks4 Sep 2026
- 2026Gram-Space: Structure-Preserving Codebook Compression for Memory-Efficient Neuro-Symbolic AI2 Aug 2026
- 2026HypoAgent: An Agentic Framework for Interactive Abductive Hypothesis Generation over Knowledge Graphs29 May 2026
- 2025FactorHD: A Hyperdimensional Computing Model for Multi-Object Multi-Class Representation and Factorization16 Jul 2025
- 2025NSFlow: An End-to-End FPGA Framework with Scalable Dataflow Architecture for Neuro-Symbolic AI27 Apr 2025
- 2025Can Large Reasoning Models do Analogical Reasoning under Perceptual Uncertainty?14 Mar 2025
- 2025Systematic Abductive Reasoning via Diverse Relation Representations in Vector-symbolic Architecture21 Jan 2025
- 2024Towards Learning to Reason: Comparing LLMs with Neuro-Symbolic on Arithmetic Relations in Abstract Reasoning7 Dec 2024
- 2024Unsupervised Cognition27 Sep 2024
Similar, not cited
Close in wording, no citation either way
- 2025Curriculum Abductive Learning
- 2026CEDAR-GRPO: Process-Aware Reinforcement Learning for General Abductive Reasoning in LLMs
- 2026Wiring the 'Why': A Unified Taxonomy and Survey of Abductive Reasoning in LLMs
- 2023Abductive Commonsense Reasoning Exploiting Mutually Exclusive Explanations
- 2025GEAR: A General Evaluation Framework for Abductive Reasoning
- 2025Consistency-based Abductive Reasoning over Perceptual Errors of Multiple Pre-trained Models in Novel Environments
- 2022AbductionRules: Training Transformers to Explain Unexpected Inputs
- 2026Abductive Reasoning with Probabilistic Commonsense