mlsanityData to 7 Oct 2026

Systematic Abductive Reasoning via Diverse Relation Representations in Vector-symbolic Architecture

arXiv 2501.11896 ↗First posted 21 Jan 2025cs.AIcited by 1

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

In abstract visual reasoning, monolithic deep learning models suffer from limited interpretability and generalization, while existing neuro-symbolic approaches fall short in capturing the diversity and systematicity of attributes and relation representations. To address these challenges, we propose a Systematic Abductive Reasoning model with diverse relation representations (Rel-SAR) in Vector-symbolic Architecture (VSA) to solve Raven's Progressive Matrices (RPM). To derive attribute representations with symbolic reasoning potential, we introduce not only various types of atomic vectors that represent numeric, periodic and logical semantics, but also the structured high-dimentional representation (SHDR) for the overall Grid component. For systematic reasoning, we propose novel numerical and logical relation functions and perform rule abduction and execution in a unified framework that integrates these relation representations. Experimental results demonstrate that Rel-SAR achieves significant improvement on RPM tasks and exhibits robust out-of-distribution generalization. Rel-SAR leverages the synergy between HD attribute representations and symbolic reasoning to achieve systematic abductive reasoning with both interpretable and computable semantics.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 35 of its 52 references that are in the map. First posted on arXiv 21 Jan 2025.

Builds on

35 of 52 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024Funny-Valen-Tine: Planning Solution Distribution Enhances Machine Abstract Reasoning Ability2 Jul
  2. 2024LARS-VSA: A Vector Symbolic Architecture For Learning with Abstract Rules23 May
  3. 2024Probabilistic Abduction for Visual Abstract Reasoning via Learning Rules in Vector-symbolic Architectures29 Jan
  4. 2023Abstracting Concept-Changing Rules for Solving Raven's Progressive Matrix Problems15 Jul
  5. 2023Learning to reason over visual objects3 Mar
  6. 2022Multi-Viewpoint and Multi-Evaluation with Felicitous Inductive Bias Boost Machine Abstract Reasoning Ability26 Oct
  7. 2022Effective Abstract Reasoning with Dual-Contrast Network27 May

Other references · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Object-Centric Learning with Slot Attentioncited by 865
  4. 2017A simple neural network module for relational reasoningcited by 345
  5. 2019RAVEN: A Dataset for Relational and Analogical Visual rEasoNingcited by 225
  6. 2018Measuring abstract reasoning in neural networkscited by 165
  7. 2021Abstraction and Analogy-Making in Artificial Intelligencecited by 103
  8. 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformationscited by 98
  9. 2020Stratified Rule-Aware Network for Abstract Visual Reasoningcited by 72
  10. 2022A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matricescited by 64
  11. 2019Learning Perceptual Inference by Contrastingcited by 57
  12. 2019Learning to Make Analogies by Contrasting Abstract Relational Structurecited by 53
16 more
  1. 2020The Scattering Compositional Learner: Discovering Objects, Attributes, Relationships in Analogical Reasoningcited by 46
  2. 2020Scale-Localized Abstract Reasoningcited by 45
  3. 2021Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Executioncited by 43
  4. 2021Computing on Functions Using Randomized Vector Representationscited by 41
  5. 2020Abstract Diagrammatic Reasoning with Multiplex Graph Networkscited by 37
  6. 2019Abstract Reasoning with Distracting Featurescited by 33
  7. 2021Learning Algebraic Representation for Systematic Generalization in Abstract Reasoningcited by 27
  8. 2022On Neural Architecture Inductive Biases for Relational Taskscited by 26
  9. 2023The Relational Bottleneck as an Inductive Bias for Efficient Abstractioncited by 26
  10. 2020Multi-Label Contrastive Learning for Abstract Visual Reasoningcited by 24
  11. 2020Solving Raven's Progressive Matrices with Multi-Layer Relation Networkscited by 16
  12. 2023Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in Transformerscited by 12
  13. 2023Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matricescited by 9
  14. 2024Towards Learning Abductive Reasoning using VSA Distributed Representationscited by 9
  15. 2024Learning Visual Abstract Reasoning through Dual-Stream Networkscited by 4
  16. 2024RESOLVE: Relational Reasoning with Symbolic and Object-Level Features Using Vector Symbolic Processingcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023A Novel Neural-symbolic System under Statistical Relational Learning
  2. 2024Towards Learning to Reason: Comparing LLMs with Neuro-Symbolic on Arithmetic Relations in Abstract Reasoning
  3. 2024Abductive Symbolic Solver on Abstraction and Reasoning Corpus
  4. 2023The role of object-centric representations, guided attention, and external memory on generalizing visual relations
  5. 2023Systematic Visual Reasoning through Object-Centric Relational Abstraction
  6. 2025Unraveling the geometry of visual relational reasoning
  7. 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matrices
  8. 2024How Far Are We from Intelligent Visual Deductive Reasoning?