Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matrices
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
We introduce algebraic machine reasoning, a new reasoning framework that is well-suited for abstract reasoning. Effectively, algebraic machine reasoning reduces the difficult process of novel problem-solving to routine algebraic computation. The fundamental algebraic objects of interest are the ideals of some suitably initialized polynomial ring. We shall explain how solving Raven's Progressive Matrices (RPMs) can be realized as computational problems in algebra, which combine various well-known algebraic subroutines that include: Computing the Gr"obner basis of an ideal, checking for ideal containment, etc. Crucially, the additional algebraic structure satisfied by ideals allows for more operations on ideals beyond set-theoretic operations. Our algebraic machine reasoning framework is not only able to select the correct answer from a given answer set, but also able to generate the correct answer with only the question matrix given. Experiments on the I-RAVEN dataset yield an overall 93.2% accuracy, which significantly outperforms the current state-of-the-art accuracy of 77.0% and exceeds human performance at 84.4% accuracy.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 99 references that are in the map. First posted on arXiv 21 Mar 2023.
Builds on
32 of 99 references.
References · 32
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2019Deep Learning for Symbolic Mathematicscited by 270
- 2019RAVEN: A Dataset for Relational and Analogical Visual rEasoNingcited by 226
- 2019SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solvercited by 173
- 2018Measuring abstract reasoning in neural networkscited by 166
- 2020RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphscited by 118
- 2021Abstraction and Analogy-Making in Artificial Intelligencecited by 103
- 2019Are Disentangled Representations Helpful for Abstract Visual Reasoning?cited by 100
- 2018Tropical Geometry of Deep Neural Networkscited by 95
- 2016DeepMath - Deep Sequence Models for Premise Selectioncited by 81
- 2020Stratified Rule-Aware Network for Abstract Visual Reasoningcited by 72
- 2019On the Expressive Power of Deep Polynomial Neural Networkscited by 66
20 more
- 2019Learning Perceptual Inference by Contrastingcited by 57
- 2019Graph Representations for Higher-Order Logic and Theorem Provingcited by 55
- 2020Scale-Localized Abstract Reasoningcited by 45
- 2020INT: An Inequality Benchmark for Evaluating Generalization in Theorem Provingcited by 44
- 2020Learning to Prove Theorems by Learning to Generate Theoremscited by 43
- 2021Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Executioncited by 43
- 2021Why AI is Harder Than We Thinkcited by 41
- 2019Abstract Reasoning with Distracting Featurescited by 33
- 2021Learning Algebraic Representation for Systematic Generalization in Abstract Reasoningcited by 27
- 2022Effective Abstract Reasoning with Dual-Contrast Networkcited by 23
- 2020Few-shot Visual Reasoning with Meta-analogical Contrastive Learningcited by 19
- 2020Solving Raven's Progressive Matrices with Multi-Layer Relation Networkscited by 16
- 2021Learning to Guide a Saturation-Based Theorem Provercited by 15
- 2020Solving Raven's Progressive Matrices with Neural Networkscited by 13
- 2020Generating Correct Answers for Progressive Matrices Intelligence Testscited by 12
- 2021Unsupervised Abstract Reasoning for Raven's Problem Matricescited by 12
- 2021Raven's Progressive Matrices Completion with Latent Gaussian Process Priorscited by 9
- 2020A closer look at the approximation capabilities of neural networkscited by 8
- 2020Prolog Technology Reinforcement Learning Provercited by 7
- 2013Fano schemes of generic intersections and machine learningcited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 2; 2026: 2.
9 papers.
- 2024What is the Visual Cognition Gap between Humans and Multimodal LLMs?cited by 30
- 2026Toward Cognitive Supersensing in Multimodal Large Language Modelcited by 7
- 2023Abstracting Concept-Changing Rules for Solving Raven's Progressive Matrix Problemscited by 6
- 2023A Cognitively-Inspired Neural Architecture for Visual Abstract Reasoning Using Contrastive Perceptual and Conceptual Processingcited by 4
- 2024Sandra -- A Neuro-Symbolic Reasoner Based On Descriptions And Situationscited by 4
- 2024ViTCN: Vision Transformer Contrastive Network For Reasoningcited by 4
- 2025Systematic Abductive Reasoning via Diverse Relation Representations in Vector-symbolic Architecturecited by 1
- 2025GenVP: Generating Visual Puzzles with Contrastive Hierarchical VAEscited by 0
- 2026ChronoVision: Temporal Reasoning via Latent State Reconstructioncited by 0
- 2026ChronoVision: Temporal Reasoning via Latent State Reconstruction6 Aug 2026
- 2026Toward Cognitive Supersensing in Multimodal Large Language Model2 Feb 2026
- 2025GenVP: Generating Visual Puzzles with Contrastive Hierarchical VAEs30 Mar 2025
- 2025Systematic Abductive Reasoning via Diverse Relation Representations in Vector-symbolic Architecture21 Jan 2025
- 2024What is the Visual Cognition Gap between Humans and Multimodal LLMs?14 Jun 2024
- 2024ViTCN: Vision Transformer Contrastive Network For Reasoning15 Mar 2024
- 2024Sandra -- A Neuro-Symbolic Reasoner Based On Descriptions And Situations1 Feb 2024
- 2023A Cognitively-Inspired Neural Architecture for Visual Abstract Reasoning Using Contrastive Perceptual and Conceptual Processing19 Sep 2023
- 2023Abstracting Concept-Changing Rules for Solving Raven's Progressive Matrix Problems15 Jul 2023
Similar, not cited
Close in wording, no citation either way
- 2024Towards Generative Abstract Reasoning: Completing Raven's Progressive Matrix via Rule Abstraction and Selection
- 2025In-Context Algebra
- 2026Rethinking Math Reasoning Evaluation: A Robust LLM-as-a-Judge Framework Beyond Symbolic Rigidity
- 2022Visual-Imagery-Based Analogical Construction in Geometric Matrix Reasoning Task
- 2025Syzygy of Thoughts: Improving LLM CoT with the Minimal Free Resolution
- 2026Moxia: A Trust-First Neuro-Symbolic Execution Architecture for Self-Explaining Mathematical Reasoning
- 2026Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery
- 2024Towards Learning to Reason: Comparing LLMs with Neuro-Symbolic on Arithmetic Relations in Abstract Reasoning