mlsanityData to 14 Oct 2026

Program Synthesis using Inductive Logic Programming for the Abstraction and Reasoning Corpus

arXiv 2405.06399 ↗First posted 10 May 2024cs.LG cs.AI cs.PLcited by 4

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

The Abstraction and Reasoning Corpus (ARC) is a general artificial intelligence benchmark that is currently unsolvable by any Machine Learning method, including Large Language Models (LLMs). It demands strong generalization and reasoning capabilities which are known to be weaknesses of Neural Network based systems. In this work, we propose a Program Synthesis system that uses Inductive Logic Programming (ILP), a branch of Symbolic AI, to solve ARC. We have manually defined a simple Domain Specific Language (DSL) that corresponds to a small set of object-centric abstractions relevant to ARC. This is the Background Knowledge used by ILP to create Logic Programs that provide reasoning capabilities to our system. The full system is capable of generalize to unseen tasks, since ILP can create Logic Program(s) from few examples, in the case of ARC: pairs of Input-Output grids examples for each task. These Logic Programs are able to generate Objects present in the Output grid and the combination of these can form a complete program that transforms an Input grid into an Output grid. We randomly chose some tasks from ARC that dont require more than the small number of the Object primitives we implemented and show that given only these, our system can solve tasks that require each, such different reasoning.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 46 references that are in the map. First posted on arXiv 10 May 2024.

Builds on

22 of 46 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024CodeIt: Self-Improving Language Models with Prioritized Hindsight Replay7 Feb
  2. 2024Neural networks for abstraction and reasoning: Towards broad generalization in machines5 Feb
  3. 2023Assessing GPT4-V on Structured Reasoning Tasks13 Dec
  4. 2023Comparing Humans, GPT-4, and GPT-4V On Abstraction and Reasoning Tasks14 Nov
  5. 2023LLMs and the Abstraction and Reasoning Corpus: Successes, Failures, and the Importance of Object-based Representations26 May

Other references · 17

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  3. 2023A Comprehensive Overview of Large Language Modelscited by 648
  4. 2023Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Taskscited by 246
  5. 2018Deep Learning: A Critical Appraisalcited by 217
  6. 2023Evaluating Large Language Models: A Comprehensive Surveycited by 202
  7. 2023Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solvecited by 178
  8. 2021OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalizationcited by 86
  9. 2021Inductive logic programming at 30cited by 47
  10. 2021Communicating Natural Programs to Humans and Machinescited by 35
  11. 2021Fast and flexible: Human program induction in abstract reasoning taskscited by 33
  12. 2022Graphs, Constraints, and Search for the Abstraction and Reasoning Corpuscited by 32
5 more
  1. 2024Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpuscited by 32
  2. 2021Neural-guided, Bidirectional Program Search for Abstraction and Reasoningcited by 23
  3. 2022Fifty Years of Prolog and Beyondcited by 15
  4. 2024Generalized Planning for the Abstraction and Reasoning Corpuscited by 10
  5. 2023A Divide-Align-Conquer Strategy for Program Synthesiscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Hypothesis Generation via LLM-Automated Language Bias for ILP
  2. 2023Hypothesis Search: Inductive Reasoning with Language Models
  3. 2024Combining Induction and Transduction for Abstract Reasoning
  4. 2024Abductive Symbolic Solver on Abstraction and Reasoning Corpus
  5. 2025NSA: Neuro-symbolic ARC Challenge
  6. 2025Symbolic Snapshot Ensembles
  7. 2025From Reasoning to Generalization: Knowledge-Augmented LLMs for ARC Benchmark
  8. 2025Honey, I shrunk the hypothesis space (through logical preprocessing)