Relational inductive bias for physical construction in humans and machines
Not on the map. Why?
Abstract (arXiv)
While current deep learning systems excel at tasks such as object classification, language processing, and gameplay, few can construct or modify a complex system such as a tower of blocks. We hypothesize that what these systems lack is a "relational inductive bias": a capacity for reasoning about inter-object relations and making choices over a structured description of a scene. To test this hypothesis, we focus on a task that involves gluing pairs of blocks together to stabilize a tower, and quantify how well humans perform. We then introduce a deep reinforcement learning agent which uses object- and relation-centric scene and policy representations and apply it to the task. Our results show that these structured representations allow the agent to outperform both humans and more naive approaches, suggesting that relational inductive bias is an important component in solving structured reasoning problems and for building more intelligent, flexible machines.
Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 5; 2023: 8; 2024: 12; 2025: 4; 2026: 4.
44 papers.
Sort:
By area:
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
- 2021ETA Prediction with Graph Neural Networks in Google Mapscited by 130
- 2022The CLRS Algorithmic Reasoning Benchmarkcited by 106
- 2021Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapescited by 71
- 2021Learning Visible Connectivity Dynamics for Cloth Smoothingcited by 62
- 2022A Generalist Neural Algorithmic Learnercited by 59
- 2024CANOS: A Fast and Scalable Neural AC-OPF Solver Robust To N-1 Perturbationscited by 27
- 2023Dual Algorithmic Reasoningcited by 21
- 2021Brick-by-Brick: Combinatorial Construction with Deep Reinforcement Learningcited by 19
- 2023Neural Algorithmic Reasoning for Combinatorial Optimisationcited by 19
- 2021Large-scale graph representation learning with very deep GNNs and self-supervisioncited by 18
- 2023Neural Relational Inference with Fast Modular Meta-learningcited by 16
32 more
- 2024Graph Reinforcement Learning for Combinatorial Optimization: A Survey and Unifying Perspectivecited by 16
- 2021Persistent Message Passingcited by 13
- 2021Reasoning-Modulated Representationscited by 13
- 2023Asynchronous Algorithmic Alignment with Cocyclescited by 13
- 2021Algorithmic Concept-based Explainable Reasoningcited by 12
- 2021Active Learning of Abstract Plan Feasibilitycited by 11
- 2023Constraining Generative Models for Engineering Design with Negative Datacited by 11
- 2024On the Markov Property of Neural Algorithmic Reasoning: Analyses and Methodscited by 11
- 2024Discrete Neural Algorithmic Reasoningcited by 9
- 2025Primal-Dual Neural Algorithmic Reasoningcited by 9
- 2023Neural Priority Queues for Graph Neural Networkscited by 7
- 2025Automated Cyber Defense with Generalizable Graph-based Reinforcement Learning Agentscited by 7
- 2024Deep Equilibrium Algorithmic Reasoningcited by 6
- 2023Feudal Graph Reinforcement Learningcited by 4
- 2024Reconstructing short-lived particles using hypergraph representation learningcited by 4
- 2022Compositional Law Parsing with Latent Random Functionscited by 3
- 2024Open-Book Neural Algorithmic Reasoningcited by 3
- 2024NAR-*ICP: Neural Execution of Classical ICP-based Pointcloud Registration Algorithmscited by 2
- 2024Neural Symbolic Regression of Complex Network Dynamicscited by 2
- 2022Learning heuristics for A*cited by 1
- 2022Solving Reasoning Tasks with a Slot Transformercited by 1
- 2023Self Attention with Temporal Prior: Can We Learn More from Arrow of Time?cited by 1
- 2024The Deep Equilibrium Algorithmic Reasonercited by 1
- 2021Relational Weight Priors in Neural Networks for Abstract Pattern Learning and Language Modellingcited by 0
- 2024LightningNet: Distributed Graph-based Cellular Network Performance Forecasting for the Edgecited by 0
- 2024Algorithm-Informed Graph Neural Networks for Leakage Detection and Localization in Water Distribution Networkscited by 0
- 2025Graph Neural Network-Based Predictive Modeling for Robotic Plaster Printingcited by 0
- 2025Tackling GNARLy Problems: Graph Neural Algorithmic Reasoning Reimagined through Reinforcement Learningcited by 0
- 2026Predictive Representations for Skill Transfer in Reinforcement Learningcited by 0
- 2026Enabling Structure-Only Initialization and Out-of-Distribution Generalization in GNN-based Molecular Dynamics Simulatorscited by 0
- 2026Relational Structural Causal Modelscited by 0
- 2026Neural Algorithmic Reasoning for Graph Saddle Point Problemscited by 0
- 2026Neural Algorithmic Reasoning for Graph Saddle Point Problems5 Oct 2026
- 2026Relational Structural Causal Models12 Jun 2026
- 2026Enabling Structure-Only Initialization and Out-of-Distribution Generalization in GNN-based Molecular Dynamics Simulators10 May 2026
- 2026Predictive Representations for Skill Transfer in Reinforcement Learning8 Apr 2026
- 2025Tackling GNARLy Problems: Graph Neural Algorithmic Reasoning Reimagined through Reinforcement Learning23 Sep 2025
- 2025Automated Cyber Defense with Generalizable Graph-based Reinforcement Learning Agents19 Sep 2025
- 2025Primal-Dual Neural Algorithmic Reasoning29 May 2025
- 2025Graph Neural Network-Based Predictive Modeling for Robotic Plaster Printing31 Mar 2025
- 2024Open-Book Neural Algorithmic Reasoning30 Dec 2024
- 2024Deep Equilibrium Algorithmic Reasoning19 Oct 2024
- 2024Neural Symbolic Regression of Complex Network Dynamics15 Oct 2024
- 2024NAR-*ICP: Neural Execution of Classical ICP-based Pointcloud Registration Algorithms14 Oct 2024
32 more
- 2024Algorithm-Informed Graph Neural Networks for Leakage Detection and Localization in Water Distribution Networks5 Aug 2024
- 2024Graph Reinforcement Learning for Combinatorial Optimization: A Survey and Unifying Perspective9 Apr 2024
- 2024CANOS: A Fast and Scalable Neural AC-OPF Solver Robust To N-1 Perturbations26 Mar 2024
- 2024On the Markov Property of Neural Algorithmic Reasoning: Analyses and Methods7 Mar 2024
- 2024Discrete Neural Algorithmic Reasoning18 Feb 2024
- 2024Reconstructing short-lived particles using hypergraph representation learning15 Feb 2024
- 2024The Deep Equilibrium Algorithmic Reasoner9 Feb 2024
- 2024LightningNet: Distributed Graph-based Cellular Network Performance Forecasting for the Edge8 Feb 2024
- 2023Self Attention with Temporal Prior: Can We Learn More from Arrow of Time?29 Oct 2023
- 2023Neural Relational Inference with Fast Modular Meta-learning10 Oct 2023
- 2023Neural Priority Queues for Graph Neural Networks18 Jul 2023
- 2023Asynchronous Algorithmic Alignment with Cocycles27 Jun 2023
- 2023Constraining Generative Models for Engineering Design with Negative Data27 Jun 2023
- 2023Neural Algorithmic Reasoning for Combinatorial Optimisation18 May 2023
- 2023Feudal Graph Reinforcement Learning11 Apr 2023
- 2023Dual Algorithmic Reasoning9 Feb 2023
- 2022Solving Reasoning Tasks with a Slot Transformer20 Oct 2022
- 2022A Generalist Neural Algorithmic Learner22 Sep 2022
- 2022Compositional Law Parsing with Latent Random Functions15 Sep 2022
- 2022The CLRS Algorithmic Reasoning Benchmark31 May 2022
- 2022Learning heuristics for A*11 Apr 2022
- 2021Brick-by-Brick: Combinatorial Construction with Deep Reinforcement Learning29 Oct 2021
- 2021Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapes12 Oct 2021
- 2021ETA Prediction with Graph Neural Networks in Google Maps25 Aug 2021
- 2021Large-scale graph representation learning with very deep GNNs and self-supervision20 Jul 2021
- 2021Reasoning-Modulated Representations19 Jul 2021
- 2021Algorithmic Concept-based Explainable Reasoning15 Jul 2021
- 2021Active Learning of Abstract Plan Feasibility1 Jul 2021
- 2021Learning Visible Connectivity Dynamics for Cloth Smoothing21 May 2021
- 2021Relational Weight Priors in Neural Networks for Abstract Pattern Learning and Language Modelling10 Mar 2021
- 2021Persistent Message Passing1 Mar 2021
- 2021Combinatorial optimization and reasoning with graph neural networks18 Feb 2021
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
- 2021ETA Prediction with Graph Neural Networks in Google Mapscited by 130
- 2022The CLRS Algorithmic Reasoning Benchmarkcited by 106
- 2021Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapescited by 71
- 2021Learning Visible Connectivity Dynamics for Cloth Smoothingcited by 62
- 2022A Generalist Neural Algorithmic Learnercited by 59
- 2024CANOS: A Fast and Scalable Neural AC-OPF Solver Robust To N-1 Perturbationscited by 27
- 2023Dual Algorithmic Reasoningcited by 21
- 2021Brick-by-Brick: Combinatorial Construction with Deep Reinforcement Learningcited by 19
- 2023Neural Algorithmic Reasoning for Combinatorial Optimisationcited by 19
- 2021Large-scale graph representation learning with very deep GNNs and self-supervisioncited by 18
- 2023Neural Relational Inference with Fast Modular Meta-learningcited by 16
12 most cited of 41 All 41 (JSON)
- 2026Neural Algorithmic Reasoning for Graph Saddle Point Problems5 Oct 2026
- 2026Relational Structural Causal Models12 Jun 2026
- 2026Enabling Structure-Only Initialization and Out-of-Distribution Generalization in GNN-based Molecular Dynamics Simulators10 May 2026
- 2025Tackling GNARLy Problems: Graph Neural Algorithmic Reasoning Reimagined through Reinforcement Learning23 Sep 2025
- 2025Primal-Dual Neural Algorithmic Reasoning29 May 2025
- 2025Graph Neural Network-Based Predictive Modeling for Robotic Plaster Printing31 Mar 2025
- 2024Open-Book Neural Algorithmic Reasoning30 Dec 2024
- 2024Deep Equilibrium Algorithmic Reasoning19 Oct 2024
- 2024Neural Symbolic Regression of Complex Network Dynamics15 Oct 2024
- 2024NAR-*ICP: Neural Execution of Classical ICP-based Pointcloud Registration Algorithms14 Oct 2024
- 2024Algorithm-Informed Graph Neural Networks for Leakage Detection and Localization in Water Distribution Networks5 Aug 2024
- 2024CANOS: A Fast and Scalable Neural AC-OPF Solver Robust To N-1 Perturbations26 Mar 2024
12 newest of 41 All 41 (JSON)