Graph learning in robotics: a survey
Not on the map. Why?
Abstract (arXiv)
Deep neural networks for graphs have emerged as a powerful tool for learning on complex non-euclidean data, which is becoming increasingly common for a variety of different applications. Yet, although their potential has been widely recognised in the machine learning community, graph learning is largely unexplored for downstream tasks such as robotics applications. To fully unlock their potential, hence, we propose a review of graph neural architectures from a robotics perspective. The paper covers the fundamentals of graph-based models, including their architecture, training procedures, and applications. It also discusses recent advancements and challenges that arise in applied settings, related for example to the integration of perception, decision-making, and control. Finally, the paper provides an extensive review of various robotic applications that benefit from learning on graph structures, such as bodies and contacts modelling, robotic manipulation, action recognition, fleet motion planning, and many more. This survey aims to provide readers with a thorough understanding of the capabilities and limitations of graph neural architectures in robotics, and to highlight potential avenues for future research.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 100 of its 157 references that are in the map. First posted on arXiv 6 Oct 2023.
Builds on
100 of 157 references.
References · 100
- 2017Attention Is All You Needcited by 59,932
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
38 more
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2015Gated Graph Sequence Neural Networkscited by 792
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
- 2019Graph Neural Networks for Social Recommendationcited by 711
- 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
- 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
- 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
- 2017Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphscited by 307
- 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
- 2015Deep Convolutional Networks on Graph-Structured Datacited by 246
- 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
- 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 237
- 2018Human Action Recognition and Prediction: A Surveycited by 226
- 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 219
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Playcited by 214
- 2018Assessing Generalization in Deep Reinforcement Learningcited by 132
- 2020HOPE-Net: A Graph-based Model for Hand-Object Pose Estimationcited by 112
- 2020EGO-TOPO: Environment Affordances from Egocentric Videocited by 111
- 2019A Gentle Introduction to Deep Learning for Graphscited by 107
- 2019Graph Neural Networks for Decentralized Multi-Robot Path Planningcited by 84
- 2019Learning Graph Convolutional Network for Skeleton-based Human Action Recognition by Neural Searchingcited by 70
- 20196-DOF Grasping for Target-driven Object Manipulation in Cluttercited by 70
- 2022RoboCraft: Learning to See, Simulate, and Shape Elasto-Plastic Objects with Graph Networkscited by 69
- 2018Propagation Networks for Model-Based Control Under Partial Observationcited by 64
- 2018MotifNet: a motif-based Graph Convolutional Network for directed graphscited by 63
- 2019Learning Decentralized Controllers for Robot Swarms with Graph Neural Networkscited by 62
- 2021Learning Visible Connectivity Dynamics for Cloth Smoothingcited by 61
- 2019Towards Practical Multi-Object Manipulation using Relational Reinforcement Learningcited by 54
- 2020Differentiable Hierarchical Graph Grouping for Multi-Person Pose Estimationcited by 52
- 2020Deep Imitation Learning for Bimanual Robotic Manipulationcited by 49
- 2021CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulationcited by 49
- 2021Forecasting Action through Contact Representations from First Person Videocited by 46
50 most cited of 100 All 100 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 1.
5 papers.
- 2024A Backpack Full of Skills: Egocentric Video Understanding with Diverse Task Perspectivescited by 9
- 2025Hier-EgoPack: Hierarchical Egocentric Video Understanding with Diverse Task Perspectivescited by 5
- 2024NAR-*ICP: Neural Execution of Classical ICP-based Pointcloud Registration Algorithmscited by 2
- 2025Knowledge Graph Completion for Action Prediction on Situational Graphs -- A Case Study on Household Taskscited by 0
- 2026α-Graph: Attention-Infused Normalizing Flow Approach to Tractable Graph Modelingcited by 0
- 2026α-Graph: Attention-Infused Normalizing Flow Approach to Tractable Graph Modeling7 Sep 2026
- 2025Knowledge Graph Completion for Action Prediction on Situational Graphs -- A Case Study on Household Tasks19 Aug 2025
- 2025Hier-EgoPack: Hierarchical Egocentric Video Understanding with Diverse Task Perspectives4 Feb 2025
- 2024NAR-*ICP: Neural Execution of Classical ICP-based Pointcloud Registration Algorithms14 Oct 2024
- 2024A Backpack Full of Skills: Egocentric Video Understanding with Diverse Task Perspectives5 Mar 2024