mlsanityData to 7 Oct 2026

Graph learning in robotics: a survey

arXiv 2310.04294 ↗First posted 6 Oct 2023cs.RO cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Deep neural networks for graphs have emerged as a powerful tool for learning on complex non-euclidean data, which is becoming increasingly common for a variety of different applications. Yet, although their potential has been widely recognised in the machine learning community, graph learning is largely unexplored for downstream tasks such as robotics applications. To fully unlock their potential, hence, we propose a review of graph neural architectures from a robotics perspective. The paper covers the fundamentals of graph-based models, including their architecture, training procedures, and applications. It also discusses recent advancements and challenges that arise in applied settings, related for example to the integration of perception, decision-making, and control. Finally, the paper provides an extensive review of various robotic applications that benefit from learning on graph structures, such as bodies and contacts modelling, robotic manipulation, action recognition, fleet motion planning, and many more. This survey aims to provide readers with a thorough understanding of the capabilities and limitations of graph neural architectures in robotics, and to highlight potential avenues for future research.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 100 of its 157 references that are in the map. First posted on arXiv 6 Oct 2023.

Builds on

100 of 157 references.

References · 100

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2018How Powerful are Graph Neural Networks?cited by 4,355
  6. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  7. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  8. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  9. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  10. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  11. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  12. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
38 more
  1. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  2. 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
  3. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  4. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  5. 2015Gated Graph Sequence Neural Networkscited by 792
  6. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
  7. 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
  8. 2019Graph Neural Networks for Social Recommendationcited by 711
  9. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
  10. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
  11. 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
  12. 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
  13. 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
  14. 2017Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphscited by 307
  15. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
  16. 2015Deep Convolutional Networks on Graph-Structured Datacited by 246
  17. 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
  18. 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 237
  19. 2018Human Action Recognition and Prediction: A Surveycited by 226
  20. 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 219
  21. 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Playcited by 214
  22. 2018Assessing Generalization in Deep Reinforcement Learningcited by 132
  23. 2020HOPE-Net: A Graph-based Model for Hand-Object Pose Estimationcited by 112
  24. 2020EGO-TOPO: Environment Affordances from Egocentric Videocited by 111
  25. 2019A Gentle Introduction to Deep Learning for Graphscited by 107
  26. 2019Graph Neural Networks for Decentralized Multi-Robot Path Planningcited by 84
  27. 2019Learning Graph Convolutional Network for Skeleton-based Human Action Recognition by Neural Searchingcited by 70
  28. 20196-DOF Grasping for Target-driven Object Manipulation in Cluttercited by 70
  29. 2022RoboCraft: Learning to See, Simulate, and Shape Elasto-Plastic Objects with Graph Networkscited by 69
  30. 2018Propagation Networks for Model-Based Control Under Partial Observationcited by 64
  31. 2018MotifNet: a motif-based Graph Convolutional Network for directed graphscited by 63
  32. 2019Learning Decentralized Controllers for Robot Swarms with Graph Neural Networkscited by 62
  33. 2021Learning Visible Connectivity Dynamics for Cloth Smoothingcited by 61
  34. 2019Towards Practical Multi-Object Manipulation using Relational Reinforcement Learningcited by 54
  35. 2020Differentiable Hierarchical Graph Grouping for Multi-Person Pose Estimationcited by 52
  36. 2020Deep Imitation Learning for Bimanual Robotic Manipulationcited by 49
  37. 2021CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulationcited by 49
  38. 2021Forecasting Action through Contact Representations from First Person Videocited by 46

50 most cited of 100 All 100 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 1.

5 papers.