Reinforcement learning on graphs: A survey
Not on the map. Why?
Abstract (arXiv)
Graph mining tasks arise from many different application domains, ranging from social networks, transportation to E-commerce, etc., which have been receiving great attention from the theoretical and algorithmic design communities in recent years, and there has been some pioneering work employing the research-rich Reinforcement Learning (RL) techniques to address graph data mining tasks. However, these graph mining methods and RL models are dispersed in different research areas, which makes it hard to compare them. In this survey, we provide a comprehensive overview of RL and graph mining methods and generalize these methods to Graph Reinforcement Learning (GRL) as a unified formulation. We further discuss the applications of GRL methods across various domains and summarize the method descriptions, open-source codes, and benchmark datasets of GRL methods. Furthermore, we propose important directions and challenges to be solved in the future. As far as we know, this is the latest work on a comprehensive survey of GRL, this work provides a global view and a learning resource for scholars. In addition, we create an online open-source for both interested scholars who want to enter this rapidly developing domain and experts who would like to compare GRL methods.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 102 of its 222 references that are in the map. First posted on arXiv 13 Apr 2022.
Builds on
102 of 222 references.
References · 102
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
- 2018Deep Graph Infomaxcited by 1,101
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2016Complex Embeddings for Simple Link Predictioncited by 897
- 2018Link Prediction Based on Graph Neural Networkscited by 829
38 more
- 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 769
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
- 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 734
- 2019Heterogeneous Graph Attention Networkcited by 732
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
- 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 583
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 561
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 557
- 2016Self-critical Sequence Training for Image Captioningcited by 544
- 2017A Brief Survey of Deep Reinforcement Learningcited by 466
- 2015Deep Recurrent Q-Learning for Partially Observable MDPscited by 457
- 2018Data-Efficient Hierarchical Reinforcement Learningcited by 436
- 2020Parameterized Explainer for Graph Neural Networkcited by 423
- 2018Adversarial Attacks on Neural Networks for Graph Datacited by 395
- 2018MolGAN: An implicit generative model for small molecular graphscited by 392
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
- 2016Learning to reinforcement learncited by 369
- 2018Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generationcited by 363
- 2016Benchmarking Deep Reinforcement Learning for Continuous Controlcited by 361
- 2016Learning Multiagent Communication with Backpropagationcited by 355
- 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 328
- 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 312
- 2018Adversarial Attack on Graph Structured Datacited by 300
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
- 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
- 2020Enhancing Graph Neural Network-based Fraud Detectors against Camouflaged Fraudsterscited by 248
- 2020XGNN: Towards Model-Level Explanations of Graph Neural Networkscited by 211
- 2020PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networkscited by 210
- 2018Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agentscited by 189
- 2018Adversarial Attack and Defense on Graph Data: A Surveycited by 166
- 2017Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learningcited by 161
- 2018Graph Convolutional Reinforcement Learningcited by 148
- 2019Causal Discovery with Reinforcement Learningcited by 145
- 2020Backdoor Attacks to Graph Neural Networkscited by 126
- 2018Large-Scale Learnable Graph Convolutional Networkscited by 113
- 2020Graph Backdoorcited by 112
- 2013From Amateurs to Connoisseurs: Modeling the Evolution of User Expertise through Online Reviewscited by 107
- 2018Multi-Hop Knowledge Graph Reasoning with Reward Shapingcited by 102
50 most cited of 102 All 102 (JSON)
Built on by
Citing papers per year: 2023: 4; 2024: 7; 2025: 3; 2026: 4.
18 papers.
Sort:
By area:
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Reviewcited by 20
- 2024The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Modelscited by 15
- 2024Towards Generalizability of Multi-Agent Reinforcement Learning in Graphs with Recurrent Message Passingcited by 8
- 2023Reinforcement Neighborhood Selection for Unsupervised Graph Anomaly Detectioncited by 7
- 2024Graph Reinforcement Learning for Power Grids: A Comprehensive Surveycited by 6
- 2023A Comprehensive Survey on Graph Summarization with Graph Neural Networkscited by 3
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligencecited by 2
- 2023From Images to Connections: Can DQN with GNNs learn the Strategic Game of Hex?cited by 1
- 2025Agentic-KGR: Co-evolutionary Knowledge Graph Construction through Multi-Agent Reinforcement Learningcited by 1
- 2024TARN-VIST: Topic Aware Reinforcement Network for Visual Storytellingcited by 0
- 2024Balanced Edge Pruning for Graph Anomaly Detection with Noisy Labelscited by 0
- 2024Dynamic Weight Adjusting Deep Q-Networks for Real-Time Environmental Adaptationcited by 0
6 more
- 2025Metric spaces of walks and Lipschitz duality on graphscited by 0
- 2025Leveraging Vulnerabilities in Temporal Graph Neural Networks via Strategic High-Impact Assaultscited by 0
- 2026Boosting Deep Reinforcement Learning with Semantic Knowledge for Robotic Manipulatorscited by 0
- 2026EUPHORIA: Efficient Universal Planning via Hybrid Optimization for Robust Industrial Robotic Assemblycited by 0
- 2026Projecting Latent RL Actions: Towards Generalizable and Scalable Graph Combinatorial Optimizationcited by 0
- 2026HiGFRL: Hierarchical Graph Fusion-Driven Reinforcement Learning for Dependency-Aware Task Scheduling in Heterogeneous Cloudcited by 0
- 2026HiGFRL: Hierarchical Graph Fusion-Driven Reinforcement Learning for Dependency-Aware Task Scheduling in Heterogeneous Cloud14 Sep 2026
- 2026Projecting Latent RL Actions: Towards Generalizable and Scalable Graph Combinatorial Optimization19 May 2026
- 2026EUPHORIA: Efficient Universal Planning via Hybrid Optimization for Robust Industrial Robotic Assembly15 May 2026
- 2026Boosting Deep Reinforcement Learning with Semantic Knowledge for Robotic Manipulators23 Jan 2026
- 2025Agentic-KGR: Co-evolutionary Knowledge Graph Construction through Multi-Agent Reinforcement Learning10 Oct 2025
- 2025Leveraging Vulnerabilities in Temporal Graph Neural Networks via Strategic High-Impact Assaults29 Sep 2025
- 2025Metric spaces of walks and Lipschitz duality on graphs27 Aug 2025
- 2024Dynamic Weight Adjusting Deep Q-Networks for Real-Time Environmental Adaptation4 Nov 2024
- 2024Balanced Edge Pruning for Graph Anomaly Detection with Noisy Labels8 Jul 2024
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligence7 Jul 2024
- 2024Graph Reinforcement Learning for Power Grids: A Comprehensive Survey5 Jul 2024
- 2024TARN-VIST: Topic Aware Reinforcement Network for Visual Storytelling18 Mar 2024
6 more
- 2024Towards Generalizability of Multi-Agent Reinforcement Learning in Graphs with Recurrent Message Passing7 Feb 2024
- 2024The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Models2 Feb 2024
- 2023Reinforcement Neighborhood Selection for Unsupervised Graph Anomaly Detection9 Dec 2023
- 2023From Images to Connections: Can DQN with GNNs learn the Strategic Game of Hex?22 Nov 2023
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review11 Mar 2023
- 2023A Comprehensive Survey on Graph Summarization with Graph Neural Networks13 Feb 2023
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Reviewcited by 20
- 2024The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Modelscited by 15
- 2024Towards Generalizability of Multi-Agent Reinforcement Learning in Graphs with Recurrent Message Passingcited by 8
- 2023Reinforcement Neighborhood Selection for Unsupervised Graph Anomaly Detectioncited by 7
- 2024Graph Reinforcement Learning for Power Grids: A Comprehensive Surveycited by 6
- 2023A Comprehensive Survey on Graph Summarization with Graph Neural Networkscited by 3
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligencecited by 2
- 2023From Images to Connections: Can DQN with GNNs learn the Strategic Game of Hex?cited by 1
- 2024TARN-VIST: Topic Aware Reinforcement Network for Visual Storytellingcited by 0
- 2024Balanced Edge Pruning for Graph Anomaly Detection with Noisy Labelscited by 0
- 2024Dynamic Weight Adjusting Deep Q-Networks for Real-Time Environmental Adaptationcited by 0
- 2025Metric spaces of walks and Lipschitz duality on graphscited by 0
12 most cited of 17 All 17 (JSON)
- 2026HiGFRL: Hierarchical Graph Fusion-Driven Reinforcement Learning for Dependency-Aware Task Scheduling in Heterogeneous Cloud14 Sep 2026
- 2026Projecting Latent RL Actions: Towards Generalizable and Scalable Graph Combinatorial Optimization19 May 2026
- 2026EUPHORIA: Efficient Universal Planning via Hybrid Optimization for Robust Industrial Robotic Assembly15 May 2026
- 2026Boosting Deep Reinforcement Learning with Semantic Knowledge for Robotic Manipulators23 Jan 2026
- 2025Leveraging Vulnerabilities in Temporal Graph Neural Networks via Strategic High-Impact Assaults29 Sep 2025
- 2025Metric spaces of walks and Lipschitz duality on graphs27 Aug 2025
- 2024Dynamic Weight Adjusting Deep Q-Networks for Real-Time Environmental Adaptation4 Nov 2024
- 2024Balanced Edge Pruning for Graph Anomaly Detection with Noisy Labels8 Jul 2024
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligence7 Jul 2024
- 2024Graph Reinforcement Learning for Power Grids: A Comprehensive Survey5 Jul 2024
- 2024TARN-VIST: Topic Aware Reinforcement Network for Visual Storytelling18 Mar 2024
- 2024Towards Generalizability of Multi-Agent Reinforcement Learning in Graphs with Recurrent Message Passing7 Feb 2024
12 newest of 17 All 17 (JSON)