Reinforcement Learning Based Query Vertex Ordering Model for Subgraph Matching
Not on the map. Why?
Abstract (arXiv)
Subgraph matching is a fundamental problem in various fields that use graph structured data. Subgraph matching algorithms enumerate all isomorphic embeddings of a query graph q in a data graph G. An important branch of matching algorithms exploit the backtracking search approach which recursively extends intermediate results following a matching order of query vertices. It has been shown that the matching order plays a critical role in time efficiency of these backtracking based subgraph matching algorithms. In recent years, many advanced techniques for query vertex ordering (i.e., matching order generation) have been proposed to reduce the unpromising intermediate results according to the preset heuristic rules. In this paper, for the first time we apply the Reinforcement Learning (RL) and Graph Neural Networks (GNNs) techniques to generate the high-quality matching order for subgraph matching algorithms. Instead of using the fixed heuristics to generate the matching order, our model could capture and make full use of the graph information, and thus determine the query vertex order with the adaptive learning-based rule that could significantly reduces the number of redundant enumerations. With the help of the reinforcement learning framework, our model is able to consider the long-term benefits rather than only consider the local information at current ordering step.Extensive experiments on six real-life data graphs demonstrate that our proposed matching order generation technique could reduce up to two orders of magnitude of query processing time compared to the state-of-the-art algorithms.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 25 of its 63 references that are in the map. First posted on arXiv 25 Jan 2022.
Builds on
25 of 63 references.
References · 25
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 557
- 2017A Brief Survey of Deep Reinforcement Learningcited by 466
- 2018Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generationcited by 363
- 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 313
- 2020Can Graph Neural Networks Count Substructures?cited by 235
13 more
- 2018Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Searchcited by 182
- 2019ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representationscited by 156
- 2017Neural Optimizer Search with Reinforcement Learningcited by 82
- 2018Graph Transformation Policy Network for Chemical Reaction Predictioncited by 56
- 2020Graph Policy Network for Transferable Active Learning on Graphscited by 49
- 2020Neural Subgraph Matchingcited by 47
- 2020Inductive Link Prediction for Nodes Having Only Attribute Informationcited by 30
- 2020GoGNN: Graph of Graphs Neural Network for Predicting Structured Entity Interactionscited by 29
- 2019Neural Subgraph Isomorphism Countingcited by 27
- 2020Binarized Graph Neural Networkcited by 12
- 2019Can Q-Learning with Graph Networks Learn a Generalizable Branching Heuristic for a SAT Solver?cited by 10
- 2018Worst-Case Optimal Join Algorithms: Techniques, Results, and Open Problemscited by 3
- 2021HUGE: An Efficient and Scalable Subgraph Enumeration Systemcited by 3
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 0; 2025: 2; 2026: 1.
6 papers.
- 2025Graph Neural Networks for Databases: A Surveycited by 6
- 2023Intrinsically motivated graph exploration using network theories of human curiositycited by 3
- 2022Detecting Small Query Graphs in A Large Graph via Neural Subgraph Searchcited by 1
- 2022A Survey on Machine Learning Solutions for Graph Pattern Extractioncited by 0
- 2025Neural Graph Navigation for Intelligent Subgraph Matchingcited by 0
- 2026Approximate Subgraph Matching with Neural Graph Representations and Reinforcement Learningcited by 0
- 2026Approximate Subgraph Matching with Neural Graph Representations and Reinforcement Learning18 Mar 2026
- 2025Neural Graph Navigation for Intelligent Subgraph Matching22 Nov 2025
- 2025Graph Neural Networks for Databases: A Survey18 Feb 2025
- 2023Intrinsically motivated graph exploration using network theories of human curiosity11 Jul 2023
- 2022Detecting Small Query Graphs in A Large Graph via Neural Subgraph Search21 Jul 2022
- 2022A Survey on Machine Learning Solutions for Graph Pattern Extraction3 Apr 2022