Neural Priority Queues for Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) have shown considerable success in neural algorithmic reasoning. Many traditional algorithms make use of an explicit memory in the form of a data structure. However, there has been limited exploration on augmenting GNNs with external memory. In this paper, we present Neural Priority Queues, a differentiable analogue to algorithmic priority queues, for GNNs. We propose and motivate a desiderata for memory modules, and show that Neural PQs exhibit the desiderata, and reason about their use with algorithmic reasoning. This is further demonstrated by empirical results on the CLRS-30 dataset. Furthermore, we find the Neural PQs useful in capturing long-range interactions, as empirically shown on a dataset from the Long-Range Graph Benchmark.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 18 of its 21 references that are in the map. First posted on arXiv 18 Jul 2023.
Builds on
18 of 21 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2015Gated Graph Sequence Neural Networkscited by 792
- 2014Neural Turing Machinescited by 630
- 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
- 2022Long Range Graph Benchmarkcited by 258
- 2020Can Graph Neural Networks Count Substructures?cited by 235
- 2019What Can Neural Networks Reason About?cited by 155
- 2019Neural Execution of Graph Algorithmscited by 118
- 2022The CLRS Algorithmic Reasoning Benchmarkcited by 103
6 more
- 2021Neural Algorithmic Reasoningcited by 92
- 2015Inferring Algorithmic Patterns with Stack-Augmented Recurrent Netscited by 76
- 2015Learning to Transduce with Unbounded Memorycited by 54
- 2020Pointer Graph Networkscited by 52
- 2018Relational inductive bias for physical construction in humans and machinescited by 41
- 2021Persistent Message Passingcited by 13
Built on by
Citing papers per year: 2024: 4; 2025: 2; 2026: 1.
7 papers.
- 2024Discrete Neural Algorithmic Reasoningcited by 8
- 2024Benchmarking ChatGPT on Algorithmic Reasoningcited by 8
- 2025Primal-Dual Neural Algorithmic Reasoningcited by 8
- 2024Open-Book Neural Algorithmic Reasoningcited by 2
- 2024A Context-Enhanced Framework for Sequential Graph Reasoningcited by 1
- 2025KNARsack: Teaching Neural Algorithmic Reasoners to Solve Pseudo-Polynomial Problemscited by 0
- 2026Richer Representations for Neural Algorithmic Reasoning via Auxiliary Reconstructioncited by 0
- 2026Richer Representations for Neural Algorithmic Reasoning via Auxiliary Reconstruction30 May 2026
- 2025KNARsack: Teaching Neural Algorithmic Reasoners to Solve Pseudo-Polynomial Problems17 Sep 2025
- 2025Primal-Dual Neural Algorithmic Reasoning29 May 2025
- 2024Open-Book Neural Algorithmic Reasoning30 Dec 2024
- 2024A Context-Enhanced Framework for Sequential Graph Reasoning12 Dec 2024
- 2024Benchmarking ChatGPT on Algorithmic Reasoning4 Apr 2024
- 2024Discrete Neural Algorithmic Reasoning18 Feb 2024