mlsanityData to 7 Oct 2026

Neural Priority Queues for Graph Neural Networks

arXiv 2307.09660 ↗First posted 18 Jul 2023cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs) have shown considerable success in neural algorithmic reasoning. Many traditional algorithms make use of an explicit memory in the form of a data structure. However, there has been limited exploration on augmenting GNNs with external memory. In this paper, we present Neural Priority Queues, a differentiable analogue to algorithmic priority queues, for GNNs. We propose and motivate a desiderata for memory modules, and show that Neural PQs exhibit the desiderata, and reason about their use with algorithmic reasoning. This is further demonstrated by empirical results on the CLRS-30 dataset. Furthermore, we find the Neural PQs useful in capturing long-range interactions, as empirically shown on a dataset from the Long-Range Graph Benchmark.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 18 of its 21 references that are in the map. First posted on arXiv 18 Jul 2023.

Builds on

18 of 21 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  3. 2021How Attentive are Graph Attention Networks?cited by 818
  4. 2015Gated Graph Sequence Neural Networkscited by 792
  5. 2014Neural Turing Machinescited by 630
  6. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
  7. 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
  8. 2022Long Range Graph Benchmarkcited by 258
  9. 2020Can Graph Neural Networks Count Substructures?cited by 235
  10. 2019What Can Neural Networks Reason About?cited by 155
  11. 2019Neural Execution of Graph Algorithmscited by 118
  12. 2022The CLRS Algorithmic Reasoning Benchmarkcited by 103
6 more
  1. 2021Neural Algorithmic Reasoningcited by 92
  2. 2015Inferring Algorithmic Patterns with Stack-Augmented Recurrent Netscited by 76
  3. 2015Learning to Transduce with Unbounded Memorycited by 54
  4. 2020Pointer Graph Networkscited by 52
  5. 2018Relational inductive bias for physical construction in humans and machinescited by 41
  6. 2021Persistent Message Passingcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 2; 2026: 1.

7 papers.