Hierarchical Attention-based Graph Neural Network with Relevance-driven Pruning
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) excel at relational reasoning but face two persistent challenges: the lack of interpretable attribution for heterogeneous node types, and the computational overhead of message passing over large, noisy graphs. We propose the Hierarchical Attention-based Heterogeneous GNN (HA-HeteroGNN), a framework that addresses both issues through a unied explainability-to-pruning pipeline. A two-tier attention mechanism separates sensor-level and context-level computation across 16 node types and 18 edge types, producing per-node relevance scores via an attention-based GNN Explainer without requiring gradient backpropagation. These relevance scores then serve as a principled pruning criterion: removing nodes identied as consistently uninformative yields a 27% reduction in graph edges while simultaneously improving classication accuracy by 2.46.1% across all model variants, challenging the conventional assumption that pruning necessarily trades accuracy for eciency. Experiments on a 50,000-record synthetic dataset spanning 11 report categories demonstrate 97.5% cross-strategy explanation stability and domain consistent sensor attribution, with training-time reductions of up to 43.9% and real-time inference latency of approximately 5860 ms per sample.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 38 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
26 of 38 references.
References · 26
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
14 more
- 2019Heterogeneous Graph Attention Networkcited by 732
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
- 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
- 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 583
- 2020Heterogeneous Graph Transformercited by 581
- 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 540
- 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 433
- 2020Parameterized Explainer for Graph Neural Networkcited by 423
- 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
- 2021Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networkscited by 176
- 2020Distilling Knowledge from Graph Convolutional Networkscited by 128
- 2021A Unified Lottery Ticket Hypothesis for Graph Neural Networkscited by 118
- 2021SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networkscited by 108
- 2021Scaling Up Graph Neural Networks Via Graph Coarseningcited by 80
Built on by
Not cited yet.