mlsanityData to 7 Oct 2026

Hierarchical Attention-based Graph Neural Network with Relevance-driven Pruning

arXiv 2605.09308 ↗First posted 10 May 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs) excel at relational reasoning but face two persistent challenges: the lack of interpretable attribution for heterogeneous node types, and the computational overhead of message passing over large, noisy graphs. We propose the Hierarchical Attention-based Heterogeneous GNN (HA-HeteroGNN), a framework that addresses both issues through a unied explainability-to-pruning pipeline. A two-tier attention mechanism separates sensor-level and context-level computation across 16 node types and 18 edge types, producing per-node relevance scores via an attention-based GNN Explainer without requiring gradient backpropagation. These relevance scores then serve as a principled pruning criterion: removing nodes identied as consistently uninformative yields a 27% reduction in graph edges while simultaneously improving classication accuracy by 2.46.1% across all model variants, challenging the conventional assumption that pruning necessarily trades accuracy for eciency. Experiments on a 50,000-record synthetic dataset spanning 11 report categories demonstrate 97.5% cross-strategy explanation stability and domain consistent sensor attribution, with training-time reductions of up to 43.9% and real-time inference latency of approximately 5860 ms per sample.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 38 references that are in the map. First posted on arXiv 10 May 2026.

Builds on

26 of 38 references.

References · 26

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  5. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  6. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  7. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  8. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
  9. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  10. 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
  11. 2021How Attentive are Graph Attention Networks?cited by 818
  12. 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
14 more
  1. 2019Heterogeneous Graph Attention Networkcited by 732
  2. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
  3. 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
  4. 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 583
  5. 2020Heterogeneous Graph Transformercited by 581
  6. 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 540
  7. 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 433
  8. 2020Parameterized Explainer for Graph Neural Networkcited by 423
  9. 2021On Explainability of Graph Neural Networks via Subgraph Explorationscited by 280
  10. 2021Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networkscited by 176
  11. 2020Distilling Knowledge from Graph Convolutional Networkscited by 128
  12. 2021A Unified Lottery Ticket Hypothesis for Graph Neural Networkscited by 118
  13. 2021SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networkscited by 108
  14. 2021Scaling Up Graph Neural Networks Via Graph Coarseningcited by 80

Built on by

Not cited yet.