Gate the Filter, Not the Message: Node-Channel Mixtures for Pre-Propagation GNNs
Not on the map. Why?
Abstract (arXiv)
Pre-propagation graph neural networks (PPGNNs) push all graph-dependent computation into a preprocessing step and train only on the resulting dense hop features, which makes them highly scalable. A puzzle in this regime is that more complex hop aggregators do not reliably outperform simpler ones: on many benchmarks, a plain MLP-based aggregator matches or beats hop-attention variants. We revisit this behavior from a graph-filter perspective. Over a precomputed diffusion basis, existing PPGNNs differ mainly in how filter coefficients are shared across nodes and feature channels, rather than simply in raw aggregator capacity. MLP-based architectures learn channel-dependent filters that are largely shared across nodes, while hop-attention-based architectures learn node-dependent mixtures that are largely shared across channels. This reveals a missing regime in standard PPGNN designs: joint node- and channel-adaptive filtering under the pre-propagation computational contract. We propose FilterMoE, a mixture-of-experts PPGNN in which a small bank of learnable Chebyshev filter experts is routed jointly over nodes and channels by a 3D gating tensor. Across eleven homophilic and heterophilic benchmarks, FilterMoE outperforms strong PPGNN baselines on nine datasets and ranks first on all three large-scale benchmarks, improving the average test score by 1.53 points. These results establish joint node-channel filter routing as a robust alternative to dataset-specific hop-aggregator selection.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 40 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
32 of 40 references.
References · 32
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
20 more
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 592
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 332
- 2020SIGN: Scalable Inception Graph Neural Networkscited by 283
- 2015Diffusion-Convolutional Neural Networkscited by 268
- 2020Scaling Graph Neural Networks with Approximate PageRankcited by 174
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2022Revisiting Heterophily For Graph Neural Networkscited by 169
- 2022Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisitedcited by 87
- 2022Graph Attention Multi-Layer Perceptroncited by 82
- 2023Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modelingcited by 63
- 2021Scalable and Adaptive Graph Neural Networks with Self-Label-Enhanced trainingcited by 54
- 2021AdaGNN: Graph Neural Networks with Adaptive Frequency Response Filtercited by 43
- 2022Improving Graph Neural Networks with Learnable Propagation Operatorscited by 19
- 2022Node-oriented Spectral Filtering for Graph Neural Networkscited by 17
- 2024Node-wise Filtering in Graph Neural Networks: A Mixture of Experts Approachcited by 17
- 2020Adaptive Graph Diffusion Networkscited by 13
- 2023Graph Neural Networks with Diverse Spectral Filteringcited by 9
- 2021Node-Variant Graph Filters in Graph Neural Networkscited by 7
- 2024Mixture of Experts Meets Decoupled Message Passing: Towards General and Adaptive Node Classificationcited by 4
- 2025Graph Learning at Scale: Characterizing and Optimizing Pre-Propagation GNNscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Accelerating Scalable Graph Neural Network Inference with Node-Adaptive Propagation
- 2023Recurrent Distance Filtering for Graph Representation Learning
- 2024Diffusing to the Top: Boost Graph Neural Networks with Minimal Hyperparameter Tuning
- 2024Sparse Decomposition of Graph Neural Networks
- 2026Generative Diffusion Models of Stochastic Graph Signals
- 2026Generalizing GNNs with Tokenized Mixture of Experts
- 2025ReDiSC: A Reparameterized Masked Diffusion Model for Scalable Node Classification with Structured Predictions
- 2026HOPPER: Learnable Hop Extraction for Linearized Graph Sequence Models