mlsanityData to 7 Oct 2026

Gate the Filter, Not the Message: Node-Channel Mixtures for Pre-Propagation GNNs

arXiv 2606.01660 ↗First posted 1 Jun 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Pre-propagation graph neural networks (PPGNNs) push all graph-dependent computation into a preprocessing step and train only on the resulting dense hop features, which makes them highly scalable. A puzzle in this regime is that more complex hop aggregators do not reliably outperform simpler ones: on many benchmarks, a plain MLP-based aggregator matches or beats hop-attention variants. We revisit this behavior from a graph-filter perspective. Over a precomputed diffusion basis, existing PPGNNs differ mainly in how filter coefficients are shared across nodes and feature channels, rather than simply in raw aggregator capacity. MLP-based architectures learn channel-dependent filters that are largely shared across nodes, while hop-attention-based architectures learn node-dependent mixtures that are largely shared across channels. This reveals a missing regime in standard PPGNN designs: joint node- and channel-adaptive filtering under the pre-propagation computational contract. We propose FilterMoE, a mixture-of-experts PPGNN in which a small bank of learnable Chebyshev filter experts is routed jointly over nodes and channels by a 3D gating tensor. Across eleven homophilic and heterophilic benchmarks, FilterMoE outperforms strong PPGNN baselines on nine datasets and ranks first on all three large-scale benchmarks, improving the average test score by 1.53 points. These results establish joint node-channel filter routing as a robust alternative to dataset-specific hop-aggregator selection.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 40 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

32 of 40 references.

References · 32

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  5. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  6. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  7. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  8. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
  9. 2019Simplifying Graph Convolutional Networkscited by 1,470
  10. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  11. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
  12. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
20 more
  1. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 592
  2. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 332
  3. 2020SIGN: Scalable Inception Graph Neural Networkscited by 283
  4. 2015Diffusion-Convolutional Neural Networkscited by 268
  5. 2020Scaling Graph Neural Networks with Approximate PageRankcited by 174
  6. 2022How Powerful are Spectral Graph Neural Networkscited by 169
  7. 2022Revisiting Heterophily For Graph Neural Networkscited by 169
  8. 2022Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisitedcited by 87
  9. 2022Graph Attention Multi-Layer Perceptroncited by 82
  10. 2023Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modelingcited by 63
  11. 2021Scalable and Adaptive Graph Neural Networks with Self-Label-Enhanced trainingcited by 54
  12. 2021AdaGNN: Graph Neural Networks with Adaptive Frequency Response Filtercited by 43
  13. 2022Improving Graph Neural Networks with Learnable Propagation Operatorscited by 19
  14. 2022Node-oriented Spectral Filtering for Graph Neural Networkscited by 17
  15. 2024Node-wise Filtering in Graph Neural Networks: A Mixture of Experts Approachcited by 17
  16. 2020Adaptive Graph Diffusion Networkscited by 13
  17. 2023Graph Neural Networks with Diverse Spectral Filteringcited by 9
  18. 2021Node-Variant Graph Filters in Graph Neural Networkscited by 7
  19. 2024Mixture of Experts Meets Decoupled Message Passing: Towards General and Adaptive Node Classificationcited by 4
  20. 2025Graph Learning at Scale: Characterizing and Optimizing Pre-Propagation GNNscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Accelerating Scalable Graph Neural Network Inference with Node-Adaptive Propagation
  2. 2023Recurrent Distance Filtering for Graph Representation Learning
  3. 2024Diffusing to the Top: Boost Graph Neural Networks with Minimal Hyperparameter Tuning
  4. 2024Sparse Decomposition of Graph Neural Networks
  5. 2026Generative Diffusion Models of Stochastic Graph Signals
  6. 2026Generalizing GNNs with Tokenized Mixture of Experts
  7. 2025ReDiSC: A Reparameterized Masked Diffusion Model for Scalable Node Classification with Structured Predictions
  8. 2026HOPPER: Learnable Hop Extraction for Linearized Graph Sequence Models