mlsanityData to 14 Oct 2026

Remedying Coarsening-Based GNN Training under Heterophily via Adaptive Complementary Enhancement

arXiv 2607.21885 ↗First posted 24 Jul 2026cs.LG cs.NA eess.SPcited by 0

Not on the map. Why?

Abstract (arXiv)

Coarsening-based training for graph neural networks (GNNs), i.e. training on coarsened graphs rather than the original large ones, has become a promising direction for scaling GNNs to massive graphs. However, prior work has been evaluated almost exclusively on textithomophilic graphs, leaving the more challenging textitheterophilic settings underexplored. We show, both empirically and theoretically, that existing coarsening-based training methods suffer significant performance degradation on heterophilic graphs due to inevitable loss of graph information during coarsening. To address this, we propose bf Adaptive bf Complementary bf Enhancement, a plug-and-play, model-agnostic strategy that reintegrates the information discarded in coarsening: ACE learns a projector for re-constructing original node features and applies textitanisotropic structural regularization to embed local heterophily. We further adopt textithomoscedastic uncertainty weighting to adaptively balance the combined training objective of primary coarsened-graph training loss and full-graph auxiliary loss with augmented node features re-constructed by the heterophily-aware projector. Extensive experiments show that ACE drives consistent gains on heterophilic benchmarks while preserving competitive results on homophilic graphs with minimal computational overhead. Code is available at the GitHub repository: https://github.com/vasile-paskardlgm/ACE.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 52 references that are in the map. First posted on arXiv 24 Jul 2026.

Builds on

37 of 52 references.

References · 37

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  4. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
  5. 2017A Survey on Multi-Task Learningcited by 840
  6. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
  7. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
  8. 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
  9. 2021GRAND: Graph Neural Diffusioncited by 258
  10. 2020A Note on Over-Smoothing for Graph Neural Networkscited by 249
  11. 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
  12. 2022Finding Global Homophily in Graph Neural Networks When Meeting Heterophilycited by 179
25 more
  1. 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
  2. 2021Graph Condensation for Graph Neural Networkscited by 150
  3. 2023SGFormer: Simplifying and Empowering Transformers for Large-Graph Representationscited by 133
  4. 2020A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sourcescited by 126
  5. 2021PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equationscited by 106
  6. 2021Scaling Up Graph Neural Networks Via Graph Coarseningcited by 80
  7. 2024Polynormer: Polynomial-Expressive Graph Transformer in Linear Timecited by 65
  8. 2022Understanding convolution on graphs via energiescited by 59
  9. 2024A Comprehensive Survey on Graph Reduction: Sparsification, Coarsening, and Condensationcited by 57
  10. 2018Spectrally approximating large graphs with smaller graphscited by 56
  11. 2020Graph Neural Networks: Taxonomy, Advances and Trendscited by 48
  12. 2023A Fractional Graph Laplacian Approach to Oversmoothingcited by 45
  13. 2018Graph Coarsening with Preserved Spectral Propertiescited by 41
  14. 2022Optimization-Induced Graph Implicit Nonlinear Diffusioncited by 28
  15. 2023From Continuous Dynamics to Graph Neural Networks: Neural Diffusion and Beyondcited by 26
  16. 2019Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimatorcited by 25
  17. 2021Graph coarsening: From scientific computing to machine learningcited by 21
  18. 2020Faster Graph Embeddings via Coarseningcited by 15
  19. 2023A Gromov--Wasserstein Geometric View of Spectrum-Preserving Graph Coarseningcited by 15
  20. 2022A Unified Framework for Optimization-Based Graph Coarseningcited by 9
  21. 2024Graph Coarsening with Message-Passing Guaranteescited by 9
  22. 2024Graph Coarsening via Supervised Granular-Ball for Scalable Graph Neural Network Trainingcited by 9
  23. 2023Re-Think and Re-Design Graph Neural Networks in Spaces of Continuous Graph Diffusion Functionalscited by 8
  24. 2024AGS-GNN: Attribute-guided Sampling for Graph Neural Networkscited by 6
  25. 2025Scalable Graph Condensation with Evolving Capabilitiescited by 6

Built on by

Not cited yet.