mlsanityData to 14 Oct 2026

GPatcher: A Simple and Adaptive MLP Model for Alleviating Graph Heterophily

arXiv 2306.14340 ↗First posted 25 Jun 2023cs.LG cs.AI cs.SIcited by 3

Not on the map. Why?

Abstract (arXiv)

While graph heterophily has been extensively studied in recent years, a fundamental research question largely remains nascent: How and to what extent will graph heterophily affect the prediction performance of graph neural networks (GNNs)? In this paper, we aim to demystify the impact of graph heterophily on GNN spectral filters. Our theoretical results show that it is essential to design adaptive polynomial filters that adapts different degrees of graph heterophily to guarantee the generalization performance of GNNs. Inspired by our theoretical findings, we propose a simple yet powerful GNN named GPatcher by leveraging the MLP-Mixer architectures. Our approach comprises two main components: (1) an adaptive patch extractor function that automatically transforms each node's non-Euclidean graph representations to Euclidean patch representations given different degrees of heterophily, and (2) an efficient patch mixer function that learns salient node representation from both the local context information and the global positional information. Through extensive experiments, the GPatcher model demonstrates outstanding performance on node classification compared with popular homophily GNNs and state-of-the-art heterophily GNNs.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 42 references that are in the map. First posted on arXiv 25 Jun 2023.

Builds on

32 of 42 references.

References · 32

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2017Inductive Representation Learning on Large Graphscited by 6,320
  4. 2019Simplifying Graph Convolutional Networkscited by 1,477
  5. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
  6. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
  7. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
  8. 2015LINE: Large-scale Information Network Embeddingcited by 582
  9. 2019Multi-scale Attributed Node Embeddingcited by 548
  10. 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
  11. 2021A Survey of Transformerscited by 401
  12. 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
20 more
  1. 2019Multi-Label Image Recognition with Graph Convolutional Networkscited by 322
  2. 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 261
  3. 2019Semantic Graph Convolutional Networks for 3D Human Pose Regressioncited by 204
  4. 2019Position-aware Graph Neural Networkscited by 203
  5. 2020Graph Neural Networks with Heterophilycited by 202
  6. 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
  7. 2022Revisiting Heterophily For Graph Neural Networkscited by 169
  8. 2021Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillationcited by 152
  9. 2020A Semi-supervised Graph Attentive Network for Financial Fraud Detectioncited by 151
  10. 2023Do We Really Need Complicated Model Architectures For Temporal Networks?cited by 143
  11. 2021A Survey of Visual Transformerscited by 117
  12. 2022A Generalization of ViT/MLP-Mixer to Graphscited by 93
  13. 2022Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminatingcited by 57
  14. 2020SkipGNN: Predicting Molecular Interactions with Skip-Graph Networkscited by 44
  15. 2021Block Modeling-Guided Graph Convolutional Neural Networkscited by 32
  16. 2022HL-Net: Heterophily Learning Network for Scene Graph Generationcited by 22
  17. 2021Beyond Low-Pass Filters: Adaptive Feature Propagation on Graphscited by 18
  18. 2016Using Fuzzy Logic to Leverage HTML Markup for Web Page Representationcited by 15
  19. 2022Rethinking Graph Neural Networks for the Graph Coloring Problemcited by 13
  20. 2023A Graph Neural Network with Negative Message Passing for Graph Coloringcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 2.

3 papers.