mlsanityData to 14 Oct 2026

Matcha: Mitigating Graph Structure Shifts with Test-Time Adaptation

arXiv 2410.06976 ↗First posted 9 Oct 2024cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

Powerful as they are, graph neural networks (GNNs) are known to be vulnerable to distribution shifts. Recently, test-time adaptation (TTA) has attracted attention due to its ability to adapt a pre-trained model to a target domain, without re-accessing the source domain. However, existing TTA algorithms are primarily designed for attribute shifts in vision tasks, where samples are independent. These methods perform poorly on graph data that experience structure shifts, where node connectivity differs between source and target graphs. We attribute this performance gap to the distinct impact of node attribute shifts versus graph structure shifts: the latter significantly degrades the quality of node representations and blurs the boundaries between different node categories. To address structure shifts in graphs, we propose Matcha, an innovative framework designed for effective and efficient adaptation to structure shifts by adjusting the htop-aggregation parameters in GNNs. To enhance the representation quality, we design a prediction-informed clustering loss to encourage the formation of distinct clusters for different node categories. Additionally, Matcha seamlessly integrates with existing TTA algorithms, allowing it to handle attribute shifts effectively while improving overall performance under combined structure and attribute shifts. We validate the effectiveness of Matcha on both synthetic and real-world datasets, demonstrating its robustness across various combinations of structure and attribute shifts. Our code is available at https://github.com/baowenxuan/Matcha .

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 51 of its 72 references that are in the map. First posted on arXiv 9 Oct 2024.

Builds on

51 of 72 references.

References · 51

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  4. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
  5. 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
  6. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
  7. 2020Simple and Deep Graph Convolutional Networkscited by 860
  8. 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 848
  9. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
  10. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
  11. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
  12. 2018Deep Visual Domain Adaptation: A Surveycited by 635
38 more
  1. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
  2. 2014Convex Optimization: Algorithms and Complexitycited by 575
  3. 2019Multi-scale Attributed Node Embeddingcited by 548
  4. 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 447
  5. 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
  6. 2021MEMO: Test Time Robustness via Adaptation and Augmentationcited by 377
  7. 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
  8. 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 359
  9. 2020Graph Neural Networks with Heterophilycited by 202
  10. 2022Parameter-free Online Test-time Adaptationcited by 189
  11. 2021Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networkscited by 182
  12. 2022How Powerful are Spectral Graph Neural Networkscited by 169
  13. 2018Contextual Stochastic Block Modelscited by 134
  14. 2022Data Augmentation for Deep Graph Learning: A Surveycited by 133
  15. 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 129
  16. 2021Robustness of Graph Neural Networks at Scalecited by 100
  17. 2022Out-Of-Distribution Generalization on Graphs: A Surveycited by 97
  18. 2021Shift-Robust GNNs: Overcoming the Limitations of Localized Graph Training Datacited by 87
  19. 2020Factorizable Graph Convolutional Networkscited by 79
  20. 2021OOD-GNN: Out-of-Distribution Generalized Graph Neural Networkcited by 78
  21. 2021Generalizing Graph Neural Networks on Out-Of-Distribution Graphscited by 71
  22. 2022Empowering Graph Representation Learning with Test-Time Graph Transformationcited by 67
  23. 2023On Pitfalls of Test-Time Adaptationcited by 64
  24. 2023AdaNPC: Exploring Non-Parametric Classifier for Test-Time Adaptationcited by 48
  25. 2023Structural Re-weighting Improves Graph Domain Adaptationcited by 45
  26. 2019DANE: Domain Adaptive Network Embeddingcited by 43
  27. 2022Non-IID Transfer Learning on Graphscited by 43
  28. 2023Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All?cited by 41
  29. 2023Networked Time Series Imputation via Position-aware Graph Enhanced Variational Autoencoderscited by 32
  30. 2023GraphPatcher: Mitigating Degree Bias for Graph Neural Networks via Test-time Augmentationcited by 31
  31. 2022Metropolis-Hastings Data Augmentation for Graph Neural Networkscited by 30
  32. 2023Class-Imbalanced Graph Learning without Class Rebalancingcited by 29
  33. 2024Pairwise Alignment Improves Graph Domain Adaptationcited by 25
  34. 2023Adaptive Test-Time Personalization for Federated Learningcited by 23
  35. 2021Graph Sanitation with Application to Node Classificationcited by 20
  36. 2021Source Free Unsupervised Graph Domain Adaptationcited by 18
  37. 2022Test-Time Training for Graph Neural Networkscited by 17
  38. 2022GraphTTA: Test Time Adaptation on Graph Neural Networkscited by 14

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 6.

10 papers.