mlsanityData to 7 Oct 2026

Rethinking Graph Generalization through the Lens of Sharpness-Aware Minimization

arXiv 2602.08855 ↗First posted 9 Feb 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs) have achieved remarkable success across various graph-based tasks but remain highly sensitive to distribution shifts. In this work, we focus on a prevalent yet under-explored phenomenon in graph generalization, Minimal Shift Flip (MSF),where test samples that slightly deviate from the training distribution are abruptly misclassified. To interpret this phenomenon, we revisit MSF through the lens of Sharpness-Aware Minimization (SAM), which characterizes the local stability and sharpness of the loss landscape while providing a theoretical foundation for modeling generalization error. To quantify loss sharpness, we introduce the concept of Local Robust Radius, measuring the smallest perturbation required to flip a prediction and establishing a theoretical link between local stability and generalization. Building on this perspective, we further observe a continual decrease in the robust radius during training, indicating weakened local stability and an increasingly sharp loss landscape that gives rise to MSF. To jointly solve the MSF phenomenon and the intractability of radius, we develop an energy-based formulation that is theoretically proven to be monotonically correlated with the robust radius, offering a tractable and principled objective for modeling flatness and stability. Building on these insights, we propose an energy-driven generative augmentation framework (E2A) that leverages energy-guided latent perturbations to generate pseudo-OOD samples and enhance model generalization. Extensive experiments across multiple benchmarks demonstrate that E2A consistently improves graph OOD generalization, outperforming state-of-the-art baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 57 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

39 of 57 references.

References · 39

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  4. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  8. 2019Invariant Risk Minimizationcited by 1,832
  9. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
  10. 2020Energy-based Out-of-distribution Detectioncited by 1,296
  11. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
  12. 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
27 more
  1. 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 402
  2. 2022Improving Out-of-Distribution Robustness via Selective Augmentationcited by 202
  3. 2022Discovering Invariant Rationales for Graph Neural Networkscited by 186
  4. 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
  5. 2022G-Mixup: Graph Data Augmentation for Graph Classificationcited by 145
  6. 2022Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphscited by 144
  7. 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 140
  8. 2021Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat Minimacited by 118
  9. 2019Graph Adversarial Training: Dynamically Regularizing Based on Graph Structurecited by 93
  10. 2022Graph Rationalization with Environment-based Augmentationscited by 70
  11. 2019Graph Transfer Learning via Adversarial Domain Adaptation with Graph Convolutioncited by 67
  12. 2023Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalizationcited by 57
  13. 2022DrugOOD: Out-of-Distribution (OOD) Dataset Curator and Benchmark for AI-aided Drug Discovery -- A Focus on Affinity Prediction Problems with Noise Annotationscited by 54
  14. 2023Does Invariant Graph Learning via Environment Augmentation Learn Invariance?cited by 42
  15. 2023Mind the Label Shift of Augmentation-based Graph OOD Generalizationcited by 34
  16. 2018Domain Adaptation with Adversarial Training and Graph Embeddingscited by 30
  17. 2023Joint Learning of Label and Environment Causal Independence for Graph Out-of-Distribution Generalizationcited by 29
  18. 2023Learning Invariant Molecular Representation in Latent Discrete Spacecited by 19
  19. 2024GOODAT: Towards Test-time Graph Out-of-Distribution Detectioncited by 17
  20. 2021CAP: Co-Adversarial Perturbation on Weights and Features for Improving Generalization of Graph Neural Networkscited by 15
  21. 2025GOLD: Graph Out-of-Distribution Detection via Implicit Adversarial Latent Generationcited by 15
  22. 2024Empowering Graph Invariance Learning with Deep Spurious Infomaxcited by 14
  23. 2024Investigating Out-of-Distribution Generalization of GNNs: An Architecture Perspectivecited by 13
  24. 2023Domain-adaptive Message Passing Graph Neural Networkcited by 10
  25. 2022Finding Diverse and Predictable Subgraphs for Graph Domain Generalizationcited by 9
  26. 2024Improving out-of-distribution generalization in graphs via hierarchical semantic environmentscited by 5
  27. 2025Quantifying Distributional Invariance in Causal Subgraph for IRM-Free Graph Generalizationcited by 2

Built on by

Not cited yet.