mlsanityData to 14 Oct 2026

Understanding and Mitigating Under-Confidence in GNNs from the Final Layer

arXiv 2505.11335 ↗First posted 16 May 2025cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs) have demonstrated remarkable effectiveness on graph-based tasks. However, their predictive confidence is often miscalibrated, typically exhibiting under-confidence, which harms the reliability of their decisions. Existing calibration methods for GNNs normally introduce additional calibration components, which fail to capture the intrinsic relationship between the model and the prediction confidence, resulting in limited theoretical guarantees and increased computational overhead. To address this issue, we propose a simple yet efficient graph calibration method. We establish a unified theoretical framework revealing that model confidence is jointly governed by class-centroid-level and node-level calibration at the final layer. Based on this insight, we theoretically show that reducing the weight decay of the final-layer parameters alleviates GNN under-confidence by acting on the class-centroid level, while node-level calibration acts as a finer-grained complement to class-centroid-level calibration, which encourages each test node to be closer to its predicted class prototype in the final-layer representations. Extensive experiments validate the superiority of our method. The code is released at https://github.com/huangJC0429/SCAR.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 39 of its 61 references that are in the map. First posted on arXiv 16 May 2025.

Builds on

39 of 61 references.

References · 39

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2017Inductive Representation Learning on Large Graphscited by 6,320
  4. 2017On Calibration of Modern Neural Networkscited by 4,960
  5. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
  6. 2020Simple and Deep Graph Convolutional Networkscited by 860
  7. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
  8. 2019Graph Neural Networks for Social Recommendationcited by 714
  9. 2020Graph Structure Learning for Robust Graph Neural Networkscited by 371
  10. 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 364
  11. 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
  12. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
27 more
  1. 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 335
  2. 2021Graph Self-Supervised Learning: A Surveycited by 289
  3. 2020A Note on Over-Smoothing for Graph Neural Networkscited by 249
  4. 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
  5. 2020Uncertainty Aware Semi-Supervised Learning on Graph Datacited by 95
  6. 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 92
  7. 2021Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classificationcited by 80
  8. 2023Uncertainty Quantification over Graph with Conformalized Graph Neural Networkscited by 79
  9. 2023Energy-based Out-of-Distribution Detection for Graph Neural Networkscited by 68
  10. 2020Intra Order-preserving Functions for Calibration of Multi-Class Neural Networkscited by 65
  11. 2023Cluster-guided Contrastive Graph Clustering Networkcited by 60
  12. 2021Graph Trend Filtering Networks for Recommendationscited by 53
  13. 2022What Makes Graph Neural Networks Miscalibrated?cited by 40
  14. 2022FP-GNN: a versatile deep learning architecture for enhanced molecular property predictioncited by 31
  15. 2020A Survey on Graph Neural Networks for Knowledge Graph Completioncited by 26
  16. 2023CONVERT:Contrastive Graph Clustering with Reliable Augmentationcited by 23
  17. 2025On the Benefits of Attribute-Driven Graph Domain Adaptationcited by 19
  18. 2022Structure-Preserving Graph Representation Learningcited by 17
  19. 2023Robust Mid-Pass Filtering Graph Convolutional Networkscited by 17
  20. 2024Dual Test-time Training for Out-of-distribution Recommender Systemcited by 16
  21. 2024Energy-based Epistemic Uncertainty for Graph Neural Networkscited by 14
  22. 2023SimCalib: Graph Neural Network Calibration based on Similarity between Nodescited by 10
  23. 2024Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspectivecited by 7
  24. 2022Revisiting the role of heterophily in graph representation learning: An edge classification perspectivecited by 6
  25. 2024Enhancing the Influence of Labels on Unlabeled Nodes in Graph Convolutional Networkscited by 4
  26. 2024HG-Adapter: Improving Pre-Trained Heterogeneous Graph Neural Networks with Dual Adapterscited by 2
  27. 2023Building Shortcuts between Distant Nodes with Biaffine Mapping for Graph Convolutional Networkscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.