Understanding and Mitigating Under-Confidence in GNNs from the Final Layer
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) have demonstrated remarkable effectiveness on graph-based tasks. However, their predictive confidence is often miscalibrated, typically exhibiting under-confidence, which harms the reliability of their decisions. Existing calibration methods for GNNs normally introduce additional calibration components, which fail to capture the intrinsic relationship between the model and the prediction confidence, resulting in limited theoretical guarantees and increased computational overhead. To address this issue, we propose a simple yet efficient graph calibration method. We establish a unified theoretical framework revealing that model confidence is jointly governed by class-centroid-level and node-level calibration at the final layer. Based on this insight, we theoretically show that reducing the weight decay of the final-layer parameters alleviates GNN under-confidence by acting on the class-centroid level, while node-level calibration acts as a finer-grained complement to class-centroid-level calibration, which encourages each test node to be closer to its predicted class prototype in the final-layer representations. Extensive experiments validate the superiority of our method. The code is released at https://github.com/huangJC0429/SCAR.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 39 of its 61 references that are in the map. First posted on arXiv 16 May 2025.
Builds on
39 of 61 references.
References · 39
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
- 2020Simple and Deep Graph Convolutional Networkscited by 860
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2019Graph Neural Networks for Social Recommendationcited by 714
- 2020Graph Structure Learning for Robust Graph Neural Networkscited by 371
- 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 364
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 362
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
27 more
- 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 335
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2020A Note on Over-Smoothing for Graph Neural Networkscited by 249
- 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
- 2020Uncertainty Aware Semi-Supervised Learning on Graph Datacited by 95
- 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 92
- 2021Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classificationcited by 80
- 2023Uncertainty Quantification over Graph with Conformalized Graph Neural Networkscited by 79
- 2023Energy-based Out-of-Distribution Detection for Graph Neural Networkscited by 68
- 2020Intra Order-preserving Functions for Calibration of Multi-Class Neural Networkscited by 65
- 2023Cluster-guided Contrastive Graph Clustering Networkcited by 60
- 2021Graph Trend Filtering Networks for Recommendationscited by 53
- 2022What Makes Graph Neural Networks Miscalibrated?cited by 40
- 2022FP-GNN: a versatile deep learning architecture for enhanced molecular property predictioncited by 31
- 2020A Survey on Graph Neural Networks for Knowledge Graph Completioncited by 26
- 2023CONVERT:Contrastive Graph Clustering with Reliable Augmentationcited by 23
- 2025On the Benefits of Attribute-Driven Graph Domain Adaptationcited by 19
- 2022Structure-Preserving Graph Representation Learningcited by 17
- 2023Robust Mid-Pass Filtering Graph Convolutional Networkscited by 17
- 2024Dual Test-time Training for Out-of-distribution Recommender Systemcited by 16
- 2024Energy-based Epistemic Uncertainty for Graph Neural Networkscited by 14
- 2023SimCalib: Graph Neural Network Calibration based on Similarity between Nodescited by 10
- 2024Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspectivecited by 7
- 2022Revisiting the role of heterophily in graph representation learning: An edge classification perspectivecited by 6
- 2024Enhancing the Influence of Labels on Unlabeled Nodes in Graph Convolutional Networkscited by 4
- 2024HG-Adapter: Improving Pre-Trained Heterogeneous Graph Neural Networks with Dual Adapterscited by 2
- 2023Building Shortcuts between Distant Nodes with Biaffine Mapping for Graph Convolutional Networkscited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025OFFSET: Segmentation-based Focus Shift Revision for Composed Image Retrievalcited by 40
- 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrievalcited by 32
- 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrievalcited by 17
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 15
- 2026IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrievalcited by 1
- 2025Global-Graph Guided and Local-Graph Weighted Contrastive Learning for Unified Clustering on Incomplete and Noise Multi-View Datacited by 0
- 2026IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrieval6 Jun 2026
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrieval23 Apr 2026
- 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrieval22 Apr 2026
- 2025Global-Graph Guided and Local-Graph Weighted Contrastive Learning for Unified Clustering on Incomplete and Noise Multi-View Data25 Dec 2025
- 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrieval2 Dec 2025
- 2025OFFSET: Segmentation-based Focus Shift Revision for Composed Image Retrieval8 Jul 2025