Are Graph Neural Networks Miscalibrated?
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) have proven to be successful in many classification tasks, outperforming previous state-of-the-art methods in terms of accuracy. However, accuracy alone is not enough for high-stakes decision making. Decision makers want to know the likelihood that a specific GNN prediction is correct. For this purpose, obtaining calibrated models is essential. In this work, we perform an empirical evaluation of the calibration of state-of-the-art GNNs on multiple datasets. Our experiments show that GNNs can be calibrated in some datasets but also badly miscalibrated in others, and that state-of-the-art calibration methods are helpful but do not fix the problem.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 2; 2024: 3; 2025: 2; 2026: 1.
14 papers.
Sort:
- 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 91
- 2022What Makes Graph Neural Networks Miscalibrated?cited by 39
- 2023SimCalib: Graph Neural Network Calibration based on Similarity between Nodescited by 10
- 2022On Calibration of Graph Neural Networks for Node Classificationcited by 9
- 2022A Graph Is More Than Its Nodes: Towards Structured Uncertainty-Aware Learning on Graphscited by 6
- 2023On the Temperature of Bayesian Graph Neural Networks for Conformal Predictioncited by 4
- 2024In-n-Out: Calibrating Graph Neural Networks for Link Predictioncited by 3
- 2024Uncertainty Quantification on Graph Learning: A Surveycited by 3
- 2024GETS: Ensemble Temperature Scaling for Calibration in Graph Neural Networkscited by 3
- 2025Multimodal Graph Representation Learning for Robust Surgical Workflow Recognition with Adversarial Feature Disentanglementcited by 3
- 2021CoG: a Two-View Co-training Framework for Defending Adversarial Attacks on Graphcited by 1
- 2025Efficient quantification on large-scale networkscited by 1
2 more
- 2026HoTS: Homophily-Aware Temperature Scaling for Graph Neural Network Calibration26 Sep 2026
- 2025Multimodal Graph Representation Learning for Robust Surgical Workflow Recognition with Adversarial Feature Disentanglement3 May 2025
- 2025Efficient quantification on large-scale networks19 Mar 2025
- 2024GETS: Ensemble Temperature Scaling for Calibration in Graph Neural Networks12 Oct 2024
- 2024Uncertainty Quantification on Graph Learning: A Survey23 Apr 2024
- 2024In-n-Out: Calibrating Graph Neural Networks for Link Prediction7 Mar 2024
- 2023SimCalib: Graph Neural Network Calibration based on Similarity between Nodes19 Dec 2023
- 2023On the Temperature of Bayesian Graph Neural Networks for Conformal Prediction17 Oct 2023
- 2022A Graph Is More Than Its Nodes: Towards Structured Uncertainty-Aware Learning on Graphs27 Oct 2022
- 2022What Makes Graph Neural Networks Miscalibrated?12 Oct 2022
- 2022On Calibration of Graph Neural Networks for Node Classification3 Jun 2022
- 2021Set Twister for Single-hop Node Classification17 Dec 2021
- 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 91
- 2022What Makes Graph Neural Networks Miscalibrated?cited by 39
- 2023SimCalib: Graph Neural Network Calibration based on Similarity between Nodescited by 10
- 2022On Calibration of Graph Neural Networks for Node Classificationcited by 9
- 2022A Graph Is More Than Its Nodes: Towards Structured Uncertainty-Aware Learning on Graphscited by 6
- 2023On the Temperature of Bayesian Graph Neural Networks for Conformal Predictioncited by 4
- 2024In-n-Out: Calibrating Graph Neural Networks for Link Predictioncited by 3
- 2024Uncertainty Quantification on Graph Learning: A Surveycited by 3
- 2024GETS: Ensemble Temperature Scaling for Calibration in Graph Neural Networkscited by 3
- 2025Multimodal Graph Representation Learning for Robust Surgical Workflow Recognition with Adversarial Feature Disentanglementcited by 3
- 2021CoG: a Two-View Co-training Framework for Defending Adversarial Attacks on Graphcited by 1
- 2025Efficient quantification on large-scale networkscited by 1
12 most cited of 14 All 14 (JSON)
- 2026HoTS: Homophily-Aware Temperature Scaling for Graph Neural Network Calibration26 Sep 2026
- 2025Multimodal Graph Representation Learning for Robust Surgical Workflow Recognition with Adversarial Feature Disentanglement3 May 2025
- 2025Efficient quantification on large-scale networks19 Mar 2025
- 2024GETS: Ensemble Temperature Scaling for Calibration in Graph Neural Networks12 Oct 2024
- 2024Uncertainty Quantification on Graph Learning: A Survey23 Apr 2024
- 2024In-n-Out: Calibrating Graph Neural Networks for Link Prediction7 Mar 2024
- 2023SimCalib: Graph Neural Network Calibration based on Similarity between Nodes19 Dec 2023
- 2023On the Temperature of Bayesian Graph Neural Networks for Conformal Prediction17 Oct 2023
- 2022A Graph Is More Than Its Nodes: Towards Structured Uncertainty-Aware Learning on Graphs27 Oct 2022
- 2022What Makes Graph Neural Networks Miscalibrated?12 Oct 2022
- 2022On Calibration of Graph Neural Networks for Node Classification3 Jun 2022
- 2021Set Twister for Single-hop Node Classification17 Dec 2021
12 newest of 14 All 14 (JSON)