Residual Reweighted Conformal Prediction for Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) excel at modeling relational data but face significant challenges in high-stakes domains due to unquantified uncertainty. Conformal prediction (CP) offers statistical coverage guarantees, but existing methods often produce overly conservative prediction intervals that fail to account for graph heteroscedasticity and structural biases. While residual reweighting CP variants address some of these limitations, they neglect graph topology, cluster-specific uncertainties, and risk data leakage by reusing training sets. To address these issues, we propose Residual Reweighted GNN (RR-GNN), a framework designed to generate minimal prediction sets with provable marginal coverage guarantees. RR-GNN introduces three major innovations to enhance prediction performance. First, it employs Graph-Structured Mondrian CP to partition nodes or edges into communities based on topological features, ensuring cluster-conditional coverage that reflects heterogeneity. Second, it uses Residual-Adaptive Nonconformity Scores by training a secondary GNN on a held-out calibration set to estimate task-specific residuals, dynamically adjusting prediction intervals according to node or edge uncertainty. Third, it adopts a Cross-Training Protocol, which alternates the optimization of the primary GNN and the residual predictor to prevent information leakage while maintaining graph dependencies. We validate RR-GNN on 15 real-world graphs across diverse tasks, including node classification, regression, and edge weight prediction. Compared to CP baselines, RR-GNN achieves improved efficiency over state-of-the-art methods, with no loss of coverage.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 57 of its 84 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
57 of 84 references.
References · 57
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
- 2019Heterogeneous Graph Attention Networkcited by 734
- 2016Distribution-Free Predictive Inference For Regressioncited by 668
- 2019Conformalized Quantile Regressioncited by 629
- 2020Graph Neural Networks in Recommender Systems: A Surveycited by 494
38 more
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2020Classification with Valid and Adaptive Coveragecited by 396
- 2021Adaptive Conformal Inference Under Distribution Shiftcited by 375
- 2020Uncertainty Sets for Image Classifiers using Conformal Predictioncited by 366
- 2017Deep Models Under the GAN: Information Leakage from Collaborative Deep Learningcited by 334
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
- 2020Fast Differentiable Sorting and Rankingcited by 197
- 2020Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learningcited by 190
- 2022Adaptive Conformal Predictions for Time Seriescited by 161
- 2020Conformal Inference of Counterfactuals and Individual Treatment Effectscited by 151
- 2021Localized Conformal Prediction: A Generalized Inference Framework for Conformal Predictioncited by 114
- 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 92
- 2020Line Graph Neural Networks for Link Predictioncited by 89
- 2021Graph Representation Learning in Biomedicinecited by 80
- 2023Uncertainty Quantification over Graph with Conformalized Graph Neural Networkscited by 79
- 2022Selection by Prediction with Conformal p-valuescited by 69
- 2018NeVAE: A Deep Generative Model for Molecular Graphscited by 67
- 2020NoPeek: Information leakage reduction to share activations in distributed deep learningcited by 66
- 2021Sensitivity Analysis of Individual Treatment Effects: A Robust Conformal Inference Approachcited by 62
- 2014Regression Conformal Prediction with Nearest Neighbourscited by 59
- 2021AC/DC: Alternating Compressed/DeCompressed Training of Deep Neural Networkscited by 59
- 2021Conformal Sensitivity Analysis for Individual Treatment Effectscited by 40
- 2022What Makes Graph Neural Networks Miscalibrated?cited by 40
- 2021Variational Graph Normalized Auto-Encoderscited by 29
- 2022Distribution Free Prediction Sets for Node Classificationcited by 28
- 2022Split Localized Conformal Predictioncited by 23
- 2022Directed Graph Auto-Encoderscited by 22
- 2024Trustworthy Classification through Rank-Based Conformal Prediction Setscited by 20
- 2019Conformal Prediction Interval Estimations with an Application to Day-Ahead and Intraday Power Marketscited by 19
- 2021Anomalous Edge Detection in Edge Exchangeable Social Network Modelscited by 17
- 2024Conformal Load Prediction with Transductive Graph Autoencoderscited by 11
- 2024Conformal Thresholded Intervals for Efficient Regressioncited by 11
- 2024Game-Theoretic Defenses for Robust Conformal Prediction Against Adversarial Attacks in Medical Imagingcited by 10
- 2024Entropy Reweighted Conformal Classificationcited by 8
- 2024Conformalized Interval Arithmetic with Symmetric Calibrationcited by 8
- 2025Conditional Conformal Risk Adaptationcited by 7
- 2023Bi-Level Attention Graph Neural Networkscited by 6
- 2025Enhancing Trustworthiness of Graph Neural Networks with Rank-Based Conformal Trainingcited by 6
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.