mlsanityData to 14 Oct 2026

Residual Reweighted Conformal Prediction for Graph Neural Networks

arXiv 2506.07854 ↗First posted 9 Jun 2025cs.LG cs.AI stat.MLcited by 2

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs) excel at modeling relational data but face significant challenges in high-stakes domains due to unquantified uncertainty. Conformal prediction (CP) offers statistical coverage guarantees, but existing methods often produce overly conservative prediction intervals that fail to account for graph heteroscedasticity and structural biases. While residual reweighting CP variants address some of these limitations, they neglect graph topology, cluster-specific uncertainties, and risk data leakage by reusing training sets. To address these issues, we propose Residual Reweighted GNN (RR-GNN), a framework designed to generate minimal prediction sets with provable marginal coverage guarantees. RR-GNN introduces three major innovations to enhance prediction performance. First, it employs Graph-Structured Mondrian CP to partition nodes or edges into communities based on topological features, ensuring cluster-conditional coverage that reflects heterogeneity. Second, it uses Residual-Adaptive Nonconformity Scores by training a secondary GNN on a held-out calibration set to estimate task-specific residuals, dynamically adjusting prediction intervals according to node or edge uncertainty. Third, it adopts a Cross-Training Protocol, which alternates the optimization of the primary GNN and the residual predictor to prevent information leakage while maintaining graph dependencies. We validate RR-GNN on 15 real-world graphs across diverse tasks, including node classification, regression, and edge weight prediction. Compared to CP baselines, RR-GNN achieves improved efficiency over state-of-the-art methods, with no loss of coverage.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 57 of its 84 references that are in the map. First posted on arXiv 9 Jun 2025.

Builds on

57 of 84 references.

References · 57

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2017Inductive Representation Learning on Large Graphscited by 6,320
  4. 2017On Calibration of Modern Neural Networkscited by 4,960
  5. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  6. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  7. 2016Variational Graph Auto-Encoderscited by 1,382
  8. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
  9. 2019Heterogeneous Graph Attention Networkcited by 734
  10. 2016Distribution-Free Predictive Inference For Regressioncited by 668
  11. 2019Conformalized Quantile Regressioncited by 629
  12. 2020Graph Neural Networks in Recommender Systems: A Surveycited by 494
38 more
  1. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  2. 2020Classification with Valid and Adaptive Coveragecited by 396
  3. 2021Adaptive Conformal Inference Under Distribution Shiftcited by 375
  4. 2020Uncertainty Sets for Image Classifiers using Conformal Predictioncited by 366
  5. 2017Deep Models Under the GAN: Information Leakage from Collaborative Deep Learningcited by 334
  6. 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
  7. 2020Fast Differentiable Sorting and Rankingcited by 197
  8. 2020Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learningcited by 190
  9. 2022Adaptive Conformal Predictions for Time Seriescited by 161
  10. 2020Conformal Inference of Counterfactuals and Individual Treatment Effectscited by 151
  11. 2021Localized Conformal Prediction: A Generalized Inference Framework for Conformal Predictioncited by 114
  12. 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 92
  13. 2020Line Graph Neural Networks for Link Predictioncited by 89
  14. 2021Graph Representation Learning in Biomedicinecited by 80
  15. 2023Uncertainty Quantification over Graph with Conformalized Graph Neural Networkscited by 79
  16. 2022Selection by Prediction with Conformal p-valuescited by 69
  17. 2018NeVAE: A Deep Generative Model for Molecular Graphscited by 67
  18. 2020NoPeek: Information leakage reduction to share activations in distributed deep learningcited by 66
  19. 2021Sensitivity Analysis of Individual Treatment Effects: A Robust Conformal Inference Approachcited by 62
  20. 2014Regression Conformal Prediction with Nearest Neighbourscited by 59
  21. 2021AC/DC: Alternating Compressed/DeCompressed Training of Deep Neural Networkscited by 59
  22. 2021Conformal Sensitivity Analysis for Individual Treatment Effectscited by 40
  23. 2022What Makes Graph Neural Networks Miscalibrated?cited by 40
  24. 2021Variational Graph Normalized Auto-Encoderscited by 29
  25. 2022Distribution Free Prediction Sets for Node Classificationcited by 28
  26. 2022Split Localized Conformal Predictioncited by 23
  27. 2022Directed Graph Auto-Encoderscited by 22
  28. 2024Trustworthy Classification through Rank-Based Conformal Prediction Setscited by 20
  29. 2019Conformal Prediction Interval Estimations with an Application to Day-Ahead and Intraday Power Marketscited by 19
  30. 2021Anomalous Edge Detection in Edge Exchangeable Social Network Modelscited by 17
  31. 2024Conformal Load Prediction with Transductive Graph Autoencoderscited by 11
  32. 2024Conformal Thresholded Intervals for Efficient Regressioncited by 11
  33. 2024Game-Theoretic Defenses for Robust Conformal Prediction Against Adversarial Attacks in Medical Imagingcited by 10
  34. 2024Entropy Reweighted Conformal Classificationcited by 8
  35. 2024Conformalized Interval Arithmetic with Symmetric Calibrationcited by 8
  36. 2025Conditional Conformal Risk Adaptationcited by 7
  37. 2023Bi-Level Attention Graph Neural Networkscited by 6
  38. 2025Enhancing Trustworthiness of Graph Neural Networks with Rank-Based Conformal Trainingcited by 6

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.